# SWE-bench Verified side-by-side rerun archive

**Archival backup only. The benchmark environment integrity gate failed. These results are excluded from the main study tables and verdicts.**

## Publication decision

On 2026-10-28 the user chose to retain the original published SWE-bench Verified results and exclude the entire new side-by-side rerun from the main comparison. FP8 KV and BLASST results in this archive are not added to the main comparison. The existing main results are not replaced by a reduced task subset.

Confirmed matching-task solution propagation, combined with incomplete tool histories, prevents certifying an independent comparison or bounding total contamination. The entire rerun therefore stays outside the main comparison. Retaining the original results is the publication decision; it is not a new certification of the earlier environment.

The user requested this separate backup, including all new SWE results, the incident, and the decision, and authorized its HF sync:

> Let's do the second option, but have an SWE_rerun.md in doc and hf sync it, put all new swe results there, the incidence, and our decision just as a backup.

ARCHIVE AUTHORIZATION 2026-10-28: new SWE scores may be read for this backup only; the integrity gate is NOT passed.

This decision supersedes the earlier plan to promote the rerun into the main Table 1 and composed verdicts. It authorizes archive-only score access after the score-free integrity investigation. It does not declare `IMAGES OK`, create an `sxs COMPLETE` line, or turn the failed environment gate into a pass. The canonical registered reader's `--run` and its canonical START marker and outputs remain unused. Independent Terminal-Bench rule-P corrections are not revoked by this SWE publication decision.

Recorded before first archive score access: **2026-10-28T15:42:37.649291-07:00**.

## Experiment and interpretation

The rerun covers **Qwen3.8-27B**, SWE-bench Verified's **500 instances**, seeds **42, 43, 44**, and **13 methods**: dense bf16; Jet-QSparse dense NVFP4, rho 0.40, rho 0.60, N = 32, N = 64, N = 128; Quest; SparQ; Loki; TriAttention; TRT-LLM FP8 KV plus FP8 attention; and BLASST t50. There are 39 arm-seed runs and 336 shard units (Quest uses 16 shards; the other arms use eight).

The registered order is a permuted-block order over seed and instance slices. Each arm retains its recorded engine snapshot, configuration fragment, sampling and per-episode budgets. Per-arm snapshots are recorded in `scripts/sparse/bl2/jqs_sxs_arms.py` and `log/sparse/dev/bigmodels/bl2/sxs/arm_table_v1.json`: the Jet-QSparse arms use `fsnap-10020414`, and the reference/comparison arms use `final1001`. The Jet-QSparse dense NVFP4 reference (`jqs_f_dense`) uses `decode: dense` and attends every block. The five sparse configurations use an NVFP4 cache, dense NVFP4 QK and decode-only sparse PV. Two-level arms are not included. No training, weights, architecture, kernels, or benchmark budgets were changed for this archive.

Rates and statistical labels from the side-by-side rerun describe the **observed compromised-condition rerun**, not a validated fair comparison or a replacement for the main paper's results. A patch read followed by an identical edit establishes solution propagation, not the counterfactual change in task outcome or overall benchmark performance. No claim of a contamination-free or lossless experiment is supported by this archive.

The statistical rule remains: detected loss requires paired p < 0.05 and BH q < 0.10; p < 0.05 alone is nominal; non-detection is accompanied by MDD80. RULER does not enter the lossless criterion or the non-RULER BH families. It is not remeasured here.

## Environment integrity incident

The environment pin includes a CPython installation manifest over file paths and sizes, excluding `__pycache__` and `.pyc`. Recorded: 4,532 files, MD5 `b015c8a11ac14d630457b48421d9b6e4`. Measured: 4,535 files, MD5 `a8dbb2906eb02bcc19eac621a98660ac`. Excluding the three additions in memory reproduces the original manifest exactly. The CPython and uv executables match their separately recorded digests. A path-and-size manifest cannot exclude same-size or transient historical changes.

| Added file | Bytes | Recorded mtime PDT | SHA256 |
|---|---:|---|---|
| FIX_NOTES.md | 1,892 | 2026-10-26 11:55:16.758237 | 78bdffc5a75c1ac901b9a7208ec79a45ed81e61181f6fe04d67ec1cfd45b4638 |
| fix_wrap_in_tex.patch | 741 | 2026-10-26 11:55:16.750915 | 4c125b22d198de79f29e77b8543e2c3693ca7947515492c4af0a497b96a5d109 |
| _q4 | 1 | 2026-10-27 03:29:23.707827 | 2d711642b726b04401627ca9fbac32f5c8530fb1903cc4db02258717921a4881 |

The v1 launcher's hold-header check expects `# sxs hold v1`, whereas the registered v2 launcher and actual hold file use `# sxs hold v2`; v2's lockout check passes. This explains the benign v1 mismatch and does not resolve the image-manifest failure. Repeated manifest checks during the investigation were stable. The tree-root mtime 2026-10-27 11:16:29 PDT remains unexplained; stable later checks cannot exclude transient earlier writes.

All 925 saved attempt environment files configure the same shared CPython tree at `/opt/py312` without a `:ro` qualifier. The files are readable across sandboxes. The registered home-isolation probes check home exposure and selected proc routes; they do not audit this shared Python path or per-file reads.

The notes and patch match, byte for byte, files archived for Jet-QSparse dense NVFP4 seed42, task `matplotlib__matplotlib-21568` (problem index 259), associated with attempt `293539_0`, under `method_jqs_f_dense_sxs/swebench/seed42/shard4of8/rowfix_20261026_160824/xfer/nel_xfer_259_0/`. The archived mtimes precede the shared copies, but copied mtimes do not prove copy direction. Standard harness transfer uses separate task-specific `/output` and `/input` mounts and provides no automatic copy into `/opt/py312`. The relevant attempt has a timeout stub instead of its actual tool trajectory, despite 141 recorded model calls. **The exact writer of the shared copies remains unknown.** `_q4`'s writer is also unknown.

A retained TRT-LLM FP8 KV episode on that same Matplotlib instance, seed42, shard4of8, attempt `293534_1`, read the entire shared patch at recorded trajectory time 2026-10-26 15:39:13 (step 48). At 15:43:22 (step 56) it edited `/testbed/lib/matplotlib/dates.py` with the identical added block. Its subsequent diff has the same five additions and two removals as the shared patch. There was no equivalent target-file edit before the read in its recorded history. It later read the complete shared notes. This demonstrates shared-solution propagation into a retained matching-task episode.

Twenty confirmed artifact-reading episodes across ten arms remain selected by the final last-verified-row rule (task, repeat, exact latency and tokens were matched without inspecting outcomes during the audit). They span 19 distinct tasks. One episode received only a patch header; the others received substantial or complete solution text. Other explicit read attempts had missing observations. The following task-index union is the minimum observed-exposure set, **not an exclusion applied to the results below**:

`39, 80, 106, 133, 144, 168, 259, 294, 378, 424, 435, 438, 443, 450, 455, 467, 484, 485, 499`

The score-free audit covered 1,802 inference files, 21,395,654,141 bytes and 41,101 stored JSONL rows across all 19,500 arm-seed-task keys. After duplicate snapshot payloads were removed, 1,377 distinct saved episode-row payloads were single-system timeout stubs and three had empty trajectories. There were 136 episode keys across 71 tasks with no substantive tool trace anywhere; 779 keys had both a timeout stub and another substantive trace. Consequently, observed reader counts are lower bounds, and a performance bound restricted to those readers would be conditional rather than a bound on total contamination.

A later candidate-screening calculation found 295 tasks with at least one missing-action-history row and 128 with an artifact filename mention. Removing known exposures plus any history gap leaves 199 tasks; additionally excluding all mentions leaves 162. These were outcome-blind proposals, not approved or applied analyses. The user chose to retain the original main SWE results and archive the entire new rerun instead.

### Retained episodes with confirmed artifact reads

This table preserves the outcome-blind exposure finding. A foreign-task read does not by itself prove an outcome change. The Matplotlib FP8 KV episode is the confirmed matching-task propagation case. Attempt IDs identify saved evidence; no row below is excluded from the archived score calculations. Arm keys follow the registered arm table.

| Arm | Seed | Instance | Problem index | Attempt | Observed artifact read |
|---|---:|---|---:|---|---|
| dense_sxs | 42 | django__django-13315 | 106 | 293554_0 | notes |
| dense_sxs | 43 | sympy__sympy-18763 | 467 | 293769_0 | patch |
| jqs_f_dense_sxs | 42 | sympy__sympy-14248 | 443 | 293602_0 | patch |
| jqs_f_r60_sxs | 42 | sympy__sympy-15599 | 450 | 293610_0 | patch |
| jqs_f_r60_sxs | 42 | sympy__sympy-22080 | 485 | 293610_1 | notes; also attempted _q4 |
| jqs_f_r60_sxs | 43 | sympy__sympy-21930 | 484 | 293768_0 | notes and patch |
| jqs_f_u128_sxs | 42 | sympy__sympy-24661 | 499 | 293611_1 | patch |
| jqs_f_u128_sxs | 42 | django__django-14140 | 144 | 293711_0 | patch |
| jqs_f_u128_sxs | 44 | sphinx-doc__sphinx-9711 | 424 | 293730_0 | patch |
| jqs_f_u32_sxs | 42 | sympy__sympy-13798 | 438 | 293605_0 | patch |
| jqs_f_u32_sxs | 44 | django__django-14771 | 168 | 304328_0 | patch |
| jqs_f_u64_sxs | 44 | django__django-13837 | 133 | 293696_0 | patch |
| jqs_f_u64_sxs | 42 | scikit-learn__scikit-learn-26194 | 378 | 293684_0 | patch |
| blasst_t50_s1_sxs | 42 | sympy__sympy-13615 | 435 | 293677_1 | partial notes |
| fp8kv_s1_sxs | 42 | matplotlib__matplotlib-21568 | 259 | 293534_1 | full patch, later full notes; matching-task edit |
| fp8kv_s1_sxs | 43 | sympy__sympy-16597 | 455 | 293770_0 | patch |
| fp8kv_s1_sxs | 44 | sympy__sympy-13798 | 438 | 293718_0 | patch |
| loki_k25_d25_s1_sxs | 42 | django__django-12308 | 80 | 293552_0 | notes |
| tri_b4096_s1_sxs | 43 | psf__requests-2317 | 294 | 293578_0 | patch header only |
| tri_b4096_s1_sxs | 44 | django__django-11206 | 39 | 293669_0 | patch |

Evidence is in the corresponding `method_<arm>/swebench/seed<seed>/shard*/` inference JSONL files, including `rowfix_*` snapshots where applicable. The shared-file evidence is preserved in place; it was not removed or changed. The exact matching-task trace is attempt `293534_1`, `inference_log.jsonl` row 6 (steps 48, 56, 60 and 78), with the duplicate rowfix snapshot `rowfix_20261026_174012`.

### Integrity recommendation and dependencies

Keep all rerun rates and calculated labels as compromised-condition archival observations. Do not promote a retrospectively screened task subset as contamination-free: missing histories and the shared writable path prevent that certification. The source-copy direction and exact writer remain unresolved.

A future accepted rerun would require a separate user decision authorizing benchmark work. Before such work, the proposed controls are read-only shared interpreter/tool mounts, private per-episode writable and JIT temporary directories, cross-sandbox write/read probes, and immutable before/after manifests with retained tool histories. No such code changes, remediation or new runs were performed here.

## Other recorded campaign incidents and signals

The registered set-asides preserve two void failed-test allocations, five replica-OOM windows and two executor-death windows. The campaign also experienced job-cgroup OOMs, ordinary harness exits, a no-progress attempt and an inode outage; the registered resume/set-aside procedures were used, with per-episode budgets unchanged. Three executor deaths shared the stale `/tmp/tmp*.ptx` handle signature on different nodes in Jet-QSparse arms. This supports a systemic runtime-JIT temporary-file problem rather than a single-node fault; no mid-campaign fix was applied.

Score-free monitoring recorded Quest first-episode timeout excess, per-arm verbosity differences, pooled verbosity steps, and handled executor deaths. The last saved monitor (2026-10-28 03:04 PDT; not a final monitor) reported Quest 186/1,500 first-episode timeouts versus dense 58/1,500, a verbosity spread of approximately 1.11x–1.41x, and a late pooled step over the long-running tail. The tail-composition explanation is an inference. None of these signals licensed a budget change or automatic arm-specific intervention. The full final stack record, route-(i) scan, final monitor and canonical completion record were not completed after the environment gate failed. A fresh scheduler-backed audit and final cost reconciliation also cannot be certified in the current session because Slurm controller/accounting access is unavailable. These are incomplete checks, not lost pass records or successful checks.

## New rerun results on all 500 tasks

**Archive only; compromised-condition observations. These cells do not replace main Table 1.**

Each seed cell is resolved / 500, followed by the percentage. Mean ± sample SD is across seeds 42–44. A missing row is counted as failure, matching the original reporting rule. The primary archival paired analysis drops pairs with a zero-token row; the registered zero-as-failure sensitivity is reported separately.

| Method | Seed 42 | Seed 43 | Seed 44 | Mean ± SD |
|---|---:|---:|---:|---:|
| Dense bf16 (reference) | 423/500 (84.60%) | 446/500 (89.20%) | 431/500 (86.20%) | 86.7 ± 2.3 |
| Jet-QSparse, dense NVFP4 decode | 419/500 (83.80%) | 450/500 (90.00%) | 436/500 (87.20%) | 87.0 ± 3.1 |
| Jet-QSparse, rho = 0.40 | 426/500 (85.20%) | 436/500 (87.20%) | 420/500 (84.00%) | 85.5 ± 1.6 |
| Jet-QSparse, rho = 0.60 | 432/500 (86.40%) | 454/500 (90.80%) | 429/500 (85.80%) | 87.7 ± 2.7 |
| Jet-QSparse, N = 32 | 429/500 (85.80%) | 447/500 (89.40%) | 434/500 (86.80%) | 87.3 ± 1.9 |
| Jet-QSparse, N = 64 | 437/500 (87.40%) | 447/500 (89.40%) | 438/500 (87.60%) | 88.1 ± 1.1 |
| Jet-QSparse, N = 128 | 435/500 (87.00%) | 458/500 (91.60%) | 436/500 (87.20%) | 88.6 ± 2.6 |
| Quest (2048-token budget) | 13/500 (2.60%) | 11/500 (2.20%) | 8/500 (1.60%) | 2.1 ± 0.5 |
| SparQ (r = d/8, k = S/16) | 439/500 (87.80%) | 455/500 (91.00%) | 436/500 (87.20%) | 88.7 ± 2.0 |
| Loki (k_f = d_f = 0.25) | 430/500 (86.00%) | 450/500 (90.00%) | 439/500 (87.80%) | 87.9 ± 2.0 |
| TriAttention (4096 decode tokens) | 420/500 (84.00%) | 445/500 (89.00%) | 441/500 (88.20%) | 87.1 ± 2.7 |
| TRT-LLM FP8 KV (FP8 attention, unit scale) | 431/500 (86.20%) | 455/500 (91.00%) | 430/500 (86.00%) | 87.7 ± 2.8 |
| BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors) | 435/500 (87.00%) | 458/500 (91.60%) | 426/500 (85.20%) | 87.9 ± 3.3 |

## Earlier two-baseline SWE sweep

This section backs up the earlier FP8 KV and BLASST sweep for all four models, plus the new Qwen3.8 dense control: **27 additional seed runs**, separate from the 39 rerun seed runs above. Each seed covers the original 500-instance SWE-bench Verified set. These historical windows are not pooled with the side-by-side rerun. Their inclusion here does not publish either baseline in the main comparison or certify an environment audit.

Both baseline arms used `tensorrt-jqsparse-final1001`, pinned `jet-agentic-eval-s1pin`, seeds 42–44 and eight shards per seed. The runs preceded ctl2's home-mount change. FP8 KV uses FP8 attention in prefill and decode with static unit scales. SWE BLASST uses both prefill and decode, factors 587.18 / 16.52: the untuned transferred NVIDIA t50 point. Its implementation choice is not decode-only Jet-QSparse.

| Model | Method | Seed 42 | Seed 43 | Seed 44 | Mean ± SD (%) |
|---|---|---:|---:|---:|---:|
| Qwen3.8-27B | TRT-LLM FP8 KV + FP8 attention | 427/500 (85.40%) | 450/500 (90.00%) | 430/500 (86.00%) | 87.1 ± 2.5 |
| Qwen3.8-27B | BLASST t50 | 428/500 (85.60%) | 447/500 (89.40%) | 429/500 (85.80%) | 86.9 ± 2.1 |
| Qwen3.6-35B-A3B | TRT-LLM FP8 KV + FP8 attention | 345/500 (69.00%) | 340/500 (68.00%) | 347/500 (69.40%) | 68.8 ± 0.7 |
| Qwen3.6-35B-A3B | BLASST t50 | 349/500 (69.80%) | 345/500 (69.00%) | 356/500 (71.20%) | 70.0 ± 1.1 |
| Nemotron-3-Nano-30B-A3B | TRT-LLM FP8 KV + FP8 attention | 113/500 (22.60%) | 119/500 (23.80%) | 113/500 (22.60%) | 23.0 ± 0.7 |
| Nemotron-3-Nano-30B-A3B | BLASST t50 | 121/500 (24.20%) | 115/500 (23.00%) | 103/500 (20.60%) | 22.6 ± 1.8 |
| Nemotron-3.5-Lightning-30B-A3B | TRT-LLM FP8 KV + FP8 attention | 259/500 (51.80%) | 251/500 (50.20%) | 243/500 (48.60%) | 50.2 ± 1.6 |
| Nemotron-3.5-Lightning-30B-A3B | BLASST t50 | 258/500 (51.60%) | 255/500 (51.00%) | 246/500 (49.20%) | 50.6 ± 1.2 |
| Qwen3.8-27B | bf16 dense_s1d control | 425/500 (85.00%) | 457/500 (91.40%) | 431/500 (86.20%) | 87.5 ± 3.4 |

The later Qwen3.8 `dense_s1d` control is 87.5 ± 3.4%, versus the original `dense_s1` 82.7 ± 3.7%. The saved control gate fired a window effect. Apparent gains by the two earlier Qwen3.8 baseline arms against the historical reference are therefore window-confounded. The registered descriptive comparisons against `dense_s1d` report no detected loss with MDD80 2.54 pp (FP8 KV) and 2.38 pp (BLASST); these are not claims of improvement.

The recheck confirms 500 distinct final instances in all 27 seed runs. Qwen3.8 FP8 KV has zero-token final-row counts [2, 0, 1], BLASST [2, 0, 2], and dense_s1d [4, 0, 2]; they remain failures in the descriptive denominator. The other six model-arm cells have none. The full-sweep provenance audit records 709 attempts, 487 served, all served engine/config checks matching, with zero recorded problems; that historical check does not pass the later rerun's environment gate.

### Earlier sweep paired contrasts

These are the eight saved SWE members of the original 40-contrast non-RULER B12 family. BH q values are copied from that whole family; they are not recomputed over the eight rows. The Qwen3.8 reference is the saved registered reading, with its window caveat. Paired zero-token exclusions can make these rates differ from the full-denominator table. All labels remain archival in this file.

| Model | Arm | Reference | Paired delta (pp) | 95% CI | p | BH q | MDD80 (pp) | Saved label |
|---|---|---|---:|---|---:|---:|---:|---|
| Qwen3.8-27B | fp8kv_s1 | dense_s1 | 4.54849 | [2.61097, 6.49547] | 9.999e-05 | 0.0019998 | 2.77627 | above, detected (p 0.0001, q 0.00200) |
| Qwen3.8-27B | blasst_t50_s1 | dense_s1 | 4.28094 | [2.4, 6.14379] | 9.999e-05 | 0.0019998 | 2.6757 | above, detected (p 0.0001, q 0.00200) |
| Qwen3.6-35B-A3B | fp8kv_s1 | dense_s1 | 0.333333 | [-1.28205, 1.95313] | 0.746825 | 0.952155 | 2.31219 | no detected loss (MDD80 2.31) |
| Qwen3.6-35B-A3B | blasst_t50_s1 | dense_s1 | 1.53333 | [-1.73019e-09, 3.14208] | 0.0713929 | 0.475952 | 2.24565 | no detected loss (MDD80 2.25) |
| Nemotron-3-Nano-30B-A3B | fp8kv_s1 | dense_s1 | 1.06667 | [-1.06667, 3.2] | 0.364464 | 0.850674 | 3.0494 | no detected loss (MDD80 3.05) |
| Nemotron-3-Nano-30B-A3B | blasst_t50_s1 | dense_s1 | 0.666667 | [-1.40485, 2.75591] | 0.566143 | 0.850674 | 2.97371 | no detected loss (MDD80 2.97) |
| Nemotron-3.5-Lightning-30B-A3B | fp8kv_s1 | dense_s1 | 1.8 | [-0.258398, 3.80952] | 0.0941906 | 0.538232 | 2.90736 | no detected loss (MDD80 2.91) |
| Nemotron-3.5-Lightning-30B-A3B | blasst_t50_s1 | dense_s1 | 2.2 | [0.272109, 4.10448] | 0.030397 | 0.390961 | 2.73901 | above, nominal (p 0.0304, q 0.39) |

Source output hashes and seed/shard consistency records are included in the machine-readable backup. The full saved SWE report, including its historical dense references and descriptive failure counts, follows. Its conditional infrastructure-excluded rates are diagnostics and do not replace the 500-task rates.

<details><summary>Original two-baseline SWE report, preserved verbatim</summary>

| model | arm | pass@1 per seed, % (passed/rows; * = still running, rate over rows so far) | mean +/- std (finished seeds once any has finished) | vs dense | paired vs dense (both completed, same seed) |
|---|---|---|---|---|---|
| qwen3.8-27b | dense_s1 | 80.8 (404/500) / 87.0 (435/500) / 80.4 (402/500) | 82.7 +/- 3.7 | -- | -- |
| qwen3.8-27b | fp8kv_s1 | 85.4 (427/500) / 90.0 (450/500) / 86.0 (430/500) | 87.1 +/- 2.5 | -- | -- |
| qwen3.8-27b | blasst_t50_s1 | 85.6 (428/500) / 89.4 (447/500) / 85.8 (429/500) | 86.9 +/- 2.1 | -- | -- |
| qwen3.8-27b | dense_s1d | 85.0 (425/500) / 91.4 (457/500) / 86.2 (431/500) | 87.5 +/- 3.4 | -- | -- |
| qwen3.6-35b-a3b | dense_s1 | 68.2 (341/500) / 70.0 (350/500) / 67.2 (336/500) | 68.5 +/- 1.4 | -- | -- |
| qwen3.6-35b-a3b | fp8kv_s1 | 69.0 (345/500) / 68.0 (340/500) / 69.4 (347/500) | 68.8 +/- 0.7 | -- | -- |
| qwen3.6-35b-a3b | blasst_t50_s1 | 69.8 (349/500) / 69.0 (345/500) / 71.2 (356/500) | 70.0 +/- 1.1 | -- | -- |
| nemotron3-nano | dense_s1 | 21.8 (109/500) / 23.8 (119/500) / 20.2 (101/500) | 21.9 +/- 1.8 | -- | -- |
| nemotron3-nano | fp8kv_s1 | 22.6 (113/500) / 23.8 (119/500) / 22.6 (113/500) | 23.0 +/- 0.7 | -- | -- |
| nemotron3-nano | blasst_t50_s1 | 24.2 (121/500) / 23.0 (115/500) / 20.6 (103/500) | 22.6 +/- 1.8 | -- | -- |
| nemotron3.5-lightning | dense_s1 | 48.2 (241/500) / 48.6 (243/500) / 48.4 (242/500) | 48.4 +/- 0.2 | -- | -- |
| nemotron3.5-lightning | fp8kv_s1 | 51.8 (259/500) / 50.2 (251/500) / 48.6 (243/500) | 50.2 +/- 1.6 | -- | -- |
| nemotron3.5-lightning | blasst_t50_s1 | 51.6 (258/500) / 51.0 (255/500) / 49.2 (246/500) | 50.6 +/- 1.2 | -- | -- |

Failure modes (summed over seeds; timeouts from the instance latency vs run_timeout 5400 s; HTTP codes from model_traffic.jsonl):

| model | arm | seeds (rows) | pass@1 over rows | no_report (0 tok) | agent timeouts (>= 90 min) | infra_error rows | system_error rows | solver-failed (graceful) | agent crashed | never called a tool (>= 5 calls, 0 tool_calls) | responses without a tool call (tool errors) | reward MISSING | HTTP 400 calls (instances) | other >= 400 | calls | truncated @16K | median instance min | pass@1 excl. infra + system + timeouts | harbor-log: timeouts / one-shot fallbacks / re-clones |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| qwen3.8-27b | dense_s1 | 42:500 43:500 44:500 | 82.7 (1241/1500) | 2 | 4 | 2 | 0 | 0 | 0 | 0 | 1.8% | 0 | 0 (0) | 0 | 113004 | 0.5% | 15.6 | 82.8 (1239/1496) | 0 / 0 / 0 |
| qwen3.8-27b | fp8kv_s1 | 42:500 43:500 44:500 | 87.1 (1307/1500) | 3 | 4 | 3 | 0 | 0 | 0 | 0 | 1.4% | 0 | 0 (0) | 0 | 110428 | 0.7% | 19.5 | 87.3 (1306/1496) | 39 / 0 / 0 |
| qwen3.8-27b | blasst_t50_s1 | 42:500 43:500 44:500 | 86.9 (1304/1500) | 4 | 8 | 4 | 0 | 0 | 0 | 0 | 1.5% | 0 | 0 (0) | 0 | 113660 | 0.8% | 20.6 | 87.1 (1300/1492) | 62 / 0 / 0 |
| qwen3.8-27b | dense_s1d | 42:500 43:500 44:500 | 87.5 (1313/1500) | 6 | 8 | 6 | 0 | 0 | 0 | 0 | 1.5% | 0 | 0 (0) | 0 | 112111 | 0.9% | 20.6 | 87.9 (1311/1492) | 0 / 0 / 0 |
| qwen3.6-35b-a3b | dense_s1 | 42:500 43:500 44:500 | 68.5 (1027/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4.3% | 0 | 0 (0) | 0 | 121201 | 0.0% | 4.6 | 68.5 (1027/1500) | 0 / 0 / 0 |
| qwen3.6-35b-a3b | fp8kv_s1 | 42:500 43:500 44:500 | 68.8 (1032/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4.4% | 0 | 0 (0) | 0 | 119914 | 0.0% | 4.5 | 68.8 (1032/1500) | 0 / 0 / 0 |
| qwen3.6-35b-a3b | blasst_t50_s1 | 42:500 43:500 44:500 | 70.0 (1050/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4.3% | 0 | 0 (0) | 0 | 118936 | 0.0% | 4.7 | 70.0 (1050/1500) | 0 / 0 / 0 |
| nemotron3-nano | dense_s1 | 42:500 43:500 44:500 | 21.9 (329/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14.4% | 0 | 0 (0) | 0 | 141245 | 2.0% | 5.3 | 21.9 (329/1500) | 0 / 0 / 0 |
| nemotron3-nano | fp8kv_s1 | 42:500 43:500 44:500 | 23.0 (345/1500) | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 15.8% | 0 | 0 (0) | 0 | 139850 | 1.9% | 5.4 | 23.0 (345/1499) | 1 / 0 / 0 |
| nemotron3-nano | blasst_t50_s1 | 42:500 43:500 44:500 | 22.6 (339/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14.5% | 0 | 0 (0) | 0 | 137541 | 2.2% | 5.4 | 22.6 (339/1500) | 3 / 0 / 0 |
| nemotron3.5-lightning | dense_s1 | 42:500 43:500 44:500 | 48.4 (726/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.6% | 0 | 1 (1) | 0 | 115855 | 0.0% | 5.2 | 48.4 (726/1500) | 0 / 0 / 0 |
| nemotron3.5-lightning | fp8kv_s1 | 42:500 43:500 44:500 | 50.2 (753/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.4% | 0 | 1 (1) | 0 | 123152 | 0.0% | 5.6 | 50.2 (753/1500) | 0 / 0 / 0 |
| nemotron3.5-lightning | blasst_t50_s1 | 42:500 43:500 44:500 | 50.6 (759/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.4% | 0 | 3 (3) | 0 | 114330 | 0.0% | 5.4 | 50.6 (759/1500) | 0 / 0 / 0 |

</details>

## Ctl2 environment controls

The later home-isolation check adds **nine SWE seed runs**, tagged `dense_s1e`: Qwen3.6-35B-A3B, Nemotron-3-Nano-30B-A3B and Nemotron-3.5-Lightning-30B-A3B, each with seeds 42–44. Together, this backup covers **75 new seed results**: 39 side-by-side rerun + 24 earlier FP8/BLASST + 3 dense_s1d + 9 dense_s1e.

Ctl2 used final1001, pinned `jet-agentic-eval-s1pin`, eight shards per seed, `ENROOT_MOUNT_HOME=n` with registered probes, and unchanged SWE budgets (5,400 seconds and 200 iterations). Qwen3.8 dense_s1e SWE was deliberately not a cell; ctl2 used the already-run dense_s1d control, whose home was visible. These historical environment controls do not clear the subsequent shared-CPython failure.

| Model | Control | Seed 42 | Seed 43 | Seed 44 | Mean ± SD (%) |
|---|---|---:|---:|---:|---:|
| Qwen3.6-35B-A3B | dense_s1e | 341/500 (68.20%) | 350/500 (70.00%) | 349/500 (69.80%) | 69.3 ± 1.0 |
| Nemotron-3-Nano-30B-A3B | dense_s1e | 98/500 (19.60%) | 109/500 (21.80%) | 101/500 (20.20%) | 20.5 ± 1.1 |
| Nemotron-3.5-Lightning-30B-A3B | dense_s1e | 253/500 (50.60%) | 249/500 (49.80%) | 256/500 (51.20%) | 50.5 ± 0.7 |

Seed counts above are reconstructed algebraically from the saved historical dense_s1 seed rates and ctl2 per-seed deltas; each saved SWE contrast has all 1,500 pairs. No additional evaluation was run. The resulting means equal the saved control rates.

The ctl2 environment-effect gate used its registered **per-cell p < 0.05** rule; BH q across seven control cells was descriptive. This gate is separate from the main study's method-loss verdict rule requiring both p and q thresholds.

| Model | Paired control delta (pp) | 95% CI | p | Descriptive BH q | MDD80 (pp) | Saved control reading |
|---|---:|---|---:|---:|---:|---|
| Qwen3.6-35B-A3B | 0.866667 | [-0.887199, 2.62794] | 0.373163 | 0.489134 | 2.51228 | dense_s1e - dense_s1 +0.87 [-0.89, +2.63] p 0.3732: no detected effect (MDD80 2.51 points): the published dense bf16 is reproduced at that resolution; bl2's rows of this cell are comparable with the published arms (disclosures) |
| Nemotron-3-Nano-30B-A3B | -1.4 | [-3.45781, 0.666667] | 0.20158 | 0.489134 | 2.94778 | dense_s1e - dense_s1 -1.40 [-3.46, +0.67] p 0.2016: no detected effect (MDD80 2.95 points): the published dense bf16 is reproduced at that resolution; bl2's rows of this cell are comparable with the published arms (disclosures) |
| Nemotron-3.5-Lightning-30B-A3B | 2.13333 | [-2.05196e-09, 4.2328] | 0.0514949 | 0.360464 | 3.0252 | dense_s1e - dense_s1 +2.13 [-0.00, +4.23] p 0.0515: no detected effect (MDD80 3.03 points): the published dense bf16 is reproduced at that resolution; bl2's rows of this cell are comparable with the published arms (disclosures) |

Saved `drop_u36`, `reads_failed` and `drop_linkcheck` sensitivities also report no detected effect for these three control cells. The saved SWE completion covers 72 shards. Initial test allocation `282720_0` was voided under `ctl2/void_ctl2_test_1023.json`; it is an incident artifact, not another accepted seed run. Saved home-probe completion disclosed six killed attempts with partial probe coverage. No new control, budget change or sandbox remediation was performed for this archive.

## Archived paired contrasts and family correction

The six family calculations below reuse the pre-registered numerical method, ordered contrasts, 10,000 sign flips and seed tuples. Their BH q values come from hypothetical replacement of the relevant Qwen3.8 SWE members in each full family, including the registered Terminal-Bench rule-P reading. **These calculations are backup diagnostics only: they do not replace any main family, q value, status or verdict.** MDD80 is the registered CI-based minimum detectable difference. The existing route/probe sensitivities address their earlier registered questions; they do not repair or certify away the CPython incident. Deltas, CI and MDD are in the units stored by the original family calculation (percentage points for rate contrasts).

### F1 (1) Final Jet-QSparse arm vs bf16 -- the lossless question

BH family membership: 120 contrasts; registered seed tuple `[20261024, 21, 0, 1]`. Only newly recomputed SWE members are tabulated here; full computed family membership, sensitivities and provenance are embedded below.

| Arm A | Arm B | Paired delta | 95% CI | p | BH q | MDD80 | Statistical label under observed conditions |
|---|---|---:|---|---:|---:|---:|---|
| jqs_f_dense_sxs | dense_sxs | 0.335121 | [-1.4667, 2.1333] | 0.772223 | 0.975439 | 2.57293 | no detected loss |
| jqs_f_r40_sxs | dense_sxs | -0.939597 | [-2.381, 0.52425] | 0.237776 | 0.679361 | 2.07635 | no detected loss |
| jqs_f_r60_sxs | dense_sxs | 1.00469 | [-0.53691, 2.5469] | 0.234677 | 0.679361 | 2.20402 | no detected loss |
| jqs_f_u32_sxs | dense_sxs | 0.468227 | [-1.2517, 2.1802] | 0.641436 | 0.966031 | 2.45284 | no detected loss |
| jqs_f_u64_sxs | dense_sxs | 1.40468 | [-0.13624, 2.9248] | 0.0857914 | 0.416118 | 2.18773 | no detected loss |
| jqs_f_u128_sxs | dense_sxs | 1.87291 | [0.27285, 3.4578] | 0.0258974 | 0.23312 | 2.2763 | above, nominal |

Sensitivity availability: drop_u36: complete, drop_linkcheck: complete, reads_failed: unavailable, drop_probed: complete, by_period_stack: unavailable, zero_as_failure: complete.

### B10 (10) Baselines vs bf16 -- single reference

BH family membership: 80 contrasts; registered seed tuple `[20261024, 22, 0, 1]`. Only newly recomputed SWE members are tabulated here; full computed family membership, sensitivities and provenance are embedded below.

| Arm A | Arm B | Paired delta | 95% CI | p | BH q | MDD80 | Statistical label under observed conditions |
|---|---|---:|---|---:|---:|---:|---|
| quest_b2048_s1_sxs | dense_sxs | -84.5718 | [-87.295, -81.845] | 9.999e-05 | 0.000571371 | 3.89502 | loss detected |
| sparq_c8_s1_sxs | dense_sxs | 2.07775 | [0.57554, 3.5613] | 0.00749925 | 0.029997 | 2.1339 | above, detected |
| loki_k25_d25_s1_sxs | dense_sxs | 1.27175 | [-0.28736, 2.8689] | 0.139286 | 0.331026 | 2.25575 | no detected loss |
| tri_b4096_s1_sxs | dense_sxs | 0.80591 | [-0.75643, 2.3644] | 0.349065 | 0.518545 | 2.23046 | no detected loss |

Sensitivity availability: drop_u36: complete, drop_linkcheck: complete, reads_failed: unavailable, drop_probed: complete, by_period_stack: unavailable, zero_as_failure: complete.

### B12 (12) TRT-LLM-native baselines vs bf16 (FP8 KV, BLASST t50)

BH family membership: 40 contrasts; registered seed tuple `[20261024, 23, 0, 1]`. Only newly recomputed SWE members are tabulated here; full computed family membership, sensitivities and provenance are embedded below.

| Arm A | Arm B | Paired delta | 95% CI | p | BH q | MDD80 | Statistical label under observed conditions |
|---|---|---:|---|---:|---:|---:|---|
| fp8kv_s1_sxs | dense_sxs | 1.34318 | [-0.13624, 2.8169] | 0.0886911 | 0.538232 | 2.11062 | no detected loss |
| blasst_t50_s1_sxs | dense_sxs | 1.40751 | [-0.12626, 2.8788] | 0.0792921 | 0.538232 | 2.14772 | no detected loss |

Sensitivity availability: drop_u36: complete, drop_linkcheck: complete, reads_failed: unavailable, drop_probed: complete, by_period_stack: unavailable, zero_as_failure: complete.

### F6 (6) Sparse vs dense within the final method

BH family membership: 100 contrasts; registered seed tuple `[20261024, 26, 0, 1]`. Only newly recomputed SWE members are tabulated here; full computed family membership, sensitivities and provenance are embedded below.

| Arm A | Arm B | Paired delta | 95% CI | p | BH q | MDD80 | Statistical label under observed conditions |
|---|---|---:|---|---:|---:|---:|---|
| jqs_f_r40_sxs | jqs_f_dense_sxs | -1.60966 | [-3.3333, 0.13423] | 0.0841916 | 0.472731 | 2.47828 | no detected loss |
| jqs_f_r60_sxs | jqs_f_dense_sxs | 0.669344 | [-1.0363, 2.3684] | 0.490451 | 0.915649 | 2.43334 | no detected loss |
| jqs_f_u32_sxs | jqs_f_dense_sxs | 0.13369 | [-1.7173, 1.9815] | 0.942506 | 1 | 2.64355 | no detected loss |
| jqs_f_u64_sxs | jqs_f_dense_sxs | 1.00334 | [-0.80645, 2.8205] | 0.315068 | 0.87519 | 2.5922 | no detected loss |
| jqs_f_u128_sxs | jqs_f_dense_sxs | 1.40374 | [-0.25221, 3.0261] | 0.108389 | 0.516139 | 2.34304 | no detected loss |

Sensitivity availability: drop_u36: complete, drop_linkcheck: complete, reads_failed: unavailable, drop_probed: complete, by_period_stack: unavailable, zero_as_failure: complete.

### H10 H10 head to head: Jet-QSparse final arm minus Loki / SparQ

BH family membership: 240 contrasts; registered seed tuple `[20261024, 27, 0, 1]`. Only newly recomputed SWE members are tabulated here; full computed family membership, sensitivities and provenance are embedded below.

| Arm A | Arm B | Paired delta | 95% CI | p | BH q | MDD80 | Statistical label under observed conditions |
|---|---|---:|---|---:|---:|---:|---|
| jqs_f_dense_sxs | loki_k25_d25_s1_sxs | -0.937082 | [-2.7778, 0.91503] | 0.360864 | 0.839916 | 2.63926 | no detected difference |
| jqs_f_r40_sxs | loki_k25_d25_s1_sxs | -2.2118 | [-3.7921, -0.65104] | 0.00619938 | 0.11445 | 2.24495 | below, nominal |
| jqs_f_r60_sxs | loki_k25_d25_s1_sxs | -0.200669 | [-1.8617, 1.4474] | 0.871713 | 1 | 2.365 | no detected difference |
| jqs_f_u32_sxs | loki_k25_d25_s1_sxs | -0.734803 | [-2.4045, 0.9498] | 0.442056 | 0.900011 | 2.39735 | no detected difference |
| jqs_f_u64_sxs | loki_k25_d25_s1_sxs | 0.200535 | [-1.3836, 1.7833] | 0.869513 | 1 | 2.2634 | no detected difference |
| jqs_f_u128_sxs | loki_k25_d25_s1_sxs | 0.601202 | [-0.9434, 2.1477] | 0.49545 | 0.927535 | 2.20918 | no detected difference |
| jqs_f_dense_sxs | sparq_c8_s1_sxs | -1.7438 | [-3.4819, 1.7567e-09] | 0.060094 | 0.473953 | 2.48852 | no detected difference |
| jqs_f_r40_sxs | sparq_c8_s1_sxs | -3.08725 | [-4.9034, -1.2788] | 0.0009999 | 0.029997 | 2.59055 | below, detected |
| jqs_f_r60_sxs | sparq_c8_s1_sxs | -1.13865 | [-2.8278, 0.54496] | 0.211179 | 0.696234 | 2.4105 | no detected difference |
| jqs_f_u32_sxs | sparq_c8_s1_sxs | -1.60643 | [-3.2172, 1.6202e-09] | 0.0608939 | 0.473953 | 2.29931 | no detected difference |
| jqs_f_u64_sxs | sparq_c8_s1_sxs | -0.669344 | [-2.3515, 1.0204] | 0.476252 | 0.921779 | 2.4099 | no detected difference |
| jqs_f_u128_sxs | sparq_c8_s1_sxs | -0.267738 | [-1.9178, 1.3812] | 0.812419 | 1 | 2.35782 | no detected difference |

Sensitivity availability: drop_u36: complete, drop_linkcheck: complete, reads_failed: unavailable, drop_probed: complete, by_period_stack: unavailable, zero_as_failure: complete.

### H12 H12 head to head: Jet-QSparse final arm minus FP8 KV / BLASST t50 (descriptive)

BH family membership: 240 contrasts; registered seed tuple `[20261024, 28, 0, 1]`. Only newly recomputed SWE members are tabulated here; full computed family membership, sensitivities and provenance are embedded below.

| Arm A | Arm B | Paired delta | 95% CI | p | BH q | MDD80 | Statistical label under observed conditions |
|---|---|---:|---|---:|---:|---:|---|
| jqs_f_dense_sxs | fp8kv_s1_sxs | -0.940228 | [-2.6281, 0.76433] | 0.317468 | 0.680289 | 2.4246 | no detected difference |
| jqs_f_r40_sxs | fp8kv_s1_sxs | -2.28648 | [-3.9012, -0.67024] | 0.00619938 | 0.123988 | 2.30916 | below, nominal |
| jqs_f_r60_sxs | fp8kv_s1_sxs | -0.134228 | [-1.7972, 1.5299] | 0.939906 | 1 | 2.37787 | no detected difference |
| jqs_f_u32_sxs | fp8kv_s1_sxs | -0.737265 | [-2.4828, 1.0013] | 0.459154 | 0.787121 | 2.49003 | no detected difference |
| jqs_f_u64_sxs | fp8kv_s1_sxs | 0.134138 | [-1.4531, 1.7128] | 0.938806 | 1 | 2.26267 | no detected difference |
| jqs_f_u128_sxs | fp8kv_s1_sxs | 0.603217 | [-0.93583, 2.1534] | 0.49935 | 0.820849 | 2.2079 | no detected difference |
| jqs_f_dense_sxs | blasst_t50_s1_sxs | -1.00671 | [-2.6774, 0.66578] | 0.276672 | 0.670562 | 2.38936 | no detected difference |
| jqs_f_r40_sxs | blasst_t50_s1_sxs | -2.28341 | [-3.8798, -0.68213] | 0.00549945 | 0.119988 | 2.28542 | below, nominal |
| jqs_f_r60_sxs | blasst_t50_s1_sxs | -0.402414 | [-1.9737, 1.1734] | 0.682632 | 0.916601 | 2.24923 | no detected difference |
| jqs_f_u32_sxs | blasst_t50_s1_sxs | -1.00469 | [-2.726, 0.71327] | 0.289671 | 0.670562 | 2.45803 | no detected difference |
| jqs_f_u64_sxs | blasst_t50_s1_sxs | 0 | [-1.7333, 1.7356] | 1 | 1 | 2.47929 | no detected difference |
| jqs_f_u128_sxs | blasst_t50_s1_sxs | 0.468855 | [-1.2113, 2.1448] | 0.633537 | 0.901685 | 2.3986 | no detected difference |

Sensitivity availability: drop_u36: complete, drop_linkcheck: complete, reads_failed: unavailable, drop_probed: complete, by_period_stack: unavailable, zero_as_failure: complete.

## Cross window diagnostics

These compare observed rerun rates with earlier published/control windows. They are descriptive paired diagnostics: no BH correction or method verdict. A difference is associated with the complete window conditions, including the integrity incident.

| Rerun arm | Earlier reference | Paired delta (pp) | 95% CI | p | MDD80 (pp) |
|---|---|---:|---|---:|---:|
| dense_sxs | dense_s1 | 3.94649 | [2.11864, 5.76923] | 9.999e-05 | 2.60909 |
| jqs_f_dense_sxs | jqs_f_dense | 4.15828 | [2.13068, 6.18421] | 0.00029997 | 2.89707 |
| jqs_f_r40_sxs | jqs_f_r40 | 4.15271 | [2.27596, 6.03086] | 9.999e-05 | 2.68364 |
| jqs_f_r60_sxs | jqs_f_r60 | 4.14439 | [2.21643, 6.07595] | 9.999e-05 | 2.75841 |
| jqs_f_u32_sxs | jqs_f_u32 | 4.66978 | [2.69504, 6.64011] | 9.999e-05 | 2.81955 |
| jqs_f_u64_sxs | jqs_f_u64 | 4.73649 | [2.87958, 6.58915] | 0.00019998 | 2.65124 |
| jqs_f_u128_sxs | jqs_f_u128 | 5.60748 | [3.51617, 7.69231] | 9.999e-05 | 2.9847 |
| quest_b2048_s1_sxs | quest_b2048_s1 | -2.33546 | [-3.30579, -1.36571] | 9.999e-05 | 1.38658 |
| sparq_c8_s1_sxs | sparq_c8_s1 | 4.7043 | [2.88462, 6.52174] | 9.999e-05 | 2.59946 |
| loki_k25_d25_s1_sxs | loki_k25_d25_s1 | 5.02681 | [3.29949, 6.74931] | 9.999e-05 | 2.4656 |
| tri_b4096_s1_sxs | tri_b4096_s1 | 4.56989 | [2.76316, 6.35995] | 9.999e-05 | 2.57064 |
| fp8kv_s1_sxs | fp8kv_s1 | 0.805369 | [-0.801068, 2.40113] | 0.370363 | 2.28862 |
| blasst_t50_s1_sxs | blasst_t50_s1 | 1.14017 | [-0.408163, 2.69504] | 0.179582 | 2.21787 |
| dense_sxs | dense_s1 | 3.94649 | [2.11864, 5.76923] | 9.999e-05 | 2.60909 |
| dense_sxs | dense_s1d | -0.938967 | [-2.4531, 0.550964] | 0.253875 | 2.14702 |

The repeated dense_sxs/dense_s1 row is the saved equality check between the general pair list and the dedicated window diagnostic. The additional dense_s1d comparison uses the later baseline-window control. No older and newer windows are pooled.

## Descriptive, score-free: timeouts and verbosity per arm, rerun vs published (sxs addendum v2; no test, no verdict)

Each cell: the rerun arm / its reference (the published run of the same arm; for bf16 also dense_s1d, the bl2 window control). Computed from keys, counts, times and token counts only (the attempt snapshots; 5474 files, digest 6d8ed57dbc54afafb027689d6c01c3fb); the set-asides dropped (['286984_0', '286984_1', '293540_1', '293545_0', '293577_1', '293623_0', '293641_0', '293716_0', '310103_0']). Definitions in the JSON (`score_free.definitions`).

| arm (rerun / reference) | episodes | timeouts per 100 episodes | first-attempt timeouts per 100 instances | counted zero-token rows (of them timeouts) | calls | completion tokens per call (ratio) | calls over 8K per 1,000 | cap hits per 1,000 |
|---|---|---|---|---|---|---|---|---|
| dense_sxs / dense_s1 | 1581 / 1532 | 5.19 / 2.22 | 3.87 / 1.60 | 4 (4) / 2 (2) | 119511 / 113004 | 1616 / 1171 (x1.38) | 46.5 / 25.8 | 11.48 / 5.01 |
| jqs_f_dense_sxs / jqs_f_dense | 1557 / 1550 | 4.69 / 3.55 | 3.51 / 2.33 | 4 (4) / 6 (6) | 119282 / 119018 | 1638 / 1256 (x1.30) | 47.8 / 30.3 | 11.47 / 6.56 |
| jqs_f_r40_sxs / jqs_f_r40 | 1557 / 1503 | 3.85 / 1.06 | 2.80 / 0.81 | 6 (6) / 2 (2) | 115703 / 106315 | 1322 / 945 (x1.40) | 30.2 / 15.4 | 7.91 / 3.49 |
| jqs_f_r60_sxs / jqs_f_r60 | 1530 / 1511 | 2.03 / 1.26 | 1.47 / 0.87 | 3 (3) / 2 (2) | 109484 / 105481 | 1261 / 950 (x1.33) | 26.2 / 15.1 | 5.86 / 3.14 |
| jqs_f_u32_sxs / jqs_f_u32 | 1543 / 1507 | 1.88 / 1.00 | 1.53 / 1.01 | 1 (1) / 0 (0) | 110836 / 105665 | 1288 / 966 (x1.33) | 26.6 / 14.5 | 5.21 / 1.98 |
| jqs_f_u64_sxs / jqs_f_u64 | 1537 / 1508 | 2.28 / 0.53 | 1.80 / 0.47 | 1 (1) / 0 (0) | 112296 / 107751 | 1397 / 991 (x1.41) | 32.8 / 16.6 | 6.06 / 2.34 |
| jqs_f_u128_sxs / jqs_f_u128 | 1557 / 1527 | 3.28 / 1.44 | 2.73 / 1.20 | 1 (1) / 1 (1) | 117330 / 113479 | 1478 / 1098 (x1.35) | 38.1 / 21.9 | 7.79 / 3.31 |
| quest_b2048_s1_sxs / quest_b2048_s1 | 1990 / 1685 | 14.97 / 6.29 | 12.40 / 4.63 | 83 (26) / 25 (9) | 371412 / 325774 | 831 / 617 (x1.35) | 12.1 / 6.7 | 3.15 / 2.08 |
| sparq_c8_s1_sxs / sparq_c8_s1 | 1571 / 1567 | 4.65 / 4.59 | 3.60 / 3.07 | 5 (5) / 9 (9) | 118518 / 121004 | 1441 / 1193 (x1.21) | 34.9 / 23.9 | 7.63 / 3.77 |
| loki_k25_d25_s1_sxs / loki_k25_d25_s1 | 1579 / 1536 | 4.75 / 3.45 | 3.60 / 2.28 | 3 (3) / 5 (5) | 118496 / 115762 | 1521 / 1223 (x1.24) | 40.7 / 27.3 | 8.43 / 4.97 |
| tri_b4096_s1_sxs / tri_b4096_s1 | 1558 / 1532 | 6.10 / 3.85 | 4.36 / 2.84 | 9 (9) / 5 (5) | 117275 / 116473 | 1705 / 1386 (x1.23) | 54.7 / 37.9 | 19.74 / 13.87 |
| fp8kv_s1_sxs / fp8kv_s1 | 1593 / 1541 | 5.65 / 2.53 | 4.20 / 2.00 | 8 (8) / 3 (3) | 120178 / 110428 | 1654 / 1364 (x1.21) | 49.7 / 33.8 | 12.00 / 7.20 |
| blasst_t50_s1_sxs / blasst_t50_s1 | 1583 / 1571 | 4.74 / 3.95 | 3.47 / 3.07 | 7 (7) / 4 (4) | 119325 / 113660 | 1602 / 1425 (x1.12) | 45.9 / 37.3 | 11.30 / 8.24 |
| dense_sxs / dense_s1d | 1581 / 1553 | 5.19 / 3.16 | 3.87 / 2.13 | 4 (4) / 6 (6) | 119511 / 112111 | 1616 / 1379 (x1.17) | 46.5 / 35.3 | 11.48 / 8.56 |

Units whose FIRST listed attempt (.jqs_attempts) has no snapshot -- their first episodes, and the first-attempt timeouts above, are a later attempt's: jqs_f_dense_sxs / jqs_f_dense: rerun jqs_f_dense_sxs s44 shard4of8 (290065_0) | jqs_f_r40_sxs / jqs_f_r40: published jqs_f_r40 s44 shard4of8 (113139_0, 113139_1) | jqs_f_r60_sxs / jqs_f_r60: published jqs_f_r60 s44 shard4of8 (113151_0) | jqs_f_u32_sxs / jqs_f_u32: published jqs_f_u32 s43 shard4of8 (113250_0, 113250_1) | jqs_f_u64_sxs / jqs_f_u64: published jqs_f_u64 s43 shard4of8 (113265_0) | quest_b2048_s1_sxs / quest_b2048_s1: published quest_b2048_s1 s42 shard8of16 (127328_0) | loki_k25_d25_s1_sxs / loki_k25_d25_s1: published loki_k25_d25_s1 s43 shard5of8 (126014_0) | tri_b4096_s1_sxs / tri_b4096_s1: rerun tri_b4096_s1_sxs s44 shard7of8 (293724_0); published tri_b4096_s1 s42 shard4of8 (126471_0), tri_b4096_s1 s43 shard4of8 (126475_0).

Counted zero-token rows (the last episode per instance) = the item table's zero-token rows in every rerun arm: True.

The addendum v2's final monitor table: not available (not verified before the START marker).


## Reproduction and incomplete completion checks

The archival wrapper calls the installed reader's `setup`, score-free `preconditions`, registered-source self-checks and read-only `analysis` numerical function. It never calls `cmd_run`, `assemble`, `write_outputs`, a promotion tool, or the appendix assembler. The only allowed hard precondition exception is the absent `sxs COMPLETE` line, explicitly authorized for this failed-gate backup; every other failed hard precondition aborts. The latest recorded retest must remain PASS. Skipped final completion checks remain unavailable. Canonical reader START/output files remain absent, and no STATE completion line is fabricated.

The arithmetic follows the registered reader; the publication disposition differs under the user's later decision. Family statistics are hypothetical composed-family backup diagnostics, not a newly accepted registered main reading. The embedded JSON contains the exact calculated numbers, full family memberships, available sensitivities, input hashes and audit checks.

ARCHIVE ANALYSIS COMPLETE: 2026-10-28T15:54:47.474975-07:00.

Archive wrapper SHA256: `8f0197cb69ce5c33b85bb61eb85f5383ef365a96b558318445c8ad0cdd1e2545`. Registered numerical reader MD5: `1741e74d1d8c3a3b45422c92f4d14656`.

## Machine readable calculation backup

The JSON preserves all numerical calculations and their provenance. Private session scratch prefixes are redacted; file-content hashes and numerical results are retained. Independent review verified all 39 rerun seed counts, 13 means/sample SDs, 41 paired contrasts, six BH families, 48 registered source pins and 672 scored-file hashes. Earlier baseline/control seed arithmetic was also checked against saved outputs. Fields named `hypothetical_promotion_*` preserve the earlier procedure's superseded prose for traceability; they do not describe a publication action.

<details><summary>Full numerical calculations and provenance</summary>

```json
{
 "schema": "jqs_swe_rerun_archive_v1",
 "status": "ARCHIVAL ONLY; environment integrity gate failed",
 "authoritative_for_main": false,
 "user_decision": {
  "date": "2026-10-28",
  "verbatim": "Let's do the second option, but have an SWE_rerun.md in doc and hf sync it, put all new swe results there, the incidence, and our decision just as a backup.",
  "authorization": "ARCHIVE AUTHORIZATION 2026-10-28: new SWE scores may be read for this backup only; the integrity gate is NOT passed."
 },
 "generated": "2026-10-28T15:54:47.394513-07:00",
 "analysis_started": "2026-10-28T15:49:25.900183-07:00",
 "canonical_completion": null,
 "canonical_cli_run_executed": false,
 "archive_wrapper_sha256": "8f0197cb69ce5c33b85bb61eb85f5383ef365a96b558318445c8ad0cdd1e2545",
 "registered_numerical_source": {
  "path": "scripts/sparse/bl2/jqs_sxs_stats_v2.py",
  "md5": "1741e74d1d8c3a3b45422c92f4d14656"
 },
 "flips": 10000,
 "preconditions": [
  {
   "name": "prereg registered",
   "ok": true,
   "soft": false,
   "detail": "'BL2 SXS PREREG REGISTERED d4171c51270d2dcf36a9e27faeb6a3b9' at column 0 of log/sparse/dev/bigmodels/bl2/STATE.md"
  },
  {
   "name": "reader registered",
   "ok": true,
   "soft": false,
   "detail": "'BL2 SXS READER V2 REGISTERED 1741e74d1d8c3a3b45422c92f4d14656' (md5 of /home/hcai/workspace/code/jet-qs/scripts/sparse/bl2/jqs_sxs_stats_v2.py) at column 0 of log/sparse/dev/bigmodels/bl2/STATE.md"
  },
  {
   "name": "registrations after the prereg's (combination_rule: no other addendum skipped)",
   "ok": true,
   "soft": false,
   "detail": "line 136 sxs watchdog scope; line 139 tbp; line 142 tbp; line 145 sxs reader v1 (superseded, never run); line 156 sxs addendum v2; line 159 sxs reader v2"
  },
  {
   "name": "sxs addendum v2 registered and installed (one md5 = the installed bl2_sxs_addendum_v2.json, its schema, its parents naming the prereg, its analysis_additions naming this reader)",
   "ok": true,
   "soft": false,
   "detail": "line(s) [156]: log/sparse/dev/bigmodels/bl2/prereg/bl2_sxs_addendum_v2.json md5 41a63efcd129833d50099f464ab4cf49 (schema jqs_bl2_sxs_addendum_v2)"
  },
  {
   "name": "the superseded reader v1 never ran (its START marker and outputs absent)",
   "ok": true,
   "soft": false,
   "detail": "v1 scripts/sparse/bl2/jqs_sxs_stats.py (md5 0874efd12db2661bc3655c3471a25f67): none of ['log/sparse/dev/bigmodels/bl2/sxsr/table1_sxs_staged.md', 'log/sparse/dev/bigmodels/bl2/sxsr/verdicts_sxs_staged.md', 'log/sparse/dev/stats/bl2_sxs.md', 'log/sparse/dev/stats/bl2_sxs.json'] or log/sparse/dev/bigmodels/bl2/sxsr/reader_started*.json"
  },
  {
   "name": "family_sources at their registered md5",
   "ok": true,
   "soft": false,
   "detail": "7 files"
  },
  {
   "name": "family_tools at their registered md5",
   "ok": true,
   "soft": false,
   "detail": "7 files"
  },
  {
   "name": "route_i_v1.json at its registered md5",
   "ok": true,
   "soft": false,
   "detail": "log/sparse/dev/bigmodels/bl2/ctl2/route_i_v1.json 34ac3bdd21633be60c937c73db3a6f87 (prereg guards 34ac3bdd21633be60c937c73db3a6f87)"
  },
  {
   "name": "sxs COMPLETE line",
   "ok": false,
   "soft": false,
   "detail": "no '  - <MM-DD HH:MM> sxs COMPLETE: STATUS 39/39 READY; AUDIT OK ...' line in log/sparse/dev/bigmodels/bl2/STATE.md (sxs COMMANDS 9.10): the runs are not complete"
  },
  {
   "name": "the addendum v2's completeness items named by its analysis_additions (all three enforced whatever the wording)",
   "ok": true,
   "soft": true,
   "detail": "named: ['retest', 'audit2', 'monitor']; not named (enforced anyway): none"
  },
  {
   "name": "incomplete-arm declarations",
   "ok": true,
   "soft": false,
   "detail": "--incomplete-arm none; 'BL2 SXS RUN INCOMPLETE' lines none"
  },
  {
   "name": "PROBED EPISODES line (sensitivity drop_probed)",
   "ok": true,
   "soft": true,
   "detail": "line 166 (1 such line(s), the last used): jqs_swe_q38_dense_sxs_s44_sh4of8 s44 8; jqs_swe_q38_dense_sxs_s44_sh4of8 s44 8; jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8 s44 8; jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8 s44 8"
  },
  {
   "name": "outputs absent (the reader runs ONCE)",
   "ok": true,
   "soft": false,
   "detail": "none exists"
  },
  {
   "name": "no START marker (or --after-crash with no output)",
   "ok": true,
   "soft": false,
   "detail": "none"
  },
  {
   "name": "STATUS re-check (agentic_state; no score read)",
   "ok": true,
   "soft": false,
   "detail": "39 of 39 runs done"
  },
  {
   "name": "set-aside manifests valid (applied; alloc = file stem; an sxs shard run_dir; window; instances)",
   "ok": true,
   "soft": false,
   "detail": "9 manifest(s): death 2, oom 5, void 2"
  },
  {
   "name": "no manifest-like file outside a <kind>_setaside/ dir (by name only: <job>_<task>.json)",
   "ok": true,
   "soft": true,
   "detail": "none"
  },
  {
   "name": "set-asides reflected (no live capture inside a set-aside window: the counted rows are not set-aside ones)",
   "ok": true,
   "soft": false,
   "detail": "9 manifest(s) of live arms checked"
  },
  {
   "name": "set-aside instances re-run (each captured again, outside its window)",
   "ok": true,
   "soft": true,
   "detail": "67 instance(s)"
  },
  {
   "name": "PROBED EPISODES line covers only the counted test jobs (no void set-aside attempt; the Jet-QSparse unit's = the passing re-test job; sensitivity drop_probed)",
   "ok": true,
   "soft": true,
   "detail": "4 segment(s): jqs_swe_q38_dense_sxs_s44_sh4of8 286983_0_sh4of8, jqs_swe_q38_dense_sxs_s44_sh4of8 286983_1_sh4of8, jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8 290065_0_sh4of8, jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8 290065_1_sh4of8"
  }
 ],
 "selfchecks": {
  "S1_published_q_reproduced": {
   "F1": {
    "source": "log/sparse/dev/stats/verdicts_noruler.json",
    "m": 120,
    "m_registered": 120,
    "max_abs_q_diff": 0.0,
    "stored_labels_not_reproduced": 0,
    "duplicate_keys": 0
   },
   "B10": {
    "source": "log/sparse/dev/stats/paired_baselines.json",
    "m": 80,
    "m_registered": 80,
    "max_abs_q_diff": 0.0,
    "stored_labels_not_reproduced": 0,
    "duplicate_keys": 0
   },
   "B12": {
    "source": "log/sparse/dev/stats/paired_baselines_bl2.json",
    "m": 40,
    "m_registered": 40,
    "max_abs_q_diff": 0.0,
    "stored_labels_not_reproduced": 0,
    "duplicate_keys": 0
   },
   "F6": {
    "source": "log/sparse/dev/stats/verdicts_noruler.json",
    "m": 100,
    "m_registered": 100,
    "max_abs_q_diff": 0.0,
    "stored_labels_not_reproduced": 0,
    "duplicate_keys": 0
   },
   "H10": {
    "source": "log/sparse/dev/stats/paired_baselines_h2h.json",
    "m": 240,
    "m_registered": 240,
    "max_abs_q_diff": 0.0,
    "stored_labels_not_reproduced": 0,
    "duplicate_keys": 0
   },
   "H12": {
    "source": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
    "m": 240,
    "m_registered": 240,
    "max_abs_q_diff": 0.0,
    "stored_labels_not_reproduced": 0,
    "duplicate_keys": 0
   }
  },
  "S2_family_sources_consistent": {
   "F1": {
    "members": 120,
    "missing_in_sources": [],
    "differ_from_sources": []
   },
   "F6": {
    "members": 100,
    "missing_in_sources": [],
    "differ_from_sources": []
   },
   "B10_verdicts_noruler_vs_paired_baselines": {
    "members": 80,
    "differ": []
   }
  },
  "S4_tbp": {
   "registered_versions": [
    1,
    2
   ],
   "used": {
    "F1": {
     "version": 1,
     "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
     "md5": "c753ae5ba8b1e30924086bcd2edfa464",
     "m": 120,
     "max_abs_q_diff": 0.0,
     "stored_labels_not_reproduced": 0,
     "same_keys_and_order_as_published": true,
     "non_tb_members_differing_from_published": [],
     "tb_members_rescored": [
      "qwen3.8-27b|tb|jqs_f_u64|dense_s1",
      "qwen3.8-27b|tb|jqs_f_u128|dense_s1"
     ],
     "tb_members_differing_from_tbp_paired_agentic": []
    },
    "B10": {
     "version": 1,
     "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
     "md5": "1ded660f60eb0e62be283230fcf20064",
     "m": 80,
     "max_abs_q_diff": 0.0,
     "stored_labels_not_reproduced": 0,
     "same_keys_and_order_as_published": true,
     "non_tb_members_differing_from_published": [],
     "tb_members_rescored": [
      "qwen3.8-27b|tb|loki_k25_d25_s1|dense_s1"
     ]
    },
    "B12": {
     "version": 1,
     "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
     "md5": "1b7ec7410db857f613ff3caa388d09f3",
     "m": 40,
     "max_abs_q_diff": 0.0,
     "stored_labels_not_reproduced": 0,
     "same_keys_and_order_as_published": true,
     "non_tb_members_differing_from_published": [],
     "tb_members_rescored": [
      "qwen3.8-27b|tb|fp8kv_s1|dense_s1",
      "qwen3.8-27b|tb|blasst_t50_s1|dense_s1"
     ]
    },
    "F6": {
     "version": 1,
     "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
     "md5": "c753ae5ba8b1e30924086bcd2edfa464",
     "m": 100,
     "max_abs_q_diff": 0.0,
     "stored_labels_not_reproduced": 0,
     "same_keys_and_order_as_published": true,
     "non_tb_members_differing_from_published": [],
     "tb_members_rescored": [
      "qwen3.8-27b|tb|jqs_f_u64|jqs_f_dense",
      "qwen3.8-27b|tb|jqs_f_u128|jqs_f_dense"
     ],
     "tb_members_differing_from_tbp_paired_agentic": []
    },
    "H10": {
     "version": 1,
     "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
     "md5": "a5ace5cf8d9b77731c7822221fcfcd34",
     "m": 240,
     "max_abs_q_diff": 0.0,
     "stored_labels_not_reproduced": 0,
     "same_keys_and_order_as_published": true,
     "non_tb_members_differing_from_published": [],
     "tb_members_rescored": [
      "qwen3.8-27b|tb|jqs_f_dense|loki_k25_d25_s1",
      "qwen3.8-27b|tb|jqs_f_r40|loki_k25_d25_s1",
      "qwen3.8-27b|tb|jqs_f_r60|loki_k25_d25_s1",
      "qwen3.8-27b|tb|jqs_f_u32|loki_k25_d25_s1",
      "qwen3.8-27b|tb|jqs_f_u64|sparq_c8_s1",
      "qwen3.8-27b|tb|jqs_f_u128|sparq_c8_s1"
     ]
    },
    "H12": {
     "version": 1,
     "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
     "md5": "5258d19c0bd01ddbb341475ae2058f16",
     "m": 240,
     "max_abs_q_diff": 0.0,
     "stored_labels_not_reproduced": 0,
     "same_keys_and_order_as_published": true,
     "non_tb_members_differing_from_published": [],
     "tb_members_rescored": [
      "qwen3.8-27b|tb|jqs_f_dense|fp8kv_s1",
      "qwen3.8-27b|tb|jqs_f_r40|fp8kv_s1",
      "qwen3.8-27b|tb|jqs_f_r60|fp8kv_s1",
      "qwen3.8-27b|tb|jqs_f_u32|fp8kv_s1",
      "qwen3.8-27b|tb|jqs_f_dense|blasst_t50_s1",
      "qwen3.8-27b|tb|jqs_f_r40|blasst_t50_s1",
      "qwen3.8-27b|tb|jqs_f_r60|blasst_t50_s1",
      "qwen3.8-27b|tb|jqs_f_u32|blasst_t50_s1",
      "qwen3.8-27b|tb|jqs_f_u64|blasst_t50_s1",
      "qwen3.8-27b|tb|jqs_f_u128|blasst_t50_s1"
     ]
    }
   },
   "later_versions": {
    "2": {
     "addendum": {
      "path": "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/prereg/bl2_tbp_addendum_v2.json",
      "md5": "5455d76c1222a317382fc1e53a5f1730"
     },
     "schema": "bl2_tbp_addendum_v2",
     "lists": [],
     "new_flags": [
      {
       "id": "post01",
       "model": "qwen3.8-27b",
       "arm": "dense_s1e",
       "reader_arm": "dense_s1e",
       "seed": 43,
       "task": "mteb-retrieve"
      }
     ],
     "v1_invariance_ok": true,
     "new_flags_on_family_arms": [],
     "lists_family_outputs": [],
     "proof": "structural: lists no output of these families; its added flags ['post01'] have reader arms outside the families' TB arms",
     "ok": true
    }
   }
  },
  "S5_specs_replace_members": {
   "F1": {
    "specs": 6,
    "ok": true,
    "problems": []
   },
   "B10": {
    "specs": 4,
    "ok": true,
    "problems": []
   },
   "B12": {
    "specs": 2,
    "ok": true,
    "problems": []
   },
   "F6": {
    "specs": 5,
    "ok": true,
    "problems": []
   },
   "H10": {
    "specs": 12,
    "ok": true,
    "problems": []
   },
   "H12": {
    "specs": 12,
    "ok": true,
    "problems": []
   }
  },
  "S6_seed_tuples": {
   "tuples": {
    "F1": [
     20261024,
     21,
     0,
     1
    ],
    "B10": [
     20261024,
     22,
     0,
     1
    ],
    "B12": [
     20261024,
     23,
     0,
     1
    ],
    "F6": [
     20261024,
     26,
     0,
     1
    ],
    "H10": [
     20261024,
     27,
     0,
     1
    ],
    "H12": [
     20261024,
     28,
     0,
     1
    ]
   },
   "cross_window": [
    20261024,
    29,
    0,
    1
   ],
   "model_index": 0,
   "bench_index": 1,
   "ok": true
  },
  "S8_arm_table": {
   "prereg_keys": [
    "dense_sxs",
    "jqs_f_dense_sxs",
    "jqs_f_r40_sxs",
    "jqs_f_r60_sxs",
    "jqs_f_u32_sxs",
    "jqs_f_u64_sxs",
    "jqs_f_u128_sxs",
    "quest_b2048_s1_sxs",
    "sparq_c8_s1_sxs",
    "loki_k25_d25_s1_sxs",
    "tri_b4096_s1_sxs",
    "fp8kv_s1_sxs",
    "blasst_t50_s1_sxs"
   ],
   "module_keys": [
    "dense_sxs",
    "jqs_f_dense_sxs",
    "jqs_f_r40_sxs",
    "jqs_f_r60_sxs",
    "jqs_f_u32_sxs",
    "jqs_f_u64_sxs",
    "jqs_f_u128_sxs",
    "quest_b2048_s1_sxs",
    "sparq_c8_s1_sxs",
    "loki_k25_d25_s1_sxs",
    "tri_b4096_s1_sxs",
    "fp8kv_s1_sxs",
    "blasst_t50_s1_sxs"
   ],
   "pub_equal": true,
   "nshards_equal": true,
   "table1_rows": true,
   "model": "qwen3.8-27b",
   "seeds": [
    42,
    43,
    44
   ]
  },
  "S9_route_i_v1": {
   "u36": 36,
   "linkcheck": 3,
   "dataset_order_n": 500,
   "dataset_order_md5": "3634a4af115640143eb9af4eb8b0b270",
   "prov": {
    "route_i": "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/ctl2/route_i_v1.json",
    "route_i_md5": "34ac3bdd21633be60c937c73db3a6f87",
    "source": {
     "synthesis": "log/sparse/dev/bigmodels/bl2/incidents/leak_1023/synthesis.md",
     "synthesis_md5": "cef3f57b780b2409740ffd9aba79067d",
     "A_exposure_md5": "588ba9b7e45cf511ae108f87ddf09c80",
     "u36_eps3_jsonl": "/tmp/[redacted-session]/-home-hcai-workspace-code-jet-qs/d8ccd053-6e82-448b-a983-3aff57522550/scratchpad/leak_verify/u36_eps3.jsonl (session scratch, not durable)",
     "u36_eps3_md5": "14edcc8ef436ed8de31824fe3141392d",
     "u36_novel_md5": "083c3f58f02275a56dfec818f9184297",
     "u36_idx_md5": "486d75150713df4988327318e4dd8ab9",
     "v_u36scan_md5": "0b03477c20ce7c7ada3b6bc705e64f41",
     "episodes_scanned": 15120
    }
   }
  },
  "S7_table1_base": {
   "base": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/md/table1.md",
   "md5": "d4ee83ffd492e3111bbe2b8e2a01c6c1",
   "why": "tbp v1 registered_outputs_P (rule P Terminal-Bench cells)",
   "rows": {
    "dense_sxs": {
     "label": "Dense bf16 (reference)",
     "published_cell": "82.7 ± 3.7",
     "published_arm": "dense_s1",
     "recomputed": {
      "per_seed": [
       80.8,
       87.0,
       80.4
      ],
      "mean": 82.73333333333333,
      "sd": 3.7004504230341104,
      "cell": "82.7 ± 3.7"
     },
     "w_mark": false,
     "ok": true
    },
    "jqs_f_dense_sxs": {
     "label": "Jet-QSparse, dense NVFP4 decode",
     "published_cell": "82.8 ± 3.6",
     "published_arm": "jqs_f_dense",
     "recomputed": {
      "per_seed": [
       80.6,
       87.0,
       80.8
      ],
      "mean": 82.8,
      "sd": 3.638681079732053,
      "cell": "82.8 ± 3.6"
     },
     "w_mark": false,
     "ok": true
    },
    "jqs_f_r40_sxs": {
     "label": "Jet-QSparse, rho = 0.40",
     "published_cell": "81.6 ± 4.3",
     "published_arm": "jqs_f_r40",
     "recomputed": {
      "per_seed": [
       79.2,
       86.6,
       79.0
      ],
      "mean": 81.6,
      "sd": 4.331281565541539,
      "cell": "81.6 ± 4.3"
     },
     "w_mark": false,
     "ok": true
    },
    "jqs_f_r60_sxs": {
     "label": "Jet-QSparse, rho = 0.60",
     "published_cell": "83.6 ± 2.5",
     "published_arm": "jqs_f_r60",
     "recomputed": {
      "per_seed": [
       82.8,
       86.4,
       81.6
      ],
      "mean": 83.6,
      "sd": 2.497999199359365,
      "cell": "83.6 ± 2.5"
     },
     "w_mark": false,
     "ok": true
    },
    "jqs_f_u32_sxs": {
     "label": "Jet-QSparse, N = 32",
     "published_cell": "82.7 ± 2.3",
     "published_arm": "jqs_f_u32",
     "recomputed": {
      "per_seed": [
       81.0,
       85.4,
       81.8
      ],
      "mean": 82.73333333333333,
      "sd": 2.34378611083293,
      "cell": "82.7 ± 2.3"
     },
     "w_mark": false,
     "ok": true
    },
    "jqs_f_u64_sxs": {
     "label": "Jet-QSparse, N = 64",
     "published_cell": "83.5 ± 4.3",
     "published_arm": "jqs_f_u64",
     "recomputed": {
      "per_seed": [
       81.4,
       88.4,
       80.6
      ],
      "mean": 83.46666666666667,
      "sd": 4.29107601113443,
      "cell": "83.5 ± 4.3"
     },
     "w_mark": false,
     "ok": true
    },
    "jqs_f_u128_sxs": {
     "label": "Jet-QSparse, N = 128",
     "published_cell": "83.0 ± 2.0",
     "published_arm": "jqs_f_u128",
     "recomputed": {
      "per_seed": [
       81.4,
       85.2,
       82.4
      ],
      "mean": 83.0,
      "sd": 1.9697715603592194,
      "cell": "83.0 ± 2.0"
     },
     "w_mark": false,
     "ok": true
    },
    "quest_b2048_s1_sxs": {
     "label": "Quest (2048-token budget)",
     "published_cell": "4.7 ± 0.2",
     "published_arm": "quest_b2048_s1",
     "recomputed": {
      "per_seed": [
       4.8,
       4.8,
       4.4
      ],
      "mean": 4.666666666666667,
      "sd": 0.23094010767585,
      "cell": "4.7 ± 0.2"
     },
     "w_mark": false,
     "ok": true
    },
    "sparq_c8_s1_sxs": {
     "label": "SparQ (r = d/8, k = S/16)",
     "published_cell": "83.7 ± 2.9",
     "published_arm": "sparq_c8_s1",
     "recomputed": {
      "per_seed": [
       81.6,
       87.0,
       82.4
      ],
      "mean": 83.66666666666667,
      "sd": 2.9143323992525865,
      "cell": "83.7 ± 2.9"
     },
     "w_mark": false,
     "ok": true
    },
    "loki_k25_d25_s1_sxs": {
     "label": "Loki (k_f = d_f = 0.25)",
     "published_cell": "82.8 ± 3.5",
     "published_arm": "loki_k25_d25_s1",
     "recomputed": {
      "per_seed": [
       79.8,
       86.6,
       82.0
      ],
      "mean": 82.8,
      "sd": 3.4698703145794925,
      "cell": "82.8 ± 3.5"
     },
     "w_mark": false,
     "ok": true
    },
    "tri_b4096_s1_sxs": {
     "label": "TriAttention (4096 decode tokens)",
     "published_cell": "82.7 ± 2.3",
     "published_arm": "tri_b4096_s1",
     "recomputed": {
      "per_seed": [
       81.2,
       85.4,
       81.6
      ],
      "mean": 82.73333333333333,
      "sd": 2.3180451534284985,
      "cell": "82.7 ± 2.3"
     },
     "w_mark": false,
     "ok": true
    },
    "fp8kv_s1_sxs": {
     "label": "TRT-LLM FP8 KV (FP8 attention, unit scale)",
     "published_cell": "87.1 ± 2.5 (w)",
     "published_arm": "fp8kv_s1",
     "recomputed": {
      "per_seed": [
       85.4,
       90.0,
       86.0
      ],
      "mean": 87.13333333333334,
      "sd": 2.500666577801472,
      "cell": "87.1 ± 2.5"
     },
     "w_mark": true,
     "ok": true
    },
    "blasst_t50_s1_sxs": {
     "label": "BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors)",
     "published_cell": "86.9 ± 2.1 (w)",
     "published_arm": "blasst_t50_s1",
     "recomputed": {
      "per_seed": [
       85.6,
       89.4,
       85.8
      ],
      "mean": 86.93333333333334,
      "sd": 2.138535324312731,
      "cell": "86.9 ± 2.1"
     },
     "w_mark": true,
     "ok": true
    }
   }
  },
  "S10_cross_window_reference": {
   "arm": "dense_s1d",
   "per_seed_rows": {
    "42": 500,
    "43": 500,
    "44": 500
   },
   "ok": true
  },
  "published_inventory_files": 720,
  "S11_untouched_families": {
   "F2": {
    "q38_swe_members": 6,
    "text": "keeps its 6 published Qwen3.8 SWE-bench member(s) (within-S1 contrasts; not recomputed here: prereg family_bh)"
   },
   "F3": {
    "q38_swe_members": 6,
    "text": "keeps its 6 published Qwen3.8 SWE-bench member(s) (within-S1 contrasts; not recomputed here: prereg family_bh)"
   },
   "F4": {
    "q38_swe_members": 0,
    "text": "has no Qwen3.8 SWE-bench member (untouched by this reading)"
   },
   "F5": {
    "q38_swe_members": 4,
    "text": "keeps its 4 published Qwen3.8 SWE-bench member(s) (within-S1 contrasts; not recomputed here: prereg family_bh)"
   },
   "F7a": {
    "q38_swe_members": 0,
    "text": "has no Qwen3.8 SWE-bench member (untouched by this reading)"
   },
   "F7b": {
    "q38_swe_members": 0,
    "text": "has no Qwen3.8 SWE-bench member (untouched by this reading)"
   },
   "F8a": {
    "q38_swe_members": 0,
    "text": "has no Qwen3.8 SWE-bench member (untouched by this reading)"
   },
   "F8b": {
    "q38_swe_members": 0,
    "text": "has no Qwen3.8 SWE-bench member (untouched by this reading)"
   },
   "S2": {
    "q38_swe_members": 0,
    "text": "has no Qwen3.8 SWE-bench member (untouched by this reading)"
   },
   "Q9a": {
    "q38_swe_members": 2,
    "text": "keeps its 2 published Qwen3.8 SWE-bench member(s) (within-S1 contrasts; not recomputed here: prereg family_bh)"
   },
   "Q9b": {
    "q38_swe_members": 2,
    "text": "keeps its 2 published Qwen3.8 SWE-bench member(s) (within-S1 contrasts; not recomputed here: prereg family_bh)"
   }
  },
  "failures": [],
  "ok": true
 },
 "skipped_completion_requirements": [
  "final audit2 certification",
  "full post-run image certification",
  "final stack record",
  "route-(i) scan",
  "final monitor"
 ],
 "numerical_results": {
  "bd_items": 1500,
  "bd_clusters": 500,
  "families": {
   "F1": {
    "title": "(1) Final Jet-QSparse arm vs bf16 -- the lossless question",
    "seed_tuple": [
     20261024,
     21,
     0,
     1
    ],
    "specs": [
     [
      "jqs_f_dense_sxs",
      "dense_sxs"
     ],
     [
      "jqs_f_r40_sxs",
      "dense_sxs"
     ],
     [
      "jqs_f_r60_sxs",
      "dense_sxs"
     ],
     [
      "jqs_f_u32_sxs",
      "dense_sxs"
     ],
     [
      "jqs_f_u64_sxs",
      "dense_sxs"
     ],
     [
      "jqs_f_u128_sxs",
      "dense_sxs"
     ]
    ],
    "replaces": [
     [
      "jqs_f_dense",
      "dense_s1"
     ],
     [
      "jqs_f_r40",
      "dense_s1"
     ],
     [
      "jqs_f_r60",
      "dense_s1"
     ],
     [
      "jqs_f_u32",
      "dense_s1"
     ],
     [
      "jqs_f_u64",
      "dense_s1"
     ],
     [
      "jqs_f_u128",
      "dense_s1"
     ]
    ],
    "family_m_registered": 120,
    "m": 120,
    "status": "ARCHIVAL ONLY; integrity gate failed; not used in main comparison",
    "removed": [],
    "members": [
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 48,
      "mean_a": 90.57239057239057,
      "mean_b": 90.06734006734007,
      "delta": 0.5050505050505051,
      "ci95": [
       -1.1904761921897844,
       2.197802199642796
      ],
      "p": 0.6404359564043596,
      "mid_p": 0.57505,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 1.5151515151515151,
       "44": 1.0101010101010102
      },
      "p_het": 0.45155484451554845,
      "mdd80": 2.42161354297471,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9846158241318725,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.42)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 98.68055555555556,
      "mean_b": 98.99305555555556,
      "delta": -0.3125,
      "ci95": [
       -1.0416666673593737,
       0.3720238102669623
      ],
      "p": 0.45925407459254075,
      "mid_p": 0.40315,
      "per_seed": {
       "42": -0.7291666666666666,
       "43": -1.0416666666666667,
       "44": 0.8333333333333334
      },
      "p_het": 0.11258874112588742,
      "mdd80": 1.0103691640115613,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8350074083500741,
      "label_source": "no_detected_loss",
      "q": 0.8104483669280131,
      "label": "no_detected_loss",
      "q_prev": 0.8350074083500741,
      "label_prev": "no_detected_loss",
      "q_published": 0.8350074083500741,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.01)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 202,
      "mean_a": 86.63729809104258,
      "mean_b": 86.67400881057269,
      "delta": -0.03671071953010279,
      "ci95": [
       -1.5082956274508423,
       1.4354067001603958
      ],
      "p": 1.0,
      "mid_p": 0.9594,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": 0.11013215859030837,
       "44": -1.3215859030837005
      },
      "p_het": 0.41605839416058393,
      "mdd80": 2.1038735896710166,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.10)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 49,
      "a_only": 32,
      "b_only": 17,
      "mean_a": 75.65543071161049,
      "mean_b": 70.0374531835206,
      "rate_a": 75.65543071161049,
      "rate_b": 70.0374531835206,
      "delta": 5.617977528089888,
      "ci95": [
       0.7246376764328935,
       10.60606061109768
      ],
      "p": 0.040495950404959506,
      "mid_p": 0.02915,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 11.235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.30686931306869314,
      "mdd80": 7.062284982286519,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.3037196280371963,
      "label_source": "nominal_gain",
      "q": 0.28585376756442005,
      "label": "nominal_gain",
      "q_prev": 0.3037196280371963,
      "label_prev": "nominal_gain",
      "q_published": 0.3037196280371963,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.0405, q 0.29)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_dense_sxs",
      "b": "dense_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 159,
      "a_only": 82,
      "b_only": 77,
      "mean_a": 87.33243967828419,
      "mean_b": 86.99731903485255,
      "rate_a": 87.0,
      "rate_b": 86.66666666666667,
      "delta": 0.3351206434316354,
      "ci95": [
       -1.466666668454037,
       2.1333333351161525
      ],
      "p": 0.7722227777222278,
      "mid_p": 0.718,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 0.8,
       "44": 1.2072434607645874
      },
      "p_het": 0.48625137486251374,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "dense_sxs"
      ],
      "row_arm": "jqs_f_dense",
      "source": "sxs",
      "replaces": [
       "jqs_f_dense",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       21,
       0,
       1
      ],
      "label_text": "final dense NVFP4 (sxs) vs bf16 sxs",
      "mdd80": 2.5729316647559974,
      "se": 0.9129557944057588,
      "ci95_bootstrap": [
       -1.41131404972124,
       2.1447721179624666
      ],
      "mdd80_cell": 2.240163337147365,
      "q": 0.9754392981754457,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.57)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 47,
      "mean_a": 89.05723905723906,
      "mean_b": 90.06734006734007,
      "delta": -1.0101010101010102,
      "ci95": [
       -2.6234567916032487,
       0.5747126454791296
      ],
      "p": 0.2695730426957304,
      "mid_p": 0.22785,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": -1.0101010101010102,
       "44": -0.5050505050505051
      },
      "p_het": 0.8924107589241076,
      "mdd80": 2.2857420571565505,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.29)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 22,
      "mean_a": 98.88888888888889,
      "mean_b": 98.99305555555556,
      "delta": -0.10416666666666667,
      "ci95": [
       -0.757575758480093,
       0.5608974366756316
      ],
      "p": 0.8357164283571643,
      "mid_p": 0.7593,
      "per_seed": {
       "42": -0.5208333333333334,
       "43": 0.20833333333333334,
       "44": 0.0
      },
      "p_het": 0.565943405659434,
      "mdd80": 0.942317063773313,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9929304099293041,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.94)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 217,
      "mean_a": 86.63729809104258,
      "mean_b": 86.67400881057269,
      "delta": -0.03671071953010279,
      "ci95": [
       -1.590909092512186,
       1.521438452362733
      ],
      "p": 1.0,
      "mid_p": 0.96385,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": -0.3303964757709251,
       "44": -0.22026431718061673
      },
      "p_het": 0.9235076492350764,
      "mdd80": 2.2244048727757555,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.22)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 47,
      "a_only": 23,
      "b_only": 24,
      "mean_a": 69.66292134831461,
      "mean_b": 70.0374531835206,
      "rate_a": 69.66292134831461,
      "rate_b": 70.0374531835206,
      "delta": -0.37453183520599254,
      "ci95": [
       -5.555555560343386,
       4.761904767329096
      ],
      "p": 1.0,
      "mid_p": 0.88635,
      "per_seed": {
       "42": 0.0,
       "43": 4.49438202247191,
       "44": -5.617977528089888
      },
      "p_het": 0.29147085291470853,
      "mdd80": 7.373922319612783,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.37)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r40_sxs",
      "b": "dense_sxs",
      "n_items": 1490,
      "n_clusters": 500,
      "n_diff_items": 150,
      "a_only": 68,
      "b_only": 82,
      "mean_a": 85.97315436241611,
      "mean_b": 86.91275167785236,
      "rate_a": 85.46666666666665,
      "rate_b": 86.66666666666667,
      "delta": -0.9395973154362416,
      "ci95": [
       -2.380952382452482,
       0.524246397235131
      ],
      "p": 0.23777622237776222,
      "mid_p": 0.2068,
      "per_seed": {
       "42": 0.8097165991902834,
       "43": -1.8036072144288577,
       "44": -1.8108651911468814
      },
      "p_het": 0.3758624137586241,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "dense_sxs"
      ],
      "row_arm": "jqs_f_r40",
      "source": "sxs",
      "replaces": [
       "jqs_f_r40",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       21,
       0,
       1
      ],
      "label_text": "final rho 0.40 (sxs) vs bf16 sxs",
      "mdd80": 2.076354979237711,
      "se": 0.7390244963997382,
      "ci95_bootstrap": [
       -2.4080670508119435,
       0.535475234270415
      ],
      "mdd80_cell": 2.240163337147365,
      "q": 0.6793606353650349,
      "label": "no_detected_loss",
      "q_prev": 0.7048525916639106,
      "label_prev": "no_detected_loss",
      "q_published": 0.7048525916639106,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.08)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 44,
      "mean_a": 89.8989898989899,
      "mean_b": 90.06734006734007,
      "delta": -0.16835016835016836,
      "ci95": [
       -1.8691588800729706,
       1.5463917543221708
      ],
      "p": 0.928007199280072,
      "mid_p": 0.8553,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": 0.0,
       "44": 0.0
      },
      "p_het": 0.9676032396760323,
      "mdd80": 2.441105103082635,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.44)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 24,
      "mean_a": 98.88888888888889,
      "mean_b": 98.99305555555556,
      "delta": -0.10416666666666667,
      "ci95": [
       -0.7211538468785339,
       0.5208333340134119
      ],
      "p": 0.8253174682531746,
      "mid_p": 0.7374,
      "per_seed": {
       "42": -0.10416666666666667,
       "43": -0.20833333333333334,
       "44": 0.0
      },
      "p_het": 0.9929007099290071,
      "mdd80": 0.8876522616024543,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9929304099293041,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.89)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 205,
      "mean_a": 87.88546255506608,
      "mean_b": 86.67400881057269,
      "delta": 1.2114537444933922,
      "ci95": [
       -0.4291845509540222,
       2.841781875738925
      ],
      "p": 0.15998400159984003,
      "mid_p": 0.1485,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": 0.7709251101321586,
       "44": 1.3215859030837005
      },
      "p_het": 0.908009199080092,
      "mdd80": 2.3377703014571605,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.6192929094187356,
      "label_source": "no_detected_loss",
      "q": 0.5817600058176001,
      "label": "no_detected_loss",
      "q_prev": 0.6192929094187356,
      "label_prev": "no_detected_loss",
      "q_published": 0.6192929094187356,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.34)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 31,
      "b_only": 20,
      "mean_a": 74.15730337078652,
      "mean_b": 70.0374531835206,
      "rate_a": 74.15730337078651,
      "rate_b": 70.0374531835206,
      "delta": 4.119850187265918,
      "ci95": [
       -1.6260162663917588,
       9.848484854262008
      ],
      "p": 0.20467953204679531,
      "mid_p": 0.16515,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 8.98876404494382,
       "44": 2.247191011235955
      },
      "p_het": 0.42145785421457854,
      "mdd80": 8.20086312259156,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.7017583955890125,
      "label_source": "no_detected_loss",
      "q": 0.6638255093409579,
      "label": "no_detected_loss",
      "q_prev": 0.7017583955890125,
      "label_prev": "no_detected_loss",
      "q_published": 0.7017583955890125,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.20)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r60_sxs",
      "b": "dense_sxs",
      "n_items": 1493,
      "n_clusters": 500,
      "n_diff_items": 145,
      "a_only": 80,
      "b_only": 65,
      "mean_a": 87.94373744139317,
      "mean_b": 86.9390488948426,
      "rate_a": 87.66666666666667,
      "rate_b": 86.66666666666667,
      "delta": 1.0046885465505693,
      "ci95": [
       -0.5369127532161896,
       2.5469168916221783
      ],
      "p": 0.23467653234676533,
      "mid_p": 0.20395,
      "per_seed": {
       "42": 1.8181818181818181,
       "43": 1.6,
       "44": -0.40160642570281124
      },
      "p_het": 0.4754524547545245,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "dense_sxs"
      ],
      "row_arm": "jqs_f_r60",
      "source": "sxs",
      "replaces": [
       "jqs_f_r60",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       21,
       0,
       1
      ],
      "label_text": "final rho 0.60 (sxs) vs bf16 sxs",
      "mdd80": 2.2040230372358605,
      "se": 0.782608823072489,
      "ci95_bootstrap": [
       -0.535833891493637,
       2.5435073627844713
      ],
      "mdd80_cell": 2.240163337147365,
      "q": 0.6793606353650349,
      "label": "no_detected_loss",
      "q_prev": 0.7983646079836461,
      "label_prev": "no_detected_loss",
      "q_published": 0.7983646079836461,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.20)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 47,
      "mean_a": 91.07744107744108,
      "mean_b": 90.06734006734007,
      "delta": 1.0101010101010102,
      "ci95": [
       -0.6535947728548801,
       2.672955976391838
      ],
      "p": 0.2706729327067293,
      "mid_p": 0.2321,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": 2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": 0.35876412358764126,
      "mdd80": 2.377496596851821,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.38)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 22,
      "mean_a": 99.02777777777777,
      "mean_b": 98.99305555555556,
      "delta": 0.034722222222222224,
      "ci95": [
       -0.6127450986191485,
       0.7161458339807993
      ],
      "p": 1.0,
      "mid_p": 0.9185,
      "per_seed": {
       "42": 0.3125,
       "43": 0.20833333333333334,
       "44": -0.4166666666666667
      },
      "p_het": 0.5693430656934306,
      "mdd80": 0.9497626544729725,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.95)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 202,
      "mean_a": 88.91336270190895,
      "mean_b": 86.67400881057269,
      "delta": 2.23935389133627,
      "ci95": [
       0.7610350060829625,
       3.720930234122269
      ],
      "p": 0.0037996200379962005,
      "mid_p": 0.00325,
      "per_seed": {
       "42": 2.202643171806167,
       "43": 2.5330396475770924,
       "44": 1.9823788546255507
      },
      "p_het": 0.9596040395960403,
      "mdd80": 2.115446708063878,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.11398860113988601,
      "label_source": "nominal_gain",
      "q": 0.11398860113988601,
      "label": "nominal_gain",
      "q_prev": 0.11398860113988601,
      "label_prev": "nominal_gain",
      "q_published": 0.11398860113988601,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.00380, q 0.114)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 50,
      "a_only": 29,
      "b_only": 21,
      "mean_a": 73.03370786516854,
      "mean_b": 70.0374531835206,
      "rate_a": 73.03370786516854,
      "rate_b": 70.0374531835206,
      "delta": 2.9962546816479403,
      "ci95": [
       -2.898550730324115,
       8.888888894717901
      ],
      "p": 0.38836116388361164,
      "mid_p": 0.32715,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 6.741573033707865,
       "44": 1.1235955056179776
      },
      "p_het": 0.6102389761023898,
      "mdd80": 8.424521285442507,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.8125187481251874,
      "label_source": "no_detected_loss",
      "q": 0.7863084659276007,
      "label": "no_detected_loss",
      "q_prev": 0.8125187481251874,
      "label_prev": "no_detected_loss",
      "q_published": 0.8125187481251874,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.42)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u32_sxs",
      "b": "dense_sxs",
      "n_items": 1495,
      "n_clusters": 500,
      "n_diff_items": 153,
      "a_only": 80,
      "b_only": 73,
      "mean_a": 87.4247491638796,
      "mean_b": 86.95652173913044,
      "rate_a": 87.33333333333333,
      "rate_b": 86.66666666666667,
      "delta": 0.4682274247491639,
      "ci95": [
       -1.2517385275172357,
       2.1802325599957433
      ],
      "p": 0.6414358564143585,
      "mid_p": 0.58975,
      "per_seed": {
       "42": 0.8064516129032258,
       "43": 0.2,
       "44": 0.40080160320641284
      },
      "p_het": 0.9354064593540646,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "dense_sxs"
      ],
      "row_arm": "jqs_f_u32",
      "source": "sxs",
      "replaces": [
       "jqs_f_u32",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       21,
       0,
       1
      ],
      "label_text": "final N = 32 (sxs) vs bf16 sxs",
      "mdd80": 2.4528408541200313,
      "se": 0.8645507101902979,
      "ci95_bootstrap": [
       -1.2683578104138853,
       2.14190093708166
      ],
      "mdd80_cell": 2.240163337147365,
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.45)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 45,
      "mean_a": 90.9090909090909,
      "mean_b": 90.06734006734007,
      "delta": 0.8417508417508418,
      "ci95": [
       -0.5376344100709577,
       2.2435897449255426
      ],
      "p": 0.29057094290570945,
      "mid_p": 0.2421,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": 3.5353535353535355,
       "44": -0.5050505050505051
      },
      "p_het": 0.0790920907909209,
      "mdd80": 1.9877499133550263,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.99)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 24,
      "mean_a": 98.26388888888889,
      "mean_b": 98.99305555555556,
      "delta": -0.7291666666666666,
      "ci95": [
       -1.5625000010551773,
       0.0744047627750796
      ],
      "p": 0.0988901109889011,
      "mid_p": 0.07965,
      "per_seed": {
       "42": -0.7291666666666666,
       "43": -0.4166666666666667,
       "44": -1.0416666666666667
      },
      "p_het": 0.8660133986601339,
      "mdd80": 1.1699011374644548,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4633382815564598,
      "label_source": "no_detected_loss",
      "q": 0.4302426900167126,
      "label": "no_detected_loss",
      "q_prev": 0.4633382815564598,
      "label_prev": "no_detected_loss",
      "q_published": 0.4633382815564598,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.17)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 203,
      "mean_a": 88.54625550660793,
      "mean_b": 86.67400881057269,
      "delta": 1.8722466960352422,
      "ci95": [
       0.22831050058120367,
       3.516819573572846
      ],
      "p": 0.027197280271972803,
      "mid_p": 0.02415,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": 0.7709251101321586,
       "44": 3.9647577092511015
      },
      "p_het": 0.11538846115388461,
      "mdd80": 2.350308087596262,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.25105181789513353,
      "label_source": "nominal_gain",
      "q": 0.2331195451883383,
      "label": "nominal_gain",
      "q_prev": 0.25105181789513353,
      "label_prev": "nominal_gain",
      "q_published": 0.25105181789513353,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.0272, q 0.23)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 52,
      "a_only": 28,
      "b_only": 24,
      "mean_a": 71.53558052434457,
      "mean_b": 70.0374531835206,
      "rate_a": 71.53558052434458,
      "rate_b": 70.0374531835206,
      "delta": 1.4981273408239701,
      "ci95": [
       -4.385964919170994,
       7.31707317703928
      ],
      "p": 0.7078292170782922,
      "mid_p": 0.6195,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 4.49438202247191,
       "44": -2.247191011235955
      },
      "p_het": 0.5954404559544045,
      "mdd80": 8.364199239367608,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9765776669086339,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.36)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u64_sxs",
      "b": "dense_sxs",
      "n_items": 1495,
      "n_clusters": 500,
      "n_diff_items": 129,
      "a_only": 75,
      "b_only": 54,
      "mean_a": 88.29431438127091,
      "mean_b": 86.88963210702342,
      "rate_a": 88.13333333333333,
      "rate_b": 86.66666666666667,
      "delta": 1.4046822742474916,
      "ci95": [
       -0.13623978358321787,
       2.9247910879299166
      ],
      "p": 0.0857914208579142,
      "mid_p": 0.07225,
      "per_seed": {
       "42": 2.620967741935484,
       "43": 0.2,
       "44": 1.402805611222445
      },
      "p_het": 0.43685631436856315,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "dense_sxs"
      ],
      "row_arm": "jqs_f_u64",
      "source": "sxs",
      "replaces": [
       "jqs_f_u64",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       21,
       0,
       1
      ],
      "label_text": "final N = 64 (sxs) vs bf16 sxs",
      "mdd80": 2.187728680083662,
      "se": 0.7802660873792159,
      "ci95_bootstrap": [
       -0.13377926421404682,
       2.9451137884872827
      ],
      "mdd80_cell": 2.240163337147365,
      "q": 0.41611838816118385,
      "label": "no_detected_loss",
      "q_prev": 0.9009533829225773,
      "label_prev": "no_detected_loss",
      "q_published": 0.9009533829225773,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.19)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 43,
      "mean_a": 90.74074074074075,
      "mean_b": 90.06734006734007,
      "delta": 0.6734006734006734,
      "ci95": [
       -0.5208333345658365,
       1.8707483005297956
      ],
      "p": 0.3565643435656434,
      "mid_p": 0.2932,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": 1.5151515151515151,
       "44": -0.5050505050505051
      },
      "p_het": 0.5851414858514149,
      "mdd80": 1.709271142134459,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7983646079836461,
      "label_source": "no_detected_loss",
      "q": 0.7640664504978074,
      "label": "no_detected_loss",
      "q_prev": 0.7983646079836461,
      "label_prev": "no_detected_loss",
      "q_published": 0.7983646079836461,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.71)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 24,
      "mean_a": 98.54166666666667,
      "mean_b": 98.99305555555556,
      "delta": -0.4513888888888889,
      "ci95": [
       -0.9803921573385052,
       0.08680555624211392
      ],
      "p": 0.1394860513948605,
      "mid_p": 0.1076,
      "per_seed": {
       "42": -1.1458333333333333,
       "43": -0.20833333333333334,
       "44": 0.0
      },
      "p_het": 0.46995300469953005,
      "mdd80": 0.7627296630843574,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.557944205579442,
      "label_source": "no_detected_loss",
      "q": 0.53994600539946,
      "label": "no_detected_loss",
      "q_prev": 0.5771836609442503,
      "label_prev": "no_detected_loss",
      "q_published": 0.557944205579442,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.76)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 209,
      "mean_a": 87.37151248164464,
      "mean_b": 86.67400881057269,
      "delta": 0.697503671071953,
      "ci95": [
       -0.8733624469712797,
       2.2727272743523796
      ],
      "p": 0.4062593740625937,
      "mid_p": 0.3817,
      "per_seed": {
       "42": 1.7621145374449338,
       "43": -0.5506607929515418,
       "44": 0.8810572687224669
      },
      "p_het": 0.46835316468353166,
      "mdd80": 2.248520515591492,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8125187481251874,
      "label_source": "no_detected_loss",
      "q": 0.7863084659276007,
      "label": "no_detected_loss",
      "q_prev": 0.8125187481251874,
      "label_prev": "no_detected_loss",
      "q_published": 0.8125187481251874,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.25)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 50,
      "a_only": 31,
      "b_only": 19,
      "mean_a": 74.53183520599251,
      "mean_b": 70.0374531835206,
      "rate_a": 74.53183520599252,
      "rate_b": 70.0374531835206,
      "delta": 4.49438202247191,
      "ci95": [
       -1.360544222993025,
       10.144927541679484
      ],
      "p": 0.15278472152784722,
      "mid_p": 0.12175,
      "per_seed": {
       "42": 6.741573033707865,
       "43": 10.112359550561798,
       "44": -3.3707865168539324
      },
      "p_het": 0.0725927407259274,
      "mdd80": 8.222997942201195,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.6111388861113889,
      "label_source": "no_detected_loss",
      "q": 0.5729427057294271,
      "label": "no_detected_loss",
      "q_prev": 0.6111388861113889,
      "label_prev": "no_detected_loss",
      "q_published": 0.5258784466380949,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.22)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u128_sxs",
      "b": "dense_sxs",
      "n_items": 1495,
      "n_clusters": 500,
      "n_diff_items": 134,
      "a_only": 81,
      "b_only": 53,
      "mean_a": 88.82943143812709,
      "mean_b": 86.95652173913044,
      "rate_a": 88.60000000000001,
      "rate_b": 86.66666666666667,
      "delta": 1.8729096989966556,
      "ci95": [
       0.27285129441414835,
       3.4578146627731394
      ],
      "p": 0.025897410258974102,
      "mid_p": 0.02005,
      "per_seed": {
       "42": 2.217741935483871,
       "43": 2.4,
       "44": 1.002004008016032
      },
      "p_het": 0.7208279172082792,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "dense_sxs"
      ],
      "row_arm": "jqs_f_u128",
      "source": "sxs",
      "replaces": [
       "jqs_f_u128",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       21,
       0,
       1
      ],
      "label_text": "final N = 128 (sxs) vs bf16 sxs",
      "mdd80": 2.27630363705887,
      "se": 0.8005297821029377,
      "ci95_bootstrap": [
       0.33377837116154874,
       3.473613894455578
      ],
      "mdd80_cell": 2.240163337147365,
      "q": 0.2331195451883383,
      "label": "nominal_gain",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": true,
      "text": "above, nominal (p 0.0259, q 0.23)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 93,
      "mean_a": 83.5016835016835,
      "mean_b": 84.76430976430976,
      "delta": -1.2626262626262625,
      "ci95": [
       -3.4364261190492718,
       0.8771929846796456
      ],
      "p": 0.28857114288571145,
      "mid_p": 0.25685,
      "per_seed": {
       "42": -2.525252525252525,
       "43": -2.272727272727273,
       "44": 1.0101010101010102
      },
      "p_het": 0.3545645435456454,
      "mdd80": 3.0829575474093813,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.08)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 23,
      "mean_a": 92.15277777777777,
      "mean_b": 91.80555555555556,
      "delta": 0.3472222222222222,
      "ci95": [
       -0.20833333418188565,
       0.8928571434519276
      ],
      "p": 0.27217278272172785,
      "mid_p": 0.2242,
      "per_seed": {
       "42": 0.9375,
       "43": 0.7291666666666666,
       "44": -0.625
      },
      "p_het": 0.052594740525947405,
      "mdd80": 0.7870244016727758,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.79)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 287,
      "mean_a": 80.1762114537445,
      "mean_b": 79.47870778267254,
      "delta": 0.697503671071953,
      "ci95": [
       -0.9715994037916746,
       2.3504273520303065
      ],
      "p": 0.4370562943705629,
      "mid_p": 0.41305,
      "per_seed": {
       "42": 3.7444933920704844,
       "43": 0.22026431718061673,
       "44": -1.8722466960352422
      },
      "p_het": 0.029497050294970503,
      "mdd80": 2.3742632840956794,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8324881797534532,
      "label_source": "no_detected_loss",
      "q": 0.8068731588379624,
      "label": "no_detected_loss",
      "q_prev": 0.8324881797534532,
      "label_prev": "no_detected_loss",
      "q_published": 0.8324881797534532,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.37)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 46,
      "a_only": 22,
      "b_only": 24,
      "mean_a": 40.823970037453186,
      "mean_b": 41.57303370786517,
      "rate_a": 40.823970037453186,
      "rate_b": 41.57303370786517,
      "delta": -0.7490636704119851,
      "ci95": [
       -5.691056915933228,
       4.166666672119435
      ],
      "p": 0.8824117588241176,
      "mid_p": 0.7714,
      "per_seed": {
       "42": -6.741573033707865,
       "43": 1.1235955056179776,
       "44": 3.3707865168539324
      },
      "p_het": 0.25877412258774124,
      "mdd80": 7.045346982488772,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.05)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 161,
      "a_only": 96,
      "b_only": 65,
      "mean_a": 70.53333333333333,
      "mean_b": 68.46666666666667,
      "rate_a": 70.53333333333333,
      "rate_b": 68.46666666666665,
      "delta": 2.066666666666667,
      "ci95": [
       0.4201680654991957,
       3.6885245918197507
      ],
      "p": 0.015998400159984,
      "mid_p": 0.0129,
      "per_seed": {
       "42": 2.6,
       "43": 0.2,
       "44": 3.4
      },
      "p_het": 0.29017098290170984,
      "mdd80": 2.3359049972062365,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.17452800174528002,
      "label_source": "nominal_gain",
      "q": 0.17452800174528002,
      "label": "nominal_gain",
      "q_prev": 0.17452800174528002,
      "label_prev": "nominal_gain",
      "q_published": 0.17452800174528002,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.0160, q 0.175)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 96,
      "mean_a": 84.51178451178451,
      "mean_b": 84.76430976430976,
      "delta": -0.25252525252525254,
      "ci95": [
       -2.356902359002289,
       1.83486238721258
      ],
      "p": 0.8777122287771223,
      "mid_p": 0.81795,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -1.7676767676767677,
       "44": 0.5050505050505051
      },
      "p_het": 0.6877312268773123,
      "mdd80": 2.995867843346752,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.00)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 25,
      "mean_a": 90.48611111111111,
      "mean_b": 91.80555555555556,
      "delta": -1.3194444444444444,
      "ci95": [
       -2.9356060628217393,
       0.069444445839632
      ],
      "p": 0.0866913308669133,
      "mid_p": 0.0707,
      "per_seed": {
       "42": -1.3541666666666667,
       "43": -0.9375,
       "44": -1.6666666666666667
      },
      "p_het": 0.5722427757224278,
      "mdd80": 2.147719333405054,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.45145485451454853,
      "label_source": "no_detected_loss",
      "q": 0.41611838816118385,
      "label": "no_detected_loss",
      "q_prev": 0.45145485451454853,
      "label_prev": "no_detected_loss",
      "q_published": 0.45145485451454853,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.15)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 314,
      "mean_a": 75.33039647577093,
      "mean_b": 79.47870778267254,
      "delta": -4.148311306901615,
      "ci95": [
       -6.120943954781632,
       -2.1857923479074923
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -3.7444933920704844,
       "43": -3.7444933920704844,
       "44": -4.955947136563877
      },
      "p_het": 0.8392160783921608,
      "mdd80": 2.8124656013613563,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.011998800119988003,
      "label_source": "loss_detected",
      "q": 0.011998800119988003,
      "label": "loss_detected",
      "q_prev": 0.011998800119988003,
      "label_prev": "loss_detected",
      "q_published": 0.011998800119988003,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0120)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 61,
      "a_only": 27,
      "b_only": 34,
      "mean_a": 38.951310861423224,
      "mean_b": 41.57303370786517,
      "rate_a": 38.951310861423224,
      "rate_b": 41.57303370786517,
      "delta": -2.6217228464419478,
      "ci95": [
       -7.801418444612153,
       2.500000005692116
      ],
      "p": 0.40375962403759624,
      "mid_p": 0.3337,
      "per_seed": {
       "42": -12.359550561797754,
       "43": 1.1235955056179776,
       "44": 3.3707865168539324
      },
      "p_het": 0.07279272072792721,
      "mdd80": 7.362457137890039,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.8125187481251874,
      "label_source": "no_detected_loss",
      "q": 0.7863084659276007,
      "label": "no_detected_loss",
      "q_prev": 0.8125187481251874,
      "label_prev": "no_detected_loss",
      "q_published": 0.8125187481251874,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.36)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 173,
      "a_only": 92,
      "b_only": 81,
      "mean_a": 69.2,
      "mean_b": 68.46666666666667,
      "rate_a": 69.2,
      "rate_b": 68.46666666666665,
      "delta": 0.7333333333333333,
      "ci95": [
       -0.9987515621669079,
       2.479338844776141
      ],
      "p": 0.45125487451254875,
      "mid_p": 0.4072,
      "per_seed": {
       "42": -0.4,
       "43": -0.6,
       "44": 3.2
      },
      "p_het": 0.14408559144085592,
      "mdd80": 2.485802481120294,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8350074083500741,
      "label_source": "no_detected_loss",
      "q": 0.8104483669280131,
      "label": "no_detected_loss",
      "q_prev": 0.8350074083500741,
      "label_prev": "no_detected_loss",
      "q_published": 0.8350074083500741,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.49)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 103,
      "mean_a": 82.82828282828282,
      "mean_b": 84.76430976430976,
      "delta": -1.936026936026936,
      "ci95": [
       -4.210526318158555,
       0.34364261400938795
      ],
      "p": 0.11388861113888611,
      "mid_p": 0.0994,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": -2.272727272727273,
       "44": -2.0202020202020203
      },
      "p_het": 0.9765023497650235,
      "mdd80": 3.254879289056215,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.48809404773808335,
      "label_source": "no_detected_loss",
      "q": 0.45555444455554445,
      "label": "no_detected_loss",
      "q_prev": 0.48809404773808335,
      "label_prev": "no_detected_loss",
      "q_published": 0.48809404773808335,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.25)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 26,
      "mean_a": 91.11111111111111,
      "mean_b": 91.80555555555556,
      "delta": -0.6944444444444444,
      "ci95": [
       -1.8429487192818153,
       0.37202381067764223
      ],
      "p": 0.30696930306969306,
      "mid_p": 0.27175,
      "per_seed": {
       "42": 1.1458333333333333,
       "43": -2.1875,
       "44": -1.0416666666666667
      },
      "p_het": 0.016698330166983303,
      "mdd80": 1.5830480425682247,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7517615585380237,
      "label_source": "no_detected_loss",
      "q": 0.7083906993915993,
      "label": "no_detected_loss",
      "q_prev": 0.7517615585380237,
      "label_prev": "no_detected_loss",
      "q_published": 0.7517615585380237,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.58)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 290,
      "mean_a": 79.00146842878121,
      "mean_b": 79.47870778267254,
      "delta": -0.47723935389133626,
      "ci95": [
       -2.1308980230204773,
       1.1799410046109107
      ],
      "p": 0.5972402759724028,
      "mid_p": 0.56605,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": -0.6607929515418502,
       "44": -1.4317180616740088
      },
      "p_het": 0.622937706229377,
      "mdd80": 2.3662673785152033,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9666233376662334,
      "label_source": "no_detected_loss",
      "q": 0.9539046095390461,
      "label": "no_detected_loss",
      "q_prev": 0.9666233376662334,
      "label_prev": "no_detected_loss",
      "q_published": 0.9666233376662334,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.37)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 55,
      "a_only": 29,
      "b_only": 26,
      "mean_a": 42.69662921348315,
      "mean_b": 41.57303370786517,
      "rate_a": 42.696629213483156,
      "rate_b": 41.57303370786517,
      "delta": 1.1235955056179776,
      "ci95": [
       -4.166666672544897,
       6.382978728378476
      ],
      "p": 0.785921407859214,
      "mid_p": 0.68535,
      "per_seed": {
       "42": 0.0,
       "43": 0.0,
       "44": 3.3707865168539324
      },
      "p_het": 0.9063093690630937,
      "mdd80": 7.539865743629022,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9824017598240177,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.54)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 154,
      "a_only": 80,
      "b_only": 74,
      "mean_a": 68.86666666666666,
      "mean_b": 68.46666666666667,
      "rate_a": 68.86666666666667,
      "rate_b": 68.46666666666665,
      "delta": 0.4,
      "ci95": [
       -1.0796221337472798,
       1.8893387329479965
      ],
      "p": 0.6537346265373463,
      "mid_p": 0.59245,
      "per_seed": {
       "42": 1.8,
       "43": -2.2,
       "44": 1.6
      },
      "p_het": 0.1146885311468853,
      "mdd80": 2.121925949379447,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9846158241318725,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 97,
      "mean_a": 82.82828282828282,
      "mean_b": 84.76430976430976,
      "delta": -1.936026936026936,
      "ci95": [
       -4.081632655226988,
       0.17921147178226643
      ],
      "p": 0.0902909709029097,
      "mid_p": 0.07695,
      "per_seed": {
       "42": -2.525252525252525,
       "43": -3.282828282828283,
       "44": 0.0
      },
      "p_het": 0.49275072492750727,
      "mdd80": 3.0452391005832373,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.45145485451454853,
      "label_source": "no_detected_loss",
      "q": 0.4167275580134294,
      "label": "no_detected_loss",
      "q_prev": 0.45145485451454853,
      "label_prev": "no_detected_loss",
      "q_published": 0.45145485451454853,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.05)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 22,
      "mean_a": 91.25,
      "mean_b": 91.80555555555556,
      "delta": -0.5555555555555556,
      "ci95": [
       -2.6041666697527344,
       1.1111111127873732
      ],
      "p": 0.9781021897810219,
      "mid_p": 0.9663,
      "per_seed": {
       "42": 0.7291666666666666,
       "43": -0.9375,
       "44": -1.4583333333333333
      },
      "p_het": 0.0413958604139586,
      "mdd80": 2.655321066828303,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.66)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 310,
      "mean_a": 77.01908957415566,
      "mean_b": 79.47870778267254,
      "delta": -2.4596182085168867,
      "ci95": [
       -4.378531075290004,
       -0.5426356568970698
      ],
      "p": 0.0136986301369863,
      "mid_p": 0.01215,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": -0.8810572687224669,
       "44": -5.616740088105727
      },
      "p_het": 0.05319468053194681,
      "mdd80": 2.741526881913296,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.17452800174528002,
      "label_source": "nominal_loss",
      "q": 0.17452800174528002,
      "label": "nominal_loss",
      "q_prev": 0.17452800174528002,
      "label_prev": "nominal_loss",
      "q_published": 0.17452800174528002,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0137, q 0.175)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 55,
      "a_only": 30,
      "b_only": 25,
      "mean_a": 43.445692883895134,
      "mean_b": 41.57303370786517,
      "rate_a": 43.445692883895134,
      "rate_b": 41.57303370786517,
      "delta": 1.8726591760299625,
      "ci95": [
       -3.100775198946039,
       6.918238997930776
      ],
      "p": 0.5493450654934506,
      "mid_p": 0.4604,
      "per_seed": {
       "42": -6.741573033707865,
       "43": 2.247191011235955,
       "44": 10.112359550561798
      },
      "p_het": 0.06359364063593641,
      "mdd80": 7.160621903116516,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9030329843727954,
      "label_source": "no_detected_loss",
      "q": 0.8908298359353253,
      "label": "no_detected_loss",
      "q_prev": 0.9030329843727954,
      "label_prev": "no_detected_loss",
      "q_published": 0.9030329843727954,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.16)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 168,
      "a_only": 84,
      "b_only": 84,
      "mean_a": 68.46666666666667,
      "mean_b": 68.46666666666667,
      "rate_a": 68.46666666666667,
      "rate_b": 68.46666666666665,
      "delta": 0.0,
      "ci95": [
       -1.6064257044191397,
       1.6064257044191397
      ],
      "p": 1.0,
      "mid_p": 0.9684,
      "per_seed": {
       "42": 1.4,
       "43": -2.6,
       "44": 1.2
      },
      "p_het": 0.12148785121487851,
      "mdd80": 2.2962353099327584,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.30)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 97,
      "mean_a": 83.33333333333333,
      "mean_b": 84.76430976430976,
      "delta": -1.430976430976431,
      "ci95": [
       -3.723404257734998,
       0.8503401383591962
      ],
      "p": 0.25807419258074193,
      "mid_p": 0.2304,
      "per_seed": {
       "42": 0.0,
       "43": -0.7575757575757576,
       "44": -3.5353535353535355
      },
      "p_het": 0.42345765423457654,
      "mdd80": 3.268869936539046,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.27)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 24,
      "mean_a": 91.25,
      "mean_b": 91.80555555555556,
      "delta": -0.5555555555555556,
      "ci95": [
       -1.6025641037820608,
       0.3787878800745335
      ],
      "p": 0.45865413458654136,
      "mid_p": 0.4105,
      "per_seed": {
       "42": -0.3125,
       "43": -1.1458333333333333,
       "44": -0.20833333333333334
      },
      "p_het": 0.5061493850614939,
      "mdd80": 1.4160786814544655,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8350074083500741,
      "label_source": "no_detected_loss",
      "q": 0.8104483669280131,
      "label": "no_detected_loss",
      "q_prev": 0.8350074083500741,
      "label_prev": "no_detected_loss",
      "q_published": 0.8350074083500741,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.42)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 294,
      "mean_a": 78.48751835535977,
      "mean_b": 79.47870778267254,
      "delta": -0.9911894273127754,
      "ci95": [
       -2.76497696038029,
       0.8076358314566734
      ],
      "p": 0.2970702929707029,
      "mid_p": 0.2793,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": -1.5418502202643172,
       "44": -1.6519823788546255
      },
      "p_het": 0.639036096390361,
      "mdd80": 2.553357935809355,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7426757324267573,
      "label_source": "no_detected_loss",
      "q": 0.6989889246369481,
      "label": "no_detected_loss",
      "q_prev": 0.7426757324267573,
      "label_prev": "no_detected_loss",
      "q_published": 0.7426757324267573,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.55)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 57,
      "a_only": 28,
      "b_only": 29,
      "mean_a": 41.19850187265918,
      "mean_b": 41.57303370786517,
      "rate_a": 41.19850187265917,
      "rate_b": 41.57303370786517,
      "delta": -0.37453183520599254,
      "ci95": [
       -5.769230773848513,
       5.000000005972568
      ],
      "p": 1.0,
      "mid_p": 0.88885,
      "per_seed": {
       "42": -6.741573033707865,
       "43": 4.49438202247191,
       "44": 1.1235955056179776
      },
      "p_het": 0.27017298270172985,
      "mdd80": 7.696804125274315,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.70)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 158,
      "a_only": 95,
      "b_only": 63,
      "mean_a": 70.6,
      "mean_b": 68.46666666666667,
      "rate_a": 70.6,
      "rate_b": 68.46666666666665,
      "delta": 2.1333333333333333,
      "ci95": [
       0.41666666487933524,
       3.840877916705706
      ],
      "p": 0.015298470152984701,
      "mid_p": 0.01205,
      "per_seed": {
       "42": 3.2,
       "43": -1.2,
       "44": 4.4
      },
      "p_het": 0.013598640135986401,
      "mdd80": 2.4472948744168153,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.17452800174528002,
      "label_source": "nominal_gain",
      "q": 0.17452800174528002,
      "label": "nominal_gain",
      "q_prev": 0.17452800174528002,
      "label_prev": "nominal_gain",
      "q_published": 0.17452800174528002,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.0153, q 0.175)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 98,
      "mean_a": 84.34343434343434,
      "mean_b": 84.76430976430976,
      "delta": -0.4208754208754209,
      "ci95": [
       -2.492211839916656,
       1.6501650185256471
      ],
      "p": 0.7567243275672433,
      "mid_p": 0.69895,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 0.25252525252525254,
       "44": -0.5050505050505051
      },
      "p_het": 0.9218078192180782,
      "mdd80": 2.9605701599635768,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.96)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 25,
      "mean_a": 91.59722222222223,
      "mean_b": 91.80555555555556,
      "delta": -0.20833333333333334,
      "ci95": [
       -1.302083334709761,
       0.7161458342089884
      ],
      "p": 0.9757024297570243,
      "mid_p": 0.95875,
      "per_seed": {
       "42": -0.5208333333333334,
       "43": -0.3125,
       "44": 0.20833333333333334
      },
      "p_het": 0.746025397460254,
      "mdd80": 1.4424349250820734,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.44)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 286,
      "mean_a": 79.0748898678414,
      "mean_b": 79.47870778267254,
      "delta": -0.40381791483113066,
      "ci95": [
       -2.173913045218721,
       1.3698630155297336
      ],
      "p": 0.6851314868513149,
      "mid_p": 0.6578,
      "per_seed": {
       "42": 0.0,
       "43": 0.44052863436123346,
       "44": -1.6519823788546255
      },
      "p_het": 0.5787421257874212,
      "mdd80": 2.5327482306837723,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9846158241318725,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.53)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 55,
      "a_only": 28,
      "b_only": 27,
      "mean_a": 41.947565543071164,
      "mean_b": 41.57303370786517,
      "rate_a": 41.947565543071164,
      "rate_b": 41.57303370786517,
      "delta": 0.37453183520599254,
      "ci95": [
       -5.00000000597988,
       5.769230773828523
      ],
      "p": 1.0,
      "mid_p": 0.8939,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.9606039396060394,
      "mdd80": 7.6968041252652535,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.70)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 160,
      "a_only": 81,
      "b_only": 79,
      "mean_a": 68.6,
      "mean_b": 68.46666666666667,
      "rate_a": 68.60000000000001,
      "rate_b": 68.46666666666665,
      "delta": 0.13333333333333333,
      "ci95": [
       -1.3831258660239953,
       1.6326530627550737
      ],
      "p": 0.9333066693330667,
      "mid_p": 0.86705,
      "per_seed": {
       "42": -0.8,
       "43": -0.8,
       "44": 2.0
      },
      "p_het": 0.3321667833216678,
      "mdd80": 2.1553869700179025,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.16)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 132,
      "mean_a": 72.39057239057239,
      "mean_b": 72.47474747474747,
      "delta": -0.08417508417508418,
      "ci95": [
       -3.092783508218898,
       2.9209622023714905
      ],
      "p": 1.0,
      "mid_p": 0.9571,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 2.0202020202020203,
       "44": -0.7575757575757576
      },
      "p_het": 0.5173482651734826,
      "mdd80": 4.298043540895482,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.30)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 40,
      "mean_a": 87.91666666666667,
      "mean_b": 88.92361111111111,
      "delta": -1.0069444444444444,
      "ci95": [
       -2.022058824430447,
       1.38764648369349e-09
      ],
      "p": 0.0654934506549345,
      "mid_p": 0.0555,
      "per_seed": {
       "42": -2.0833333333333335,
       "43": -0.8333333333333334,
       "44": -0.10416666666666667
      },
      "p_het": 0.24597540245975402,
      "mdd80": 1.4451719932742129,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4057776040577761,
      "label_source": "no_detected_loss",
      "q": 0.388135099533525,
      "label": "no_detected_loss",
      "q_prev": 0.4057776040577761,
      "label_prev": "no_detected_loss",
      "q_published": 0.4057776040577761,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.45)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 200,
      "mean_a": 68.79588839941263,
      "mean_b": 69.60352422907489,
      "delta": -0.8076358296622613,
      "ci95": [
       -2.3484848500749402,
       0.7342143921396529
      ],
      "p": 0.3330666933306669,
      "mid_p": 0.31255,
      "per_seed": {
       "42": -1.1013215859030836,
       "43": -0.7709251101321586,
       "44": -0.5506607929515418
      },
      "p_het": 0.9546045395460454,
      "mdd80": 2.2032151348187083,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7907670771384401,
      "label_source": "no_detected_loss",
      "q": 0.7476343274763433,
      "label": "no_detected_loss",
      "q_prev": 0.7907670771384401,
      "label_prev": "no_detected_loss",
      "q_published": 0.7907670771384401,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.20)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 15,
      "a_only": 8,
      "b_only": 7,
      "mean_a": 4.49438202247191,
      "mean_b": 4.119850187265918,
      "rate_a": 4.49438202247191,
      "rate_b": 4.119850187265918,
      "delta": 0.37453183520599254,
      "ci95": [
       -2.702702706405925,
       3.418803422269586
      ],
      "p": 1.0,
      "mid_p": 0.81975,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 3.3707865168539324,
       "44": -1.1235955056179776
      },
      "p_het": 0.36146385361463856,
      "mdd80": 4.375060260790925,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.38)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 252,
      "a_only": 116,
      "b_only": 136,
      "mean_a": 20.6,
      "mean_b": 21.933333333333334,
      "rate_a": 20.599999999999998,
      "rate_b": 21.933333333333334,
      "delta": -1.3333333333333333,
      "ci95": [
       -3.4153005485807024,
       0.7604562757529935
      ],
      "p": 0.22907709229077092,
      "mid_p": 0.20645,
      "per_seed": {
       "42": 0.4,
       "43": -1.2,
       "44": -3.2
      },
      "p_het": 0.38236176382361764,
      "mdd80": 2.9844269297205956,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7048525916639106,
      "label_source": "no_detected_loss",
      "q": 0.6793606353650349,
      "label": "no_detected_loss",
      "q_prev": 0.7048525916639106,
      "label_prev": "no_detected_loss",
      "q_published": 0.7048525916639106,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.98)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 132,
      "mean_a": 71.88552188552188,
      "mean_b": 72.47474747474747,
      "delta": -0.5892255892255892,
      "ci95": [
       -3.3333333361819704,
       2.1739130464407377
      ],
      "p": 0.7121287871212879,
      "mid_p": 0.67075,
      "per_seed": {
       "42": -2.525252525252525,
       "43": 2.525252525252525,
       "44": -1.7676767676767677
      },
      "p_het": 0.28247175282471754,
      "mdd80": 3.9360468303917933,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.94)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 40,
      "mean_a": 86.94444444444444,
      "mean_b": 88.92361111111111,
      "delta": -1.9791666666666667,
      "ci95": [
       -3.7037037065907037,
       -0.40064102380752087
      ],
      "p": 0.011198880111988802,
      "mid_p": 0.00835,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": -2.2916666666666665,
       "44": -2.8125
      },
      "p_het": 0.44655534446555345,
      "mdd80": 2.360709599660712,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.16798320167983202,
      "label_source": "nominal_loss",
      "q": 0.16798320167983202,
      "label": "nominal_loss",
      "q_prev": 0.16798320167983202,
      "label_prev": "nominal_loss",
      "q_published": 0.16798320167983202,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0112, q 0.168)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 213,
      "mean_a": 67.40088105726872,
      "mean_b": 69.60352422907489,
      "delta": -2.202643171806167,
      "ci95": [
       -3.6764705898731322,
       -0.7281553381843804
      ],
      "p": 0.0028997100289971,
      "mid_p": 0.00235,
      "per_seed": {
       "42": -1.9823788546255507,
       "43": -2.3127753303964758,
       "44": -2.3127753303964758
      },
      "p_het": 0.9863013698630136,
      "mdd80": 2.107170461452789,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.11398860113988601,
      "label_source": "nominal_loss",
      "q": 0.11398860113988601,
      "label": "nominal_loss",
      "q_prev": 0.11398860113988601,
      "label_prev": "nominal_loss",
      "q_published": 0.11398860113988601,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00290, q 0.114)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 13,
      "a_only": 6,
      "b_only": 7,
      "mean_a": 3.745318352059925,
      "mean_b": 4.119850187265918,
      "rate_a": 3.7453183520599254,
      "rate_b": 4.119850187265918,
      "delta": -0.37453183520599254,
      "ci95": [
       -3.252032523440298,
       2.4390243932985682
      ],
      "p": 1.0,
      "mid_p": 0.8063,
      "per_seed": {
       "42": 0.0,
       "43": 1.1235955056179776,
       "44": -2.247191011235955
      },
      "p_het": 0.6711328867113289,
      "mdd80": 4.06741681457906,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.07)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 277,
      "a_only": 113,
      "b_only": 164,
      "mean_a": 18.533333333333335,
      "mean_b": 21.933333333333334,
      "rate_a": 18.53333333333333,
      "rate_b": 21.933333333333334,
      "delta": -3.4,
      "ci95": [
       -5.5782312947325225,
       -1.2195121929149488
      ],
      "p": 0.0031996800319968005,
      "mid_p": 0.00255,
      "per_seed": {
       "42": -3.8,
       "43": -5.4,
       "44": -1.0
      },
      "p_het": 0.26117388261173885,
      "mdd80": 3.115190662144843,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.11398860113988601,
      "label_source": "nominal_loss",
      "q": 0.11398860113988601,
      "label": "nominal_loss",
      "q_prev": 0.11398860113988601,
      "label_prev": "nominal_loss",
      "q_published": 0.11398860113988601,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00320, q 0.114)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 131,
      "mean_a": 73.4006734006734,
      "mean_b": 72.47474747474747,
      "delta": 0.9259259259259259,
      "ci95": [
       -1.8115942058420096,
       3.641456584892866
      ],
      "p": 0.5483451654834517,
      "mid_p": 0.5082,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": 7.575757575757576,
       "44": -1.7676767676767677
      },
      "p_het": 0.0016998300169983002,
      "mdd80": 3.897313065302874,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9030329843727954,
      "label_source": "no_detected_loss",
      "q": 0.8908298359353253,
      "label": "no_detected_loss",
      "q_prev": 0.9030329843727954,
      "label_prev": "no_detected_loss",
      "q_published": 0.9030329843727954,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.90)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 39,
      "mean_a": 87.22222222222223,
      "mean_b": 88.92361111111111,
      "delta": -1.7013888888888888,
      "ci95": [
       -3.255208334796846,
       -0.16025640846841827
      ],
      "p": 0.0316968303169683,
      "mid_p": 0.0274,
      "per_seed": {
       "42": 0.0,
       "43": -3.75,
       "44": -1.3541666666666667
      },
      "p_het": 0.0156984301569843,
      "mdd80": 2.211972167847451,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.27168711700258547,
      "label_source": "nominal_loss",
      "q": 0.2535746425357464,
      "label": "nominal_loss",
      "q_prev": 0.27168711700258547,
      "label_prev": "nominal_loss",
      "q_published": 0.27168711700258547,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0317, q 0.25)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 209,
      "mean_a": 67.91483113069016,
      "mean_b": 69.60352422907489,
      "delta": -1.6886930983847284,
      "ci95": [
       -3.2163742705208964,
       -0.1488095222500267
      ],
      "p": 0.0372962703729627,
      "mid_p": 0.0338,
      "per_seed": {
       "42": -3.7444933920704844,
       "43": 0.7709251101321586,
       "44": -2.092511013215859
      },
      "p_het": 0.05269473052694731,
      "mdd80": 2.1923984629689173,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.2983701629837016,
      "label_source": "nominal_loss",
      "q": 0.2797220277972203,
      "label": "nominal_loss",
      "q_prev": 0.2983701629837016,
      "label_prev": "nominal_loss",
      "q_published": 0.2983701629837016,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0373, q 0.28)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 20,
      "a_only": 11,
      "b_only": 9,
      "mean_a": 4.868913857677903,
      "mean_b": 4.119850187265918,
      "rate_a": 4.868913857677903,
      "rate_b": 4.119850187265918,
      "delta": 0.7490636704119851,
      "ci95": [
       -2.8368794360114213,
       4.38596491654273
      ],
      "p": 0.846015398460154,
      "mid_p": 0.70595,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 3.3707865168539324,
       "44": -3.3707865168539324
      },
      "p_het": 0.19518048195180482,
      "mdd80": 5.162190257183503,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9953122334825341,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.16)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 257,
      "a_only": 126,
      "b_only": 131,
      "mean_a": 21.6,
      "mean_b": 21.933333333333334,
      "rate_a": 21.599999999999998,
      "rate_b": 21.933333333333334,
      "delta": -0.3333333333333333,
      "ci95": [
       -2.4577572989127265,
       1.7832647484033277
      ],
      "p": 0.8046195380461953,
      "mid_p": 0.7571,
      "per_seed": {
       "42": -0.6,
       "43": -0.4,
       "44": 0.0
      },
      "p_het": 0.9817018298170183,
      "mdd80": 3.031072196012856,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9852484139341168,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.03)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 133,
      "mean_a": 71.88552188552188,
      "mean_b": 72.47474747474747,
      "delta": -0.5892255892255892,
      "ci95": [
       -3.436426119743687,
       2.2653721710199113
      ],
      "p": 0.7198280171982802,
      "mid_p": 0.6774,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 0.0,
       "44": -0.25252525252525254
      },
      "p_het": 0.8914108589141085,
      "mdd80": 4.07509370939123,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.08)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 39,
      "mean_a": 86.80555555555556,
      "mean_b": 88.92361111111111,
      "delta": -2.1180555555555554,
      "ci95": [
       -4.51388889188763,
       0.13020833544946375
      ],
      "p": 0.07439256074392561,
      "mid_p": 0.06725,
      "per_seed": {
       "42": 0.625,
       "43": -4.791666666666667,
       "44": -2.1875
      },
      "p_het": 0.019998000199980003,
      "mdd80": 3.319151332936428,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4057776040577761,
      "label_source": "no_detected_loss",
      "q": 0.388135099533525,
      "label": "no_detected_loss",
      "q_prev": 0.4057776040577761,
      "label_prev": "no_detected_loss",
      "q_published": 0.4057776040577761,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.32)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 222,
      "mean_a": 68.4287812041116,
      "mean_b": 69.60352422907489,
      "delta": -1.1747430249632893,
      "ci95": [
       -2.866666668197177,
       0.5185185202259621
      ],
      "p": 0.18388161183881613,
      "mid_p": 0.1703,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": -0.9911894273127754,
       "44": -2.3127753303964758
      },
      "p_het": 0.5645435456454354,
      "mdd80": 2.419402820477546,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.6686604066866041,
      "label_source": "no_detected_loss",
      "q": 0.6304512405902267,
      "label": "no_detected_loss",
      "q_prev": 0.6686604066866041,
      "label_prev": "no_detected_loss",
      "q_published": 0.6686604066866041,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.42)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 19,
      "a_only": 11,
      "b_only": 8,
      "mean_a": 5.2434456928838955,
      "mean_b": 4.119850187265918,
      "rate_a": 5.2434456928838955,
      "rate_b": 4.119850187265918,
      "delta": 1.1235955056179776,
      "ci95": [
       -2.2727272761624375,
       4.504504508571047
      ],
      "p": 0.6892310768923108,
      "mid_p": 0.5503,
      "per_seed": {
       "42": 0.0,
       "43": 6.741573033707865,
       "44": -3.3707865168539324
      },
      "p_het": 0.030496950304969503,
      "mdd80": 4.843709511399617,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.84)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 254,
      "a_only": 105,
      "b_only": 149,
      "mean_a": 19.0,
      "mean_b": 21.933333333333334,
      "rate_a": 19.0,
      "rate_b": 21.933333333333334,
      "delta": -2.933333333333333,
      "ci95": [
       -5.078125002090502,
       -0.7936507915280678
      ],
      "p": 0.009599040095990401,
      "mid_p": 0.00825,
      "per_seed": {
       "42": -3.6,
       "43": -4.0,
       "44": -1.2
      },
      "p_het": 0.4978502149785021,
      "mdd80": 3.0621275978483795,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.16455497307412115,
      "label_source": "nominal_loss",
      "q": 0.16455497307412115,
      "label": "nominal_loss",
      "q_prev": 0.16455497307412115,
      "label_prev": "nominal_loss",
      "q_published": 0.16455497307412115,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00960, q 0.165)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 130,
      "mean_a": 72.72727272727273,
      "mean_b": 72.47474747474747,
      "delta": 0.25252525252525254,
      "ci95": [
       -2.9051987796134364,
       3.431372552101646
      ],
      "p": 0.9202079792020798,
      "mid_p": 0.87955,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": 1.5151515151515151,
       "44": -1.7676767676767677
      },
      "p_het": 0.5157484251574842,
      "mdd80": 4.528768058107293,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.53)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 86.94444444444444,
      "mean_b": 88.92361111111111,
      "delta": -1.9791666666666667,
      "ci95": [
       -3.7660256430924752,
       -0.37202380779814537
      ],
      "p": 0.008799120087991202,
      "mid_p": 0.00675,
      "per_seed": {
       "42": -0.625,
       "43": -2.9166666666666665,
       "44": -2.3958333333333335
      },
      "p_het": 0.3604639536046395,
      "mdd80": 2.4257041065579243,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.16455497307412115,
      "label_source": "nominal_loss",
      "q": 0.16455497307412115,
      "label": "nominal_loss",
      "q_prev": 0.16455497307412115,
      "label_prev": "nominal_loss",
      "q_published": 0.16455497307412115,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00880, q 0.165)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 211,
      "mean_a": 68.28193832599119,
      "mean_b": 69.60352422907489,
      "delta": -1.3215859030837005,
      "ci95": [
       -2.86123033054014,
       0.22222222378048379
      ],
      "p": 0.10428957104289571,
      "mid_p": 0.09505,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": 0.3303964757709251,
       "44": -3.4140969162995596
      },
      "p_het": 0.13928607139286073,
      "mdd80": 2.203753529421244,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.46350920463509204,
      "label_source": "no_detected_loss",
      "q": 0.4315430525912926,
      "label": "no_detected_loss",
      "q_prev": 0.46350920463509204,
      "label_prev": "no_detected_loss",
      "q_published": 0.46350920463509204,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.20)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 15,
      "a_only": 9,
      "b_only": 6,
      "mean_a": 5.2434456928838955,
      "mean_b": 4.119850187265918,
      "rate_a": 5.2434456928838955,
      "rate_b": 4.119850187265918,
      "delta": 1.1235955056179776,
      "ci95": [
       -2.127659577535356,
       4.2735042770987794
      ],
      "p": 0.6602339766023397,
      "mid_p": 0.51255,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 4.49438202247191,
       "44": -2.247191011235955
      },
      "p_het": 0.1376862313768623,
      "mdd80": 4.5749325434850965,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.57)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 258,
      "a_only": 120,
      "b_only": 138,
      "mean_a": 20.733333333333334,
      "mean_b": 21.933333333333334,
      "rate_a": 20.733333333333334,
      "rate_b": 21.933333333333334,
      "delta": -1.2,
      "ci95": [
       -3.234880452214635,
       0.823045269567654
      ],
      "p": 0.27347265273472654,
      "mid_p": 0.24625,
      "per_seed": {
       "42": 0.0,
       "43": -2.2,
       "44": -1.4
      },
      "p_het": 0.7056294370562943,
      "mdd80": 2.900212659013105,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.90)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 130,
      "mean_a": 73.06397306397307,
      "mean_b": 72.47474747474747,
      "delta": 0.5892255892255892,
      "ci95": [
       -2.0408163291837385,
       3.256704983873239
      ],
      "p": 0.7091290870912909,
      "mid_p": 0.6615,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": 4.545454545454546,
       "44": 0.25252525252525254
      },
      "p_het": 0.08699130086991301,
      "mdd80": 3.786155643768548,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.79)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 87.5,
      "mean_b": 88.92361111111111,
      "delta": -1.4236111111111112,
      "ci95": [
       -2.976190477861885,
       0.07440476351548425
      ],
      "p": 0.0710928907109289,
      "mid_p": 0.06285,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": -1.25,
       "44": -2.1875
      },
      "p_het": 0.652934706529347,
      "mdd80": 2.1802703014193945,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4057776040577761,
      "label_source": "no_detected_loss",
      "q": 0.388135099533525,
      "label": "no_detected_loss",
      "q_prev": 0.4057776040577761,
      "label_prev": "no_detected_loss",
      "q_published": 0.4057776040577761,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.18)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 217,
      "mean_a": 68.94273127753304,
      "mean_b": 69.60352422907489,
      "delta": -0.6607929515418502,
      "ci95": [
       -2.1969696985522846,
       0.8807588090087517
      ],
      "p": 0.42605739426057393,
      "mid_p": 0.39975,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": -2.092511013215859,
       "44": -1.4317180616740088
      },
      "p_het": 0.15128487151284872,
      "mdd80": 2.1996625346591103,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.824627214697885,
      "label_source": "no_detected_loss",
      "q": 0.7988576142385762,
      "label": "no_detected_loss",
      "q_prev": 0.824627214697885,
      "label_prev": "no_detected_loss",
      "q_published": 0.824627214697885,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.20)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 9,
      "b_only": 7,
      "mean_a": 4.868913857677903,
      "mean_b": 4.119850187265918,
      "rate_a": 4.868913857677903,
      "rate_b": 4.119850187265918,
      "delta": 0.7490636704119851,
      "ci95": [
       -2.500000003606824,
       4.065040653999821
      ],
      "p": 0.831016898310169,
      "mid_p": 0.6725,
      "per_seed": {
       "42": 0.0,
       "43": 2.247191011235955,
       "44": 0.0
      },
      "p_het": 0.8497150284971503,
      "mdd80": 4.6920558254486515,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9929304099293041,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.69)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 275,
      "a_only": 132,
      "b_only": 143,
      "mean_a": 21.2,
      "mean_b": 21.933333333333334,
      "rate_a": 21.2,
      "rate_b": 21.933333333333334,
      "delta": -0.7333333333333333,
      "ci95": [
       -2.8314028334197228,
       1.3440860235961183
      ],
      "p": 0.5382461753824618,
      "mid_p": 0.4964,
      "per_seed": {
       "42": 0.4,
       "43": -1.0,
       "44": -1.6
      },
      "p_het": 0.7502249775022498,
      "mdd80": 2.984235412610444,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9030329843727954,
      "label_source": "no_detected_loss",
      "q": 0.8908298359353253,
      "label": "no_detected_loss",
      "q_prev": 0.9030329843727954,
      "label_prev": "no_detected_loss",
      "q_published": 0.9030329843727954,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 138,
      "mean_a": 77.10437710437711,
      "mean_b": 76.26262626262626,
      "delta": 0.8417508417508418,
      "ci95": [
       -1.6025641048917512,
       3.2710280396300786
      ],
      "p": 0.547945205479452,
      "mid_p": 0.50175,
      "per_seed": {
       "42": 1.2626262626262625,
       "43": -2.525252525252525,
       "44": 3.787878787878788
      },
      "p_het": 0.17268273172682733,
      "mdd80": 3.4831720936974215,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9030329843727954,
      "label_source": "no_detected_loss",
      "q": 0.8908298359353253,
      "label": "no_detected_loss",
      "q_prev": 0.9030329843727954,
      "label_prev": "no_detected_loss",
      "q_published": 0.9030329843727954,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.48)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 46,
      "mean_a": 87.15277777777777,
      "mean_b": 87.60416666666667,
      "delta": -0.4513888888888889,
      "ci95": [
       -1.370614035820354,
       0.4861111120594268
      ],
      "p": 0.37366263373662634,
      "mid_p": 0.3343,
      "per_seed": {
       "42": 0.0,
       "43": -0.7291666666666666,
       "44": -0.625
      },
      "p_het": 0.8308169183081692,
      "mdd80": 1.3270074780530505,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8125187481251874,
      "label_source": "no_detected_loss",
      "q": 0.7863084659276007,
      "label": "no_detected_loss",
      "q_prev": 0.8125187481251874,
      "label_prev": "no_detected_loss",
      "q_published": 0.8125187481251874,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.33)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 178,
      "mean_a": 80.10279001468429,
      "mean_b": 79.77239353891336,
      "delta": 0.3303964757709251,
      "ci95": [
       -1.1013215873301392,
       1.7584097874165239
      ],
      "p": 0.6807319268073193,
      "mid_p": 0.64465,
      "per_seed": {
       "42": 0.5506607929515418,
       "43": 0.0,
       "44": 0.44052863436123346
      },
      "p_het": 0.9519048095190481,
      "mdd80": 2.0438592776347013,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_dense",
       "bf16"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9846158241318725,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.04)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 35,
      "a_only": 16,
      "b_only": 19,
      "mean_a": 22.846441947565545,
      "mean_b": 23.970037453183522,
      "rate_a": 22.84644194756554,
      "rate_b": 23.970037453183522,
      "delta": -1.1235955056179776,
      "ci95": [
       -5.426356593588616,
       3.1007751981622143
      ],
      "p": 0.7279272072792721,
      "mid_p": 0.60815,
      "per_seed": {
       "42": 0.0,
       "43": -1.1235955056179776,
       "44": -2.247191011235955
      },
      "p_het": 0.9771022897710229,
      "mdd80": 6.094368715218112,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.09)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 220,
      "a_only": 107,
      "b_only": 113,
      "mean_a": 48.0,
      "mean_b": 48.4,
      "rate_a": 48.0,
      "rate_b": 48.400000000000006,
      "delta": -0.4,
      "ci95": [
       -2.487562190997946,
       1.6806722710882718
      ],
      "p": 0.7499250074992501,
      "mid_p": 0.70495,
      "per_seed": {
       "42": -1.6,
       "43": -0.8,
       "44": 1.2
      },
      "p_het": 0.47595240475952405,
      "mdd80": 2.9790506730536213,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_dense",
       "dense_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 132,
      "mean_a": 75.58922558922559,
      "mean_b": 76.26262626262626,
      "delta": -0.6734006734006734,
      "ci95": [
       -3.065134102332263,
       1.7133956408342446
      ],
      "p": 0.6266373362663734,
      "mid_p": 0.5793,
      "per_seed": {
       "42": -1.7676767676767677,
       "43": -3.5353535353535355,
       "44": 3.282828282828283
      },
      "p_het": 0.0846915308469153,
      "mdd80": 3.4152306874940086,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9765776669086339,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9765776669086339,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.42)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 41,
      "mean_a": 85.48611111111111,
      "mean_b": 87.60416666666667,
      "delta": -2.1180555555555554,
      "ci95": [
       -3.794642858946587,
       -0.4629629601870553
      ],
      "p": 0.0071992800719928,
      "mid_p": 0.00555,
      "per_seed": {
       "42": -2.2916666666666665,
       "43": -2.6041666666666665,
       "44": -1.4583333333333333
      },
      "p_het": 0.5856414358564144,
      "mdd80": 2.3811624166245147,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.16455497307412115,
      "label_source": "nominal_loss",
      "q": 0.16455497307412115,
      "label": "nominal_loss",
      "q_prev": 0.16455497307412115,
      "label_prev": "nominal_loss",
      "q_published": 0.16455497307412115,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00720, q 0.165)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 202,
      "mean_a": 78.41409691629956,
      "mean_b": 79.77239353891336,
      "delta": -1.3582966226138031,
      "ci95": [
       -2.812939523192113,
       0.07680491701523856
      ],
      "p": 0.07439256074392561,
      "mid_p": 0.06665,
      "per_seed": {
       "42": -0.3303964757709251,
       "43": -2.4229074889867843,
       "44": -1.3215859030837005
      },
      "p_het": 0.553944605539446,
      "mdd80": 2.065309712746817,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r40",
       "bf16"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4057776040577761,
      "label_source": "no_detected_loss",
      "q": 0.388135099533525,
      "label": "no_detected_loss",
      "q_prev": 0.4057776040577761,
      "label_prev": "no_detected_loss",
      "q_published": 0.4057776040577761,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.07)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 39,
      "a_only": 16,
      "b_only": 23,
      "mean_a": 21.348314606741575,
      "mean_b": 23.970037453183522,
      "rate_a": 21.34831460674157,
      "rate_b": 23.970037453183522,
      "delta": -2.6217228464419478,
      "ci95": [
       -7.751937989805705,
       2.515723274747911
      ],
      "p": 0.39966003399660033,
      "mid_p": 0.33125,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -4.49438202247191,
       "44": 0.0
      },
      "p_het": 0.7501249875012499,
      "mdd80": 7.338330767877604,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.8125187481251874,
      "label_source": "no_detected_loss",
      "q": 0.7863084659276007,
      "label": "no_detected_loss",
      "q_prev": 0.8125187481251874,
      "label_prev": "no_detected_loss",
      "q_published": 0.8125187481251874,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.34)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 247,
      "a_only": 121,
      "b_only": 126,
      "mean_a": 48.06666666666667,
      "mean_b": 48.4,
      "rate_a": 48.06666666666667,
      "rate_b": 48.400000000000006,
      "delta": -0.3333333333333333,
      "ci95": [
       -2.3809523827747956,
       1.7060367474141656
      ],
      "p": 0.7998200179982001,
      "mid_p": 0.7508,
      "per_seed": {
       "42": -0.6,
       "43": -1.4,
       "44": 1.0
      },
      "p_het": 0.6257374262573743,
      "mdd80": 2.9209843711523003,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r40",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9852484139341168,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.92)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 134,
      "mean_a": 73.06397306397307,
      "mean_b": 76.26262626262626,
      "delta": -3.1986531986531985,
      "ci95": [
       -5.817610065335667,
       -0.5847953193747496
      ],
      "p": 0.0192980701929807,
      "mid_p": 0.01625,
      "per_seed": {
       "42": -6.313131313131313,
       "43": -3.5353535353535355,
       "44": 0.25252525252525254
      },
      "p_het": 0.1050894910508949,
      "mdd80": 3.7399096506479914,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.192980701929807,
      "label_source": "nominal_loss",
      "q": 0.192980701929807,
      "label": "nominal_loss",
      "q_prev": 0.192980701929807,
      "label_prev": "nominal_loss",
      "q_published": 0.192980701929807,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0193, q 0.193)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 42,
      "mean_a": 87.08333333333333,
      "mean_b": 87.60416666666667,
      "delta": -0.5208333333333334,
      "ci95": [
       -1.666666667820985,
       0.6250000008628362
      ],
      "p": 0.42085791420857915,
      "mid_p": 0.3879,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": -0.7291666666666666,
       "44": -1.6666666666666667
      },
      "p_het": 0.2736726327367263,
      "mdd80": 1.637861591965283,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.824627214697885,
      "label_source": "no_detected_loss",
      "q": 0.7988576142385762,
      "label": "no_detected_loss",
      "q_prev": 0.824627214697885,
      "label_prev": "no_detected_loss",
      "q_published": 0.824627214697885,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.64)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 196,
      "mean_a": 78.19383259911895,
      "mean_b": 79.77239353891336,
      "delta": -1.57856093979442,
      "ci95": [
       -3.1345565765433143,
       1.4969508114852375e-09
      ],
      "p": 0.051394860513948606,
      "mid_p": 0.0456,
      "per_seed": {
       "42": -2.092511013215859,
       "43": -0.6607929515418502,
       "44": -1.9823788546255507
      },
      "p_het": 0.6811318868113189,
      "mdd80": 2.2402777407252183,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r60",
       "bf16"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.36278725068669604,
      "label_source": "no_detected_loss",
      "q": 0.34263240342632406,
      "label": "no_detected_loss",
      "q_prev": 0.36278725068669604,
      "label_prev": "no_detected_loss",
      "q_published": 0.36278725068669604,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.24)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 31,
      "a_only": 12,
      "b_only": 19,
      "mean_a": 21.348314606741575,
      "mean_b": 23.970037453183522,
      "rate_a": 21.34831460674157,
      "rate_b": 23.970037453183522,
      "delta": -2.6217228464419478,
      "ci95": [
       -6.6666666726537915,
       1.5503876012205826
      ],
      "p": 0.28877112288771123,
      "mid_p": 0.21945,
      "per_seed": {
       "42": -5.617977528089888,
       "43": -2.247191011235955,
       "44": 0.0
      },
      "p_het": 0.573942605739426,
      "mdd80": 5.8727553086953135,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.7418832584826623,
      "label_source": "no_detected_loss",
      "q": 0.6973702629737026,
      "label": "no_detected_loss",
      "q_prev": 0.7418832584826623,
      "label_prev": "no_detected_loss",
      "q_published": 0.7418832584826623,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.87)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 242,
      "a_only": 127,
      "b_only": 115,
      "mean_a": 49.2,
      "mean_b": 48.4,
      "rate_a": 49.199999999999996,
      "rate_b": 48.400000000000006,
      "delta": 0.8,
      "ci95": [
       -1.2244897979783236,
       2.8225806471940436
      ],
      "p": 0.48365163483651635,
      "mid_p": 0.44485,
      "per_seed": {
       "42": 2.2,
       "43": -1.0,
       "44": 1.2
      },
      "p_het": 0.43115688431156884,
      "mdd80": 2.8924543576543122,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r60",
       "dense_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8616197203809031,
      "label_source": "no_detected_loss",
      "q": 0.8370020140843059,
      "label": "no_detected_loss",
      "q_prev": 0.8616197203809031,
      "label_prev": "no_detected_loss",
      "q_published": 0.8616197203809031,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.89)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 129,
      "mean_a": 75.75757575757575,
      "mean_b": 76.26262626262626,
      "delta": -0.5050505050505051,
      "ci95": [
       -3.048780490876939,
       2.0202020227201496
      ],
      "p": 0.7452254774522548,
      "mid_p": 0.69785,
      "per_seed": {
       "42": -0.25252525252525254,
       "43": -2.525252525252525,
       "44": 1.2626262626262625
      },
      "p_het": 0.45435456454354567,
      "mdd80": 3.622818223442847,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.62)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 86.52777777777777,
      "mean_b": 87.60416666666667,
      "delta": -1.0763888888888888,
      "ci95": [
       -2.604166668589098,
       0.383771930981288
      ],
      "p": 0.22477752224777522,
      "mid_p": 0.2062,
      "per_seed": {
       "42": -1.25,
       "43": -0.5208333333333334,
       "44": -1.4583333333333333
      },
      "p_het": 0.8184181581841816,
      "mdd80": 2.1354893965436763,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7048525916639106,
      "label_source": "no_detected_loss",
      "q": 0.6793606353650349,
      "label": "no_detected_loss",
      "q_prev": 0.7048525916639106,
      "label_prev": "no_detected_loss",
      "q_published": 0.7048525916639106,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.14)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 189,
      "mean_a": 78.56093979441997,
      "mean_b": 79.77239353891336,
      "delta": -1.2114537444933922,
      "ci95": [
       -2.5073746325649204,
       0.07645260072488483
      ],
      "p": 0.0740925907409259,
      "mid_p": 0.06665,
      "per_seed": {
       "42": 0.11013215859030837,
       "43": -1.5418502202643172,
       "44": -2.202643171806167
      },
      "p_het": 0.44935506449355067,
      "mdd80": 1.8466696939436835,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u32",
       "bf16"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4057776040577761,
      "label_source": "no_detected_loss",
      "q": 0.388135099533525,
      "label": "no_detected_loss",
      "q_prev": 0.4057776040577761,
      "label_prev": "no_detected_loss",
      "q_published": 0.4057776040577761,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.85)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 18,
      "b_only": 23,
      "mean_a": 22.09737827715356,
      "mean_b": 23.970037453183522,
      "rate_a": 22.097378277153563,
      "rate_b": 23.970037453183522,
      "delta": -1.8726591760299625,
      "ci95": [
       -7.407407412870204,
       3.703703710591009
      ],
      "p": 0.6041395860413958,
      "mid_p": 0.5183,
      "per_seed": {
       "42": -5.617977528089888,
       "43": -1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.48005199480051997,
      "mdd80": 7.941147114395706,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9666233376662334,
      "label_source": "no_detected_loss",
      "q": 0.9539046095390461,
      "label": "no_detected_loss",
      "q_prev": 0.9666233376662334,
      "label_prev": "no_detected_loss",
      "q_published": 0.9666233376662334,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.94)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 234,
      "a_only": 104,
      "b_only": 130,
      "mean_a": 46.666666666666664,
      "mean_b": 48.4,
      "rate_a": 46.666666666666664,
      "rate_b": 48.400000000000006,
      "delta": -1.7333333333333334,
      "ci95": [
       -3.746770027790037,
       0.27322404576521475
      ],
      "p": 0.10038996100389962,
      "mid_p": 0.0892,
      "per_seed": {
       "42": -1.0,
       "43": -1.0,
       "44": -3.2
      },
      "p_het": 0.611038896110389,
      "mdd80": 2.8731027871456214,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u32",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4633382815564598,
      "label_source": "no_detected_loss",
      "q": 0.4302426900167126,
      "label": "no_detected_loss",
      "q_prev": 0.4633382815564598,
      "label_prev": "no_detected_loss",
      "q_published": 0.4633382815564598,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.87)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 148,
      "mean_a": 77.60942760942761,
      "mean_b": 76.26262626262626,
      "delta": 1.3468013468013469,
      "ci95": [
       -1.2820512845550498,
       3.977272730223814
      ],
      "p": 0.34266573342665735,
      "mid_p": 0.3121,
      "per_seed": {
       "42": -0.7575757575757576,
       "43": 0.5050505050505051,
       "44": 4.292929292929293
      },
      "p_het": 0.3564643535646435,
      "mdd80": 3.758855910948986,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7907670771384401,
      "label_source": "no_detected_loss",
      "q": 0.7476343274763433,
      "label": "no_detected_loss",
      "q_prev": 0.7907670771384401,
      "label_prev": "no_detected_loss",
      "q_published": 0.7907670771384401,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.76)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 40,
      "mean_a": 86.59722222222223,
      "mean_b": 87.60416666666667,
      "delta": -1.0069444444444444,
      "ci95": [
       -2.4088541679907425,
       0.37202381100853765
      ],
      "p": 0.1927807219278072,
      "mid_p": 0.17585,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": -3.4375,
       "44": -0.4166666666666667
      },
      "p_het": 0.039696030396960305,
      "mdd80": 1.9875025002483753,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.680402547980496,
      "label_source": "no_detected_loss",
      "q": 0.6426024064260241,
      "label": "no_detected_loss",
      "q_prev": 0.680402547980496,
      "label_prev": "no_detected_loss",
      "q_published": 0.680402547980496,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.99)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 194,
      "mean_a": 79.0748898678414,
      "mean_b": 79.77239353891336,
      "delta": -0.697503671071953,
      "ci95": [
       -2.2058823546135056,
       0.811209441040659
      ],
      "p": 0.3935606439356064,
      "mid_p": 0.36865,
      "per_seed": {
       "42": 0.11013215859030837,
       "43": -0.8810572687224669,
       "44": -1.3215859030837005
      },
      "p_het": 0.7257274272572742,
      "mdd80": 2.156325280226567,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u64",
       "bf16"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8125187481251874,
      "label_source": "no_detected_loss",
      "q": 0.7863084659276007,
      "label": "no_detected_loss",
      "q_prev": 0.8125187481251874,
      "label_prev": "no_detected_loss",
      "q_published": 0.8125187481251874,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.16)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 33,
      "a_only": 17,
      "b_only": 16,
      "mean_a": 24.344569288389515,
      "mean_b": 23.970037453183522,
      "rate_a": 24.34456928838951,
      "rate_b": 23.970037453183522,
      "delta": 0.37453183520599254,
      "ci95": [
       -3.9682539728422697,
       4.761904766540168
      ],
      "p": 1.0,
      "mid_p": 0.8732,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 1.1235955056179776,
       "44": -1.1235955056179776
      },
      "p_het": 0.926907309269073,
      "mdd80": 6.239472732396465,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.24)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 242,
      "a_only": 124,
      "b_only": 118,
      "mean_a": 48.8,
      "mean_b": 48.4,
      "rate_a": 48.800000000000004,
      "rate_b": 48.400000000000006,
      "delta": 0.4,
      "ci95": [
       -1.5686274529077981,
       2.3529411783798437
      ],
      "p": 0.7424257574242575,
      "mid_p": 0.6937,
      "per_seed": {
       "42": 1.4,
       "43": -0.8,
       "44": 0.6
      },
      "p_het": 0.6878312168783122,
      "mdd80": 2.8027578047076207,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u64",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9870317316094478,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9870317316094478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.80)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 138,
      "mean_a": 75.25252525252525,
      "mean_b": 76.26262626262626,
      "delta": -1.0101010101010102,
      "ci95": [
       -3.6458333360513526,
       1.6304347854485504
      ],
      "p": 0.48825117488251174,
      "mid_p": 0.44925,
      "per_seed": {
       "42": -4.292929292929293,
       "43": -1.5151515151515151,
       "44": 2.7777777777777777
      },
      "p_het": 0.0923907609239076,
      "mdd80": 3.7709659189129674,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8616197203809031,
      "label_source": "no_detected_loss",
      "q": 0.8370020140843059,
      "label": "no_detected_loss",
      "q_prev": 0.8616197203809031,
      "label_prev": "no_detected_loss",
      "q_published": 0.8616197203809031,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.77)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 43,
      "mean_a": 87.91666666666667,
      "mean_b": 87.60416666666667,
      "delta": 0.3125,
      "ci95": [
       -0.6944444457129928,
       1.3888888902473728
      ],
      "p": 0.667033296670333,
      "mid_p": 0.62645,
      "per_seed": {
       "42": 1.25,
       "43": -0.10416666666666667,
       "44": -0.20833333333333334
      },
      "p_het": 0.5269473052694731,
      "mdd80": 1.488965084171745,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9846158241318725,
      "label_source": "no_detected_loss",
      "q": 0.9660310564688213,
      "label": "no_detected_loss",
      "q_prev": 0.9870317316094478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9846158241318725,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.49)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 188,
      "mean_a": 78.8546255506608,
      "mean_b": 79.77239353891336,
      "delta": -0.9177679882525698,
      "ci95": [
       -2.3364485996334152,
       0.5028735646035918
      ],
      "p": 0.22317768223177684,
      "mid_p": 0.2056,
      "per_seed": {
       "42": 0.9911894273127754,
       "43": -2.643171806167401,
       "44": -1.1013215859030836
      },
      "p_het": 0.11988801119888011,
      "mdd80": 2.029272748767788,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u128",
       "bf16"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7048525916639106,
      "label_source": "no_detected_loss",
      "q": 0.6793606353650349,
      "label": "no_detected_loss",
      "q_prev": 0.7048525916639106,
      "label_prev": "no_detected_loss",
      "q_published": 0.7048525916639106,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.03)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 34,
      "a_only": 12,
      "b_only": 22,
      "mean_a": 20.224719101123597,
      "mean_b": 23.970037453183522,
      "rate_a": 20.224719101123597,
      "rate_b": 23.970037453183522,
      "delta": -3.745318352059925,
      "ci95": [
       -8.527131787884624,
       0.925925931699995
      ],
      "p": 0.16948305169483052,
      "mid_p": 0.1309,
      "per_seed": {
       "42": -7.865168539325842,
       "43": -2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 0.37176282371762825,
      "mdd80": 6.756130975379088,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.6355614438556144,
      "label_source": "no_detected_loss",
      "q": 0.59817547656999,
      "label": "no_detected_loss",
      "q_prev": 0.6355614438556144,
      "label_prev": "no_detected_loss",
      "q_published": 0.6355614438556144,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.76)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 242,
      "a_only": 129,
      "b_only": 113,
      "mean_a": 49.46666666666667,
      "mean_b": 48.4,
      "rate_a": 49.46666666666667,
      "rate_b": 48.400000000000006,
      "delta": 1.0666666666666667,
      "ci95": [
       -1.010101012063798,
       3.12109862863989
      ],
      "p": 0.34096590340965904,
      "mid_p": 0.3099,
      "per_seed": {
       "42": 2.4,
       "43": 0.6,
       "44": 0.2
      },
      "p_het": 0.6537346265373463,
      "mdd80": 2.9525817662371785,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u128",
       "dense_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7907670771384401,
      "label_source": "no_detected_loss",
      "q": 0.7476343274763433,
      "label": "no_detected_loss",
      "q_prev": 0.7907670771384401,
      "label_prev": "no_detected_loss",
      "q_published": 0.7907670771384401,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.95)"
     }
    ],
    "counts": {
     "m": 120,
     "by_bench": {
      "gpqa": 24,
      "aime25": 24,
      "lcb": 24,
      "tb": 24,
      "swe": 24
     },
     "n_p05": 17,
     "n_p05_below": 11,
     "n_p05_above": 6,
     "loss_detected": 1,
     "nominal_loss": 10,
     "gain_detected": 0,
     "nominal_gain": 6,
     "no_detected_loss": 103,
     "smallest_q_below": 0.011998800119988003
    },
    "counts_prev": {
     "m": 120,
     "by_bench": {
      "gpqa": 24,
      "aime25": 24,
      "lcb": 24,
      "tb": 24,
      "swe": 24
     },
     "n_p05": 17,
     "n_p05_below": 11,
     "n_p05_above": 6,
     "loss_detected": 1,
     "nominal_loss": 10,
     "gain_detected": 0,
     "nominal_gain": 5,
     "no_detected_loss": 104,
     "smallest_q_below": 0.011998800119988003
    },
    "label_changes": [
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "dense_sxs"
      ],
      "source": "sxs",
      "delta": 1.8729096989966556,
      "p": 0.025897410258974102,
      "q_prev": 1.0,
      "q": 0.2331195451883383,
      "label_prev": "no_detected_loss",
      "label": "nominal_gain"
     }
    ],
    "sources": [
     {
      "source": "published",
      "file": "log/sparse/dev/stats/verdicts_noruler.json",
      "md5": "e41a15a47099cab0e07915792d268715",
      "members": 90
     },
     {
      "source": "tbp v1",
      "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "members": 24
     },
     {
      "source": "sxs",
      "file": null,
      "md5": null,
      "members": 6
     }
    ],
    "ruler": {
     "unchanged": true,
     "m": 24,
     "source": "log/sparse/dev/stats/verdicts_noruler.json",
     "why": "no RULER member is replaced: RULER keeps its own BH (prereg family_bh)"
    },
    "arm_status": [
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "tb"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.5050505050505051,
        "ci95": [
         -1.1904761921897844,
         2.197802199642796
        ],
        "p": 0.6404359564043596,
        "q": 0.9660310564688213,
        "mdd80": 2.42161354297471,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3125,
        "ci95": [
         -1.0416666673593737,
         0.3720238102669623
        ],
        "p": 0.45925407459254075,
        "q": 0.8104483669280131,
        "mdd80": 1.0103691640115613,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.03671071953010279,
        "ci95": [
         -1.5082956274508423,
         1.4354067001603958
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.1038735896710166,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 5.617977528089888,
        "ci95": [
         0.7246376764328935,
         10.60606061109768
        ],
        "p": 0.040495950404959506,
        "q": 0.28585376756442005,
        "mdd80": 7.062284982286519,
        "verdict": "nominal_gain",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.3351206434316354,
        "ci95": [
         -1.466666668454037,
         2.1333333351161525
        ],
        "p": 0.7722227777222278,
        "q": 0.9754392981754457,
        "mdd80": 2.5729316647559974,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.42, AIME25 1.01, LCB v6 2.10, Terminal-Bench 2.1 7.06, SWE-bench Verified 2.57)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_r40",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.0101010101010102,
        "ci95": [
         -2.6234567916032487,
         0.5747126454791296
        ],
        "p": 0.2695730426957304,
        "q": 0.6973702629737026,
        "mdd80": 2.2857420571565505,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.10416666666666667,
        "ci95": [
         -0.757575758480093,
         0.5608974366756316
        ],
        "p": 0.8357164283571643,
        "q": 0.9929304099293041,
        "mdd80": 0.942317063773313,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.03671071953010279,
        "ci95": [
         -1.590909092512186,
         1.521438452362733
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.2244048727757555,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -5.555555560343386,
         4.761904767329096
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 7.373922319612783,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.9395973154362416,
        "ci95": [
         -2.380952382452482,
         0.524246397235131
        ],
        "p": 0.23777622237776222,
        "q": 0.6793606353650349,
        "mdd80": 2.076354979237711,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.29, AIME25 0.94, LCB v6 2.22, Terminal-Bench 2.1 7.37, SWE-bench Verified 2.08)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_r60",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.16835016835016836,
        "ci95": [
         -1.8691588800729706,
         1.5463917543221708
        ],
        "p": 0.928007199280072,
        "q": 1.0,
        "mdd80": 2.441105103082635,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.10416666666666667,
        "ci95": [
         -0.7211538468785339,
         0.5208333340134119
        ],
        "p": 0.8253174682531746,
        "q": 0.9929304099293041,
        "mdd80": 0.8876522616024543,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 1.2114537444933922,
        "ci95": [
         -0.4291845509540222,
         2.841781875738925
        ],
        "p": 0.15998400159984003,
        "q": 0.5817600058176001,
        "mdd80": 2.3377703014571605,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 4.119850187265918,
        "ci95": [
         -1.6260162663917588,
         9.848484854262008
        ],
        "p": 0.20467953204679531,
        "q": 0.6638255093409579,
        "mdd80": 8.20086312259156,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.0046885465505693,
        "ci95": [
         -0.5369127532161896,
         2.5469168916221783
        ],
        "p": 0.23467653234676533,
        "q": 0.6793606353650349,
        "mdd80": 2.2040230372358605,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.44, AIME25 0.89, LCB v6 2.34, Terminal-Bench 2.1 8.20, SWE-bench Verified 2.20)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_u32",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "lcb"
      ],
      "cells": {
       "gpqa": {
        "delta": 1.0101010101010102,
        "ci95": [
         -0.6535947728548801,
         2.672955976391838
        ],
        "p": 0.2706729327067293,
        "q": 0.6973702629737026,
        "mdd80": 2.377496596851821,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.034722222222222224,
        "ci95": [
         -0.6127450986191485,
         0.7161458339807993
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 0.9497626544729725,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 2.23935389133627,
        "ci95": [
         0.7610350060829625,
         3.720930234122269
        ],
        "p": 0.0037996200379962005,
        "q": 0.11398860113988601,
        "mdd80": 2.115446708063878,
        "verdict": "nominal_gain",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -2.898550730324115,
         8.888888894717901
        ],
        "p": 0.38836116388361164,
        "q": 0.7863084659276007,
        "mdd80": 8.424521285442507,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.4682274247491639,
        "ci95": [
         -1.2517385275172357,
         2.1802325599957433
        ],
        "p": 0.6414358564143585,
        "q": 0.9660310564688213,
        "mdd80": 2.4528408541200313,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.38, AIME25 0.95, LCB v6 2.12, Terminal-Bench 2.1 8.42, SWE-bench Verified 2.45)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_u64",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "lcb"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.8417508417508418,
        "ci95": [
         -0.5376344100709577,
         2.2435897449255426
        ],
        "p": 0.29057094290570945,
        "q": 0.6973702629737026,
        "mdd80": 1.9877499133550263,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.7291666666666666,
        "ci95": [
         -1.5625000010551773,
         0.0744047627750796
        ],
        "p": 0.0988901109889011,
        "q": 0.4302426900167126,
        "mdd80": 1.1699011374644548,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 1.8722466960352422,
        "ci95": [
         0.22831050058120367,
         3.516819573572846
        ],
        "p": 0.027197280271972803,
        "q": 0.2331195451883383,
        "mdd80": 2.350308087596262,
        "verdict": "nominal_gain",
        "source": "published"
       },
       "tb": {
        "delta": 1.4981273408239701,
        "ci95": [
         -4.385964919170994,
         7.31707317703928
        ],
        "p": 0.7078292170782922,
        "q": 0.9660310564688213,
        "mdd80": 8.364199239367608,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.4046822742474916,
        "ci95": [
         -0.13623978358321787,
         2.9247910879299166
        ],
        "p": 0.0857914208579142,
        "q": 0.41611838816118385,
        "mdd80": 2.187728680083662,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 1.99, AIME25 1.17, LCB v6 2.35, Terminal-Bench 2.1 8.36, SWE-bench Verified 2.19)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.6734006734006734,
        "ci95": [
         -0.5208333345658365,
         1.8707483005297956
        ],
        "p": 0.3565643435656434,
        "q": 0.7640664504978074,
        "mdd80": 1.709271142134459,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.4513888888888889,
        "ci95": [
         -0.9803921573385052,
         0.08680555624211392
        ],
        "p": 0.1394860513948605,
        "q": 0.53994600539946,
        "mdd80": 0.7627296630843574,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.697503671071953,
        "ci95": [
         -0.8733624469712797,
         2.2727272743523796
        ],
        "p": 0.4062593740625937,
        "q": 0.7863084659276007,
        "mdd80": 2.248520515591492,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 4.49438202247191,
        "ci95": [
         -1.360544222993025,
         10.144927541679484
        ],
        "p": 0.15278472152784722,
        "q": 0.5729427057294271,
        "mdd80": 8.222997942201195,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.8729096989966556,
        "ci95": [
         0.27285129441414835,
         3.4578146627731394
        ],
        "p": 0.025897410258974102,
        "q": 0.2331195451883383,
        "mdd80": 2.27630363705887,
        "verdict": "nominal_gain",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 1.71, AIME25 0.76, LCB v6 2.25, Terminal-Bench 2.1 8.22, SWE-bench Verified 2.28)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": -1.2626262626262625,
        "ci95": [
         -3.4364261190492718,
         0.8771929846796456
        ],
        "p": 0.28857114288571145,
        "q": 0.6973702629737026,
        "mdd80": 3.0829575474093813,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.3472222222222222,
        "ci95": [
         -0.20833333418188565,
         0.8928571434519276
        ],
        "p": 0.27217278272172785,
        "q": 0.6973702629737026,
        "mdd80": 0.7870244016727758,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.697503671071953,
        "ci95": [
         -0.9715994037916746,
         2.3504273520303065
        ],
        "p": 0.4370562943705629,
        "q": 0.8068731588379624,
        "mdd80": 2.3742632840956794,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.7490636704119851,
        "ci95": [
         -5.691056915933228,
         4.166666672119435
        ],
        "p": 0.8824117588241176,
        "q": 1.0,
        "mdd80": 7.045346982488772,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.066666666666667,
        "ci95": [
         0.4201680654991957,
         3.6885245918197507
        ],
        "p": 0.015998400159984,
        "q": 0.17452800174528002,
        "mdd80": 2.3359049972062365,
        "verdict": "nominal_gain",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.08, AIME25 0.79, LCB v6 2.37, Terminal-Bench 2.1 7.05, SWE-bench Verified 2.34)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_r40",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.25252525252525254,
        "ci95": [
         -2.356902359002289,
         1.83486238721258
        ],
        "p": 0.8777122287771223,
        "q": 1.0,
        "mdd80": 2.995867843346752,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.3194444444444444,
        "ci95": [
         -2.9356060628217393,
         0.069444445839632
        ],
        "p": 0.0866913308669133,
        "q": 0.41611838816118385,
        "mdd80": 2.147719333405054,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -4.148311306901615,
        "ci95": [
         -6.120943954781632,
         -2.1857923479074923
        ],
        "p": 9.999000099990002e-05,
        "q": 0.011998800119988003,
        "mdd80": 2.8124656013613563,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -7.801418444612153,
         2.500000005692116
        ],
        "p": 0.40375962403759624,
        "q": 0.7863084659276007,
        "mdd80": 7.362457137890039,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.7333333333333333,
        "ci95": [
         -0.9987515621669079,
         2.479338844776141
        ],
        "p": 0.45125487451254875,
        "q": 0.8104483669280131,
        "mdd80": 2.485802481120294,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_r60",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.936026936026936,
        "ci95": [
         -4.210526318158555,
         0.34364261400938795
        ],
        "p": 0.11388861113888611,
        "q": 0.45555444455554445,
        "mdd80": 3.254879289056215,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.6944444444444444,
        "ci95": [
         -1.8429487192818153,
         0.37202381067764223
        ],
        "p": 0.30696930306969306,
        "q": 0.7083906993915993,
        "mdd80": 1.5830480425682247,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.47723935389133626,
        "ci95": [
         -2.1308980230204773,
         1.1799410046109107
        ],
        "p": 0.5972402759724028,
        "q": 0.9539046095390461,
        "mdd80": 2.3662673785152033,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.1235955056179776,
        "ci95": [
         -4.166666672544897,
         6.382978728378476
        ],
        "p": 0.785921407859214,
        "q": 0.9824017598240177,
        "mdd80": 7.539865743629022,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.4,
        "ci95": [
         -1.0796221337472798,
         1.8893387329479965
        ],
        "p": 0.6537346265373463,
        "q": 0.9660310564688213,
        "mdd80": 2.121925949379447,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.25, AIME25 1.58, LCB v6 2.37, Terminal-Bench 2.1 7.54, SWE-bench Verified 2.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_u32",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "lcb"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.936026936026936,
        "ci95": [
         -4.081632655226988,
         0.17921147178226643
        ],
        "p": 0.0902909709029097,
        "q": 0.4167275580134294,
        "mdd80": 3.0452391005832373,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5555555555555556,
        "ci95": [
         -2.6041666697527344,
         1.1111111127873732
        ],
        "p": 0.9781021897810219,
        "q": 1.0,
        "mdd80": 2.655321066828303,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.4596182085168867,
        "ci95": [
         -4.378531075290004,
         -0.5426356568970698
        ],
        "p": 0.0136986301369863,
        "q": 0.17452800174528002,
        "mdd80": 2.741526881913296,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.8726591760299625,
        "ci95": [
         -3.100775198946039,
         6.918238997930776
        ],
        "p": 0.5493450654934506,
        "q": 0.8908298359353253,
        "mdd80": 7.160621903116516,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.0,
        "ci95": [
         -1.6064257044191397,
         1.6064257044191397
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.2962353099327584,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_u64",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": -1.430976430976431,
        "ci95": [
         -3.723404257734998,
         0.8503401383591962
        ],
        "p": 0.25807419258074193,
        "q": 0.6973702629737026,
        "mdd80": 3.268869936539046,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5555555555555556,
        "ci95": [
         -1.6025641037820608,
         0.3787878800745335
        ],
        "p": 0.45865413458654136,
        "q": 0.8104483669280131,
        "mdd80": 1.4160786814544655,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9911894273127754,
        "ci95": [
         -2.76497696038029,
         0.8076358314566734
        ],
        "p": 0.2970702929707029,
        "q": 0.6989889246369481,
        "mdd80": 2.553357935809355,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -5.769230773848513,
         5.000000005972568
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 7.696804125274315,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.1333333333333333,
        "ci95": [
         0.41666666487933524,
         3.840877916705706
        ],
        "p": 0.015298470152984701,
        "q": 0.17452800174528002,
        "mdd80": 2.4472948744168153,
        "verdict": "nominal_gain",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.27, AIME25 1.42, LCB v6 2.55, Terminal-Bench 2.1 7.70, SWE-bench Verified 2.45)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.4208754208754209,
        "ci95": [
         -2.492211839916656,
         1.6501650185256471
        ],
        "p": 0.7567243275672433,
        "q": 0.9660310564688213,
        "mdd80": 2.9605701599635768,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.20833333333333334,
        "ci95": [
         -1.302083334709761,
         0.7161458342089884
        ],
        "p": 0.9757024297570243,
        "q": 1.0,
        "mdd80": 1.4424349250820734,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.40381791483113066,
        "ci95": [
         -2.173913045218721,
         1.3698630155297336
        ],
        "p": 0.6851314868513149,
        "q": 0.9660310564688213,
        "mdd80": 2.5327482306837723,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -5.00000000597988,
         5.769230773828523
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 7.6968041252652535,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.13333333333333333,
        "ci95": [
         -1.3831258660239953,
         1.6326530627550737
        ],
        "p": 0.9333066693330667,
        "q": 1.0,
        "mdd80": 2.1553869700179025,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.96, AIME25 1.44, LCB v6 2.53, Terminal-Bench 2.1 7.70, SWE-bench Verified 2.16)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.08417508417508418,
        "ci95": [
         -3.092783508218898,
         2.9209622023714905
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.298043540895482,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0069444444444444,
        "ci95": [
         -2.022058824430447,
         1.38764648369349e-09
        ],
        "p": 0.0654934506549345,
        "q": 0.388135099533525,
        "mdd80": 1.4451719932742129,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.8076358296622613,
        "ci95": [
         -2.3484848500749402,
         0.7342143921396529
        ],
        "p": 0.3330666933306669,
        "q": 0.7476343274763433,
        "mdd80": 2.2032151348187083,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -2.702702706405925,
         3.418803422269586
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.375060260790925,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.3333333333333333,
        "ci95": [
         -3.4153005485807024,
         0.7604562757529935
        ],
        "p": 0.22907709229077092,
        "q": 0.6793606353650349,
        "mdd80": 2.9844269297205956,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 4.30, AIME25 1.45, LCB v6 2.20, Terminal-Bench 2.1 4.38, SWE-bench Verified 2.98)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_r40",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25",
       "lcb",
       "swe"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5892255892255892,
        "ci95": [
         -3.3333333361819704,
         2.1739130464407377
        ],
        "p": 0.7121287871212879,
        "q": 0.9660310564688213,
        "mdd80": 3.9360468303917933,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.9791666666666667,
        "ci95": [
         -3.7037037065907037,
         -0.40064102380752087
        ],
        "p": 0.011198880111988802,
        "q": 0.16798320167983202,
        "mdd80": 2.360709599660712,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.202643171806167,
        "ci95": [
         -3.6764705898731322,
         -0.7281553381843804
        ],
        "p": 0.0028997100289971,
        "q": 0.11398860113988601,
        "mdd80": 2.107170461452789,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -3.252032523440298,
         2.4390243932985682
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.06741681457906,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -3.4,
        "ci95": [
         -5.5782312947325225,
         -1.2195121929149488
        ],
        "p": 0.0031996800319968005,
        "q": 0.11398860113988601,
        "mdd80": 3.115190662144843,
        "verdict": "nominal_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25, LCB v6, SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_r60",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25",
       "lcb"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.9259259259259259,
        "ci95": [
         -1.8115942058420096,
         3.641456584892866
        ],
        "p": 0.5483451654834517,
        "q": 0.8908298359353253,
        "mdd80": 3.897313065302874,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.7013888888888888,
        "ci95": [
         -3.255208334796846,
         -0.16025640846841827
        ],
        "p": 0.0316968303169683,
        "q": 0.2535746425357464,
        "mdd80": 2.211972167847451,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.6886930983847284,
        "ci95": [
         -3.2163742705208964,
         -0.1488095222500267
        ],
        "p": 0.0372962703729627,
        "q": 0.2797220277972203,
        "mdd80": 2.1923984629689173,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.7490636704119851,
        "ci95": [
         -2.8368794360114213,
         4.38596491654273
        ],
        "p": 0.846015398460154,
        "q": 0.9953122334825341,
        "mdd80": 5.162190257183503,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.3333333333333333,
        "ci95": [
         -2.4577572989127265,
         1.7832647484033277
        ],
        "p": 0.8046195380461953,
        "q": 0.9852484139341168,
        "mdd80": 3.031072196012856,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25, LCB v6)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_u32",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "swe"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5892255892255892,
        "ci95": [
         -3.436426119743687,
         2.2653721710199113
        ],
        "p": 0.7198280171982802,
        "q": 0.9660310564688213,
        "mdd80": 4.07509370939123,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -2.1180555555555554,
        "ci95": [
         -4.51388889188763,
         0.13020833544946375
        ],
        "p": 0.07439256074392561,
        "q": 0.388135099533525,
        "mdd80": 3.319151332936428,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.1747430249632893,
        "ci95": [
         -2.866666668197177,
         0.5185185202259621
        ],
        "p": 0.18388161183881613,
        "q": 0.6304512405902267,
        "mdd80": 2.419402820477546,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.1235955056179776,
        "ci95": [
         -2.2727272761624375,
         4.504504508571047
        ],
        "p": 0.6892310768923108,
        "q": 0.9660310564688213,
        "mdd80": 4.843709511399617,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -2.933333333333333,
        "ci95": [
         -5.078125002090502,
         -0.7936507915280678
        ],
        "p": 0.009599040095990401,
        "q": 0.16455497307412115,
        "mdd80": 3.0621275978483795,
        "verdict": "nominal_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_u64",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.25252525252525254,
        "ci95": [
         -2.9051987796134364,
         3.431372552101646
        ],
        "p": 0.9202079792020798,
        "q": 1.0,
        "mdd80": 4.528768058107293,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.9791666666666667,
        "ci95": [
         -3.7660256430924752,
         -0.37202380779814537
        ],
        "p": 0.008799120087991202,
        "q": 0.16455497307412115,
        "mdd80": 2.4257041065579243,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.3215859030837005,
        "ci95": [
         -2.86123033054014,
         0.22222222378048379
        ],
        "p": 0.10428957104289571,
        "q": 0.4315430525912926,
        "mdd80": 2.203753529421244,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.1235955056179776,
        "ci95": [
         -2.127659577535356,
         4.2735042770987794
        ],
        "p": 0.6602339766023397,
        "q": 0.9660310564688213,
        "mdd80": 4.5749325434850965,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.2,
        "ci95": [
         -3.234880452214635,
         0.823045269567654
        ],
        "p": 0.27347265273472654,
        "q": 0.6973702629737026,
        "mdd80": 2.900212659013105,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.5892255892255892,
        "ci95": [
         -2.0408163291837385,
         3.256704983873239
        ],
        "p": 0.7091290870912909,
        "q": 0.9660310564688213,
        "mdd80": 3.786155643768548,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.4236111111111112,
        "ci95": [
         -2.976190477861885,
         0.07440476351548425
        ],
        "p": 0.0710928907109289,
        "q": 0.388135099533525,
        "mdd80": 2.1802703014193945,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.6607929515418502,
        "ci95": [
         -2.1969696985522846,
         0.8807588090087517
        ],
        "p": 0.42605739426057393,
        "q": 0.7988576142385762,
        "mdd80": 2.1996625346591103,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.7490636704119851,
        "ci95": [
         -2.500000003606824,
         4.065040653999821
        ],
        "p": 0.831016898310169,
        "q": 0.9929304099293041,
        "mdd80": 4.6920558254486515,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.7333333333333333,
        "ci95": [
         -2.8314028334197228,
         1.3440860235961183
        ],
        "p": 0.5382461753824618,
        "q": 0.8908298359353253,
        "mdd80": 2.984235412610444,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.79, AIME25 2.18, LCB v6 2.20, Terminal-Bench 2.1 4.69, SWE-bench Verified 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.8417508417508418,
        "ci95": [
         -1.6025641048917512,
         3.2710280396300786
        ],
        "p": 0.547945205479452,
        "q": 0.8908298359353253,
        "mdd80": 3.4831720936974215,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.4513888888888889,
        "ci95": [
         -1.370614035820354,
         0.4861111120594268
        ],
        "p": 0.37366263373662634,
        "q": 0.7863084659276007,
        "mdd80": 1.3270074780530505,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.3303964757709251,
        "ci95": [
         -1.1013215873301392,
         1.7584097874165239
        ],
        "p": 0.6807319268073193,
        "q": 0.9660310564688213,
        "mdd80": 2.0438592776347013,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.1235955056179776,
        "ci95": [
         -5.426356593588616,
         3.1007751981622143
        ],
        "p": 0.7279272072792721,
        "q": 0.9660310564688213,
        "mdd80": 6.094368715218112,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.4,
        "ci95": [
         -2.487562190997946,
         1.6806722710882718
        ],
        "p": 0.7499250074992501,
        "q": 0.9660310564688213,
        "mdd80": 2.9790506730536213,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.48, AIME25 1.33, LCB v6 2.04, Terminal-Bench 2.1 6.09, SWE-bench Verified 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_r40",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.6734006734006734,
        "ci95": [
         -3.065134102332263,
         1.7133956408342446
        ],
        "p": 0.6266373362663734,
        "q": 0.9660310564688213,
        "mdd80": 3.4152306874940086,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -2.1180555555555554,
        "ci95": [
         -3.794642858946587,
         -0.4629629601870553
        ],
        "p": 0.0071992800719928,
        "q": 0.16455497307412115,
        "mdd80": 2.3811624166245147,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.3582966226138031,
        "ci95": [
         -2.812939523192113,
         0.07680491701523856
        ],
        "p": 0.07439256074392561,
        "q": 0.388135099533525,
        "mdd80": 2.065309712746817,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -7.751937989805705,
         2.515723274747911
        ],
        "p": 0.39966003399660033,
        "q": 0.7863084659276007,
        "mdd80": 7.338330767877604,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.3333333333333333,
        "ci95": [
         -2.3809523827747956,
         1.7060367474141656
        ],
        "p": 0.7998200179982001,
        "q": 0.9852484139341168,
        "mdd80": 2.9209843711523003,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_r60",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "gpqa"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -3.1986531986531985,
        "ci95": [
         -5.817610065335667,
         -0.5847953193747496
        ],
        "p": 0.0192980701929807,
        "q": 0.192980701929807,
        "mdd80": 3.7399096506479914,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5208333333333334,
        "ci95": [
         -1.666666667820985,
         0.6250000008628362
        ],
        "p": 0.42085791420857915,
        "q": 0.7988576142385762,
        "mdd80": 1.637861591965283,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.57856093979442,
        "ci95": [
         -3.1345565765433143,
         1.4969508114852375e-09
        ],
        "p": 0.051394860513948606,
        "q": 0.34263240342632406,
        "mdd80": 2.2402777407252183,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -6.6666666726537915,
         1.5503876012205826
        ],
        "p": 0.28877112288771123,
        "q": 0.6973702629737026,
        "mdd80": 5.8727553086953135,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8,
        "ci95": [
         -1.2244897979783236,
         2.8225806471940436
        ],
        "p": 0.48365163483651635,
        "q": 0.8370020140843059,
        "mdd80": 2.8924543576543122,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (GPQA)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_u32",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5050505050505051,
        "ci95": [
         -3.048780490876939,
         2.0202020227201496
        ],
        "p": 0.7452254774522548,
        "q": 0.9660310564688213,
        "mdd80": 3.622818223442847,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0763888888888888,
        "ci95": [
         -2.604166668589098,
         0.383771930981288
        ],
        "p": 0.22477752224777522,
        "q": 0.6793606353650349,
        "mdd80": 2.1354893965436763,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.2114537444933922,
        "ci95": [
         -2.5073746325649204,
         0.07645260072488483
        ],
        "p": 0.0740925907409259,
        "q": 0.388135099533525,
        "mdd80": 1.8466696939436835,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.8726591760299625,
        "ci95": [
         -7.407407412870204,
         3.703703710591009
        ],
        "p": 0.6041395860413958,
        "q": 0.9539046095390461,
        "mdd80": 7.941147114395706,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.7333333333333334,
        "ci95": [
         -3.746770027790037,
         0.27322404576521475
        ],
        "p": 0.10038996100389962,
        "q": 0.4302426900167126,
        "mdd80": 2.8731027871456214,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.62, AIME25 2.14, LCB v6 1.85, Terminal-Bench 2.1 7.94, SWE-bench Verified 2.87)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_u64",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 1.3468013468013469,
        "ci95": [
         -1.2820512845550498,
         3.977272730223814
        ],
        "p": 0.34266573342665735,
        "q": 0.7476343274763433,
        "mdd80": 3.758855910948986,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0069444444444444,
        "ci95": [
         -2.4088541679907425,
         0.37202381100853765
        ],
        "p": 0.1927807219278072,
        "q": 0.6426024064260241,
        "mdd80": 1.9875025002483753,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.697503671071953,
        "ci95": [
         -2.2058823546135056,
         0.811209441040659
        ],
        "p": 0.3935606439356064,
        "q": 0.7863084659276007,
        "mdd80": 2.156325280226567,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -3.9682539728422697,
         4.761904766540168
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 6.239472732396465,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.4,
        "ci95": [
         -1.5686274529077981,
         2.3529411783798437
        ],
        "p": 0.7424257574242575,
        "q": 0.9660310564688213,
        "mdd80": 2.8027578047076207,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.76, AIME25 1.99, LCB v6 2.16, Terminal-Bench 2.1 6.24, SWE-bench Verified 2.80)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.0101010101010102,
        "ci95": [
         -3.6458333360513526,
         1.6304347854485504
        ],
        "p": 0.48825117488251174,
        "q": 0.8370020140843059,
        "mdd80": 3.7709659189129674,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.3125,
        "ci95": [
         -0.6944444457129928,
         1.3888888902473728
        ],
        "p": 0.667033296670333,
        "q": 0.9660310564688213,
        "mdd80": 1.488965084171745,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9177679882525698,
        "ci95": [
         -2.3364485996334152,
         0.5028735646035918
        ],
        "p": 0.22317768223177684,
        "q": 0.6793606353650349,
        "mdd80": 2.029272748767788,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -3.745318352059925,
        "ci95": [
         -8.527131787884624,
         0.925925931699995
        ],
        "p": 0.16948305169483052,
        "q": 0.59817547656999,
        "mdd80": 6.756130975379088,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.0666666666666667,
        "ci95": [
         -1.010101012063798,
         3.12109862863989
        ],
        "p": 0.34096590340965904,
        "q": 0.7476343274763433,
        "mdd80": 2.9525817662371785,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.77, AIME25 1.49, LCB v6 2.03, Terminal-Bench 2.1 6.76, SWE-bench Verified 2.95)"
     }
    ],
    "arm_status_prev": [
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "tb"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.5050505050505051,
        "ci95": [
         -1.1904761921897844,
         2.197802199642796
        ],
        "p": 0.6404359564043596,
        "q": 0.9870317316094478,
        "mdd80": 2.42161354297471,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3125,
        "ci95": [
         -1.0416666673593737,
         0.3720238102669623
        ],
        "p": 0.45925407459254075,
        "q": 0.8350074083500741,
        "mdd80": 1.0103691640115613,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.03671071953010279,
        "ci95": [
         -1.5082956274508423,
         1.4354067001603958
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.1038735896710166,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 5.617977528089888,
        "ci95": [
         0.7246376764328935,
         10.60606061109768
        ],
        "p": 0.040495950404959506,
        "q": 0.3037196280371963,
        "mdd80": 7.062284982286519,
        "verdict": "nominal_gain",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.3351206434316354,
        "ci95": [
         -1.466666668454037,
         2.1333333351161525
        ],
        "p": 0.7722227777222278,
        "q": 1.0,
        "mdd80": 2.5729316647559974,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.42, AIME25 1.01, LCB v6 2.10, Terminal-Bench 2.1 7.06, SWE-bench Verified 2.57)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_r40",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.0101010101010102,
        "ci95": [
         -2.6234567916032487,
         0.5747126454791296
        ],
        "p": 0.2695730426957304,
        "q": 0.7418832584826623,
        "mdd80": 2.2857420571565505,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.10416666666666667,
        "ci95": [
         -0.757575758480093,
         0.5608974366756316
        ],
        "p": 0.8357164283571643,
        "q": 1.0,
        "mdd80": 0.942317063773313,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.03671071953010279,
        "ci95": [
         -1.590909092512186,
         1.521438452362733
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.2244048727757555,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -5.555555560343386,
         4.761904767329096
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 7.373922319612783,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.9395973154362416,
        "ci95": [
         -2.380952382452482,
         0.524246397235131
        ],
        "p": 0.23777622237776222,
        "q": 0.7048525916639106,
        "mdd80": 2.076354979237711,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.29, AIME25 0.94, LCB v6 2.22, Terminal-Bench 2.1 7.37, SWE-bench Verified 2.08)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_r60",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.16835016835016836,
        "ci95": [
         -1.8691588800729706,
         1.5463917543221708
        ],
        "p": 0.928007199280072,
        "q": 1.0,
        "mdd80": 2.441105103082635,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.10416666666666667,
        "ci95": [
         -0.7211538468785339,
         0.5208333340134119
        ],
        "p": 0.8253174682531746,
        "q": 1.0,
        "mdd80": 0.8876522616024543,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 1.2114537444933922,
        "ci95": [
         -0.4291845509540222,
         2.841781875738925
        ],
        "p": 0.15998400159984003,
        "q": 0.6192929094187356,
        "mdd80": 2.3377703014571605,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 4.119850187265918,
        "ci95": [
         -1.6260162663917588,
         9.848484854262008
        ],
        "p": 0.20467953204679531,
        "q": 0.7017583955890125,
        "mdd80": 8.20086312259156,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.0046885465505693,
        "ci95": [
         -0.5369127532161896,
         2.5469168916221783
        ],
        "p": 0.23467653234676533,
        "q": 0.7983646079836461,
        "mdd80": 2.2040230372358605,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.44, AIME25 0.89, LCB v6 2.34, Terminal-Bench 2.1 8.20, SWE-bench Verified 2.20)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_u32",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "lcb"
      ],
      "cells": {
       "gpqa": {
        "delta": 1.0101010101010102,
        "ci95": [
         -0.6535947728548801,
         2.672955976391838
        ],
        "p": 0.2706729327067293,
        "q": 0.7418832584826623,
        "mdd80": 2.377496596851821,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.034722222222222224,
        "ci95": [
         -0.6127450986191485,
         0.7161458339807993
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 0.9497626544729725,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 2.23935389133627,
        "ci95": [
         0.7610350060829625,
         3.720930234122269
        ],
        "p": 0.0037996200379962005,
        "q": 0.11398860113988601,
        "mdd80": 2.115446708063878,
        "verdict": "nominal_gain",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -2.898550730324115,
         8.888888894717901
        ],
        "p": 0.38836116388361164,
        "q": 0.8125187481251874,
        "mdd80": 8.424521285442507,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.4682274247491639,
        "ci95": [
         -1.2517385275172357,
         2.1802325599957433
        ],
        "p": 0.6414358564143585,
        "q": 1.0,
        "mdd80": 2.4528408541200313,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.38, AIME25 0.95, LCB v6 2.12, Terminal-Bench 2.1 8.42, SWE-bench Verified 2.45)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_u64",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "lcb"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.8417508417508418,
        "ci95": [
         -0.5376344100709577,
         2.2435897449255426
        ],
        "p": 0.29057094290570945,
        "q": 0.7418832584826623,
        "mdd80": 1.9877499133550263,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.7291666666666666,
        "ci95": [
         -1.5625000010551773,
         0.0744047627750796
        ],
        "p": 0.0988901109889011,
        "q": 0.4633382815564598,
        "mdd80": 1.1699011374644548,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 1.8722466960352422,
        "ci95": [
         0.22831050058120367,
         3.516819573572846
        ],
        "p": 0.027197280271972803,
        "q": 0.25105181789513353,
        "mdd80": 2.350308087596262,
        "verdict": "nominal_gain",
        "source": "published"
       },
       "tb": {
        "delta": 1.4981273408239701,
        "ci95": [
         -4.385964919170994,
         7.31707317703928
        ],
        "p": 0.7078292170782922,
        "q": 0.9870317316094478,
        "mdd80": 8.364199239367608,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.4046822742474916,
        "ci95": [
         -0.13623978358321787,
         2.9247910879299166
        ],
        "p": 0.0857914208579142,
        "q": 0.9009533829225773,
        "mdd80": 2.187728680083662,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 1.99, AIME25 1.17, LCB v6 2.35, Terminal-Bench 2.1 8.36, SWE-bench Verified 2.19)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.6734006734006734,
        "ci95": [
         -0.5208333345658365,
         1.8707483005297956
        ],
        "p": 0.3565643435656434,
        "q": 0.7983646079836461,
        "mdd80": 1.709271142134459,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.4513888888888889,
        "ci95": [
         -0.9803921573385052,
         0.08680555624211392
        ],
        "p": 0.1394860513948605,
        "q": 0.5771836609442503,
        "mdd80": 0.7627296630843574,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.697503671071953,
        "ci95": [
         -0.8733624469712797,
         2.2727272743523796
        ],
        "p": 0.4062593740625937,
        "q": 0.8125187481251874,
        "mdd80": 2.248520515591492,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 4.49438202247191,
        "ci95": [
         -1.360544222993025,
         10.144927541679484
        ],
        "p": 0.15278472152784722,
        "q": 0.6111388861113889,
        "mdd80": 8.222997942201195,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.8729096989966556,
        "ci95": [
         0.27285129441414835,
         3.4578146627731394
        ],
        "p": 0.025897410258974102,
        "q": 1.0,
        "mdd80": 2.27630363705887,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 1.71, AIME25 0.76, LCB v6 2.25, Terminal-Bench 2.1 8.22, SWE-bench Verified 2.28)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": -1.2626262626262625,
        "ci95": [
         -3.4364261190492718,
         0.8771929846796456
        ],
        "p": 0.28857114288571145,
        "q": 0.7418832584826623,
        "mdd80": 3.0829575474093813,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.3472222222222222,
        "ci95": [
         -0.20833333418188565,
         0.8928571434519276
        ],
        "p": 0.27217278272172785,
        "q": 0.7418832584826623,
        "mdd80": 0.7870244016727758,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.697503671071953,
        "ci95": [
         -0.9715994037916746,
         2.3504273520303065
        ],
        "p": 0.4370562943705629,
        "q": 0.8324881797534532,
        "mdd80": 2.3742632840956794,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.7490636704119851,
        "ci95": [
         -5.691056915933228,
         4.166666672119435
        ],
        "p": 0.8824117588241176,
        "q": 1.0,
        "mdd80": 7.045346982488772,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.066666666666667,
        "ci95": [
         0.4201680654991957,
         3.6885245918197507
        ],
        "p": 0.015998400159984,
        "q": 0.17452800174528002,
        "mdd80": 2.3359049972062365,
        "verdict": "nominal_gain",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.08, AIME25 0.79, LCB v6 2.37, Terminal-Bench 2.1 7.05, SWE-bench Verified 2.34)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_r40",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.25252525252525254,
        "ci95": [
         -2.356902359002289,
         1.83486238721258
        ],
        "p": 0.8777122287771223,
        "q": 1.0,
        "mdd80": 2.995867843346752,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.3194444444444444,
        "ci95": [
         -2.9356060628217393,
         0.069444445839632
        ],
        "p": 0.0866913308669133,
        "q": 0.45145485451454853,
        "mdd80": 2.147719333405054,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -4.148311306901615,
        "ci95": [
         -6.120943954781632,
         -2.1857923479074923
        ],
        "p": 9.999000099990002e-05,
        "q": 0.011998800119988003,
        "mdd80": 2.8124656013613563,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -7.801418444612153,
         2.500000005692116
        ],
        "p": 0.40375962403759624,
        "q": 0.8125187481251874,
        "mdd80": 7.362457137890039,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.7333333333333333,
        "ci95": [
         -0.9987515621669079,
         2.479338844776141
        ],
        "p": 0.45125487451254875,
        "q": 0.8350074083500741,
        "mdd80": 2.485802481120294,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_r60",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.936026936026936,
        "ci95": [
         -4.210526318158555,
         0.34364261400938795
        ],
        "p": 0.11388861113888611,
        "q": 0.48809404773808335,
        "mdd80": 3.254879289056215,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.6944444444444444,
        "ci95": [
         -1.8429487192818153,
         0.37202381067764223
        ],
        "p": 0.30696930306969306,
        "q": 0.7517615585380237,
        "mdd80": 1.5830480425682247,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.47723935389133626,
        "ci95": [
         -2.1308980230204773,
         1.1799410046109107
        ],
        "p": 0.5972402759724028,
        "q": 0.9666233376662334,
        "mdd80": 2.3662673785152033,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.1235955056179776,
        "ci95": [
         -4.166666672544897,
         6.382978728378476
        ],
        "p": 0.785921407859214,
        "q": 1.0,
        "mdd80": 7.539865743629022,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.4,
        "ci95": [
         -1.0796221337472798,
         1.8893387329479965
        ],
        "p": 0.6537346265373463,
        "q": 0.9870317316094478,
        "mdd80": 2.121925949379447,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.25, AIME25 1.58, LCB v6 2.37, Terminal-Bench 2.1 7.54, SWE-bench Verified 2.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_u32",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "lcb"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.936026936026936,
        "ci95": [
         -4.081632655226988,
         0.17921147178226643
        ],
        "p": 0.0902909709029097,
        "q": 0.45145485451454853,
        "mdd80": 3.0452391005832373,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5555555555555556,
        "ci95": [
         -2.6041666697527344,
         1.1111111127873732
        ],
        "p": 0.9781021897810219,
        "q": 1.0,
        "mdd80": 2.655321066828303,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.4596182085168867,
        "ci95": [
         -4.378531075290004,
         -0.5426356568970698
        ],
        "p": 0.0136986301369863,
        "q": 0.17452800174528002,
        "mdd80": 2.741526881913296,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.8726591760299625,
        "ci95": [
         -3.100775198946039,
         6.918238997930776
        ],
        "p": 0.5493450654934506,
        "q": 0.9030329843727954,
        "mdd80": 7.160621903116516,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.0,
        "ci95": [
         -1.6064257044191397,
         1.6064257044191397
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.2962353099327584,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_u64",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": -1.430976430976431,
        "ci95": [
         -3.723404257734998,
         0.8503401383591962
        ],
        "p": 0.25807419258074193,
        "q": 0.7418832584826623,
        "mdd80": 3.268869936539046,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5555555555555556,
        "ci95": [
         -1.6025641037820608,
         0.3787878800745335
        ],
        "p": 0.45865413458654136,
        "q": 0.8350074083500741,
        "mdd80": 1.4160786814544655,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9911894273127754,
        "ci95": [
         -2.76497696038029,
         0.8076358314566734
        ],
        "p": 0.2970702929707029,
        "q": 0.7426757324267573,
        "mdd80": 2.553357935809355,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -5.769230773848513,
         5.000000005972568
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 7.696804125274315,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.1333333333333333,
        "ci95": [
         0.41666666487933524,
         3.840877916705706
        ],
        "p": 0.015298470152984701,
        "q": 0.17452800174528002,
        "mdd80": 2.4472948744168153,
        "verdict": "nominal_gain",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.27, AIME25 1.42, LCB v6 2.55, Terminal-Bench 2.1 7.70, SWE-bench Verified 2.45)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.4208754208754209,
        "ci95": [
         -2.492211839916656,
         1.6501650185256471
        ],
        "p": 0.7567243275672433,
        "q": 0.9870317316094478,
        "mdd80": 2.9605701599635768,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.20833333333333334,
        "ci95": [
         -1.302083334709761,
         0.7161458342089884
        ],
        "p": 0.9757024297570243,
        "q": 1.0,
        "mdd80": 1.4424349250820734,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.40381791483113066,
        "ci95": [
         -2.173913045218721,
         1.3698630155297336
        ],
        "p": 0.6851314868513149,
        "q": 0.9870317316094478,
        "mdd80": 2.5327482306837723,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -5.00000000597988,
         5.769230773828523
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 7.6968041252652535,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.13333333333333333,
        "ci95": [
         -1.3831258660239953,
         1.6326530627550737
        ],
        "p": 0.9333066693330667,
        "q": 1.0,
        "mdd80": 2.1553869700179025,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.96, AIME25 1.44, LCB v6 2.53, Terminal-Bench 2.1 7.70, SWE-bench Verified 2.16)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.08417508417508418,
        "ci95": [
         -3.092783508218898,
         2.9209622023714905
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.298043540895482,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0069444444444444,
        "ci95": [
         -2.022058824430447,
         1.38764648369349e-09
        ],
        "p": 0.0654934506549345,
        "q": 0.4057776040577761,
        "mdd80": 1.4451719932742129,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.8076358296622613,
        "ci95": [
         -2.3484848500749402,
         0.7342143921396529
        ],
        "p": 0.3330666933306669,
        "q": 0.7907670771384401,
        "mdd80": 2.2032151348187083,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -2.702702706405925,
         3.418803422269586
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.375060260790925,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.3333333333333333,
        "ci95": [
         -3.4153005485807024,
         0.7604562757529935
        ],
        "p": 0.22907709229077092,
        "q": 0.7048525916639106,
        "mdd80": 2.9844269297205956,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 4.30, AIME25 1.45, LCB v6 2.20, Terminal-Bench 2.1 4.38, SWE-bench Verified 2.98)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_r40",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25",
       "lcb",
       "swe"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5892255892255892,
        "ci95": [
         -3.3333333361819704,
         2.1739130464407377
        ],
        "p": 0.7121287871212879,
        "q": 0.9870317316094478,
        "mdd80": 3.9360468303917933,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.9791666666666667,
        "ci95": [
         -3.7037037065907037,
         -0.40064102380752087
        ],
        "p": 0.011198880111988802,
        "q": 0.16798320167983202,
        "mdd80": 2.360709599660712,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.202643171806167,
        "ci95": [
         -3.6764705898731322,
         -0.7281553381843804
        ],
        "p": 0.0028997100289971,
        "q": 0.11398860113988601,
        "mdd80": 2.107170461452789,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -3.252032523440298,
         2.4390243932985682
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.06741681457906,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -3.4,
        "ci95": [
         -5.5782312947325225,
         -1.2195121929149488
        ],
        "p": 0.0031996800319968005,
        "q": 0.11398860113988601,
        "mdd80": 3.115190662144843,
        "verdict": "nominal_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25, LCB v6, SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_r60",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25",
       "lcb"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.9259259259259259,
        "ci95": [
         -1.8115942058420096,
         3.641456584892866
        ],
        "p": 0.5483451654834517,
        "q": 0.9030329843727954,
        "mdd80": 3.897313065302874,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.7013888888888888,
        "ci95": [
         -3.255208334796846,
         -0.16025640846841827
        ],
        "p": 0.0316968303169683,
        "q": 0.27168711700258547,
        "mdd80": 2.211972167847451,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.6886930983847284,
        "ci95": [
         -3.2163742705208964,
         -0.1488095222500267
        ],
        "p": 0.0372962703729627,
        "q": 0.2983701629837016,
        "mdd80": 2.1923984629689173,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.7490636704119851,
        "ci95": [
         -2.8368794360114213,
         4.38596491654273
        ],
        "p": 0.846015398460154,
        "q": 1.0,
        "mdd80": 5.162190257183503,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.3333333333333333,
        "ci95": [
         -2.4577572989127265,
         1.7832647484033277
        ],
        "p": 0.8046195380461953,
        "q": 1.0,
        "mdd80": 3.031072196012856,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25, LCB v6)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_u32",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "swe"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5892255892255892,
        "ci95": [
         -3.436426119743687,
         2.2653721710199113
        ],
        "p": 0.7198280171982802,
        "q": 0.9870317316094478,
        "mdd80": 4.07509370939123,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -2.1180555555555554,
        "ci95": [
         -4.51388889188763,
         0.13020833544946375
        ],
        "p": 0.07439256074392561,
        "q": 0.4057776040577761,
        "mdd80": 3.319151332936428,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.1747430249632893,
        "ci95": [
         -2.866666668197177,
         0.5185185202259621
        ],
        "p": 0.18388161183881613,
        "q": 0.6686604066866041,
        "mdd80": 2.419402820477546,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.1235955056179776,
        "ci95": [
         -2.2727272761624375,
         4.504504508571047
        ],
        "p": 0.6892310768923108,
        "q": 0.9870317316094478,
        "mdd80": 4.843709511399617,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -2.933333333333333,
        "ci95": [
         -5.078125002090502,
         -0.7936507915280678
        ],
        "p": 0.009599040095990401,
        "q": 0.16455497307412115,
        "mdd80": 3.0621275978483795,
        "verdict": "nominal_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_u64",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.25252525252525254,
        "ci95": [
         -2.9051987796134364,
         3.431372552101646
        ],
        "p": 0.9202079792020798,
        "q": 1.0,
        "mdd80": 4.528768058107293,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.9791666666666667,
        "ci95": [
         -3.7660256430924752,
         -0.37202380779814537
        ],
        "p": 0.008799120087991202,
        "q": 0.16455497307412115,
        "mdd80": 2.4257041065579243,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.3215859030837005,
        "ci95": [
         -2.86123033054014,
         0.22222222378048379
        ],
        "p": 0.10428957104289571,
        "q": 0.46350920463509204,
        "mdd80": 2.203753529421244,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.1235955056179776,
        "ci95": [
         -2.127659577535356,
         4.2735042770987794
        ],
        "p": 0.6602339766023397,
        "q": 0.9870317316094478,
        "mdd80": 4.5749325434850965,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.2,
        "ci95": [
         -3.234880452214635,
         0.823045269567654
        ],
        "p": 0.27347265273472654,
        "q": 0.7418832584826623,
        "mdd80": 2.900212659013105,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.5892255892255892,
        "ci95": [
         -2.0408163291837385,
         3.256704983873239
        ],
        "p": 0.7091290870912909,
        "q": 0.9870317316094478,
        "mdd80": 3.786155643768548,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.4236111111111112,
        "ci95": [
         -2.976190477861885,
         0.07440476351548425
        ],
        "p": 0.0710928907109289,
        "q": 0.4057776040577761,
        "mdd80": 2.1802703014193945,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.6607929515418502,
        "ci95": [
         -2.1969696985522846,
         0.8807588090087517
        ],
        "p": 0.42605739426057393,
        "q": 0.824627214697885,
        "mdd80": 2.1996625346591103,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.7490636704119851,
        "ci95": [
         -2.500000003606824,
         4.065040653999821
        ],
        "p": 0.831016898310169,
        "q": 1.0,
        "mdd80": 4.6920558254486515,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.7333333333333333,
        "ci95": [
         -2.8314028334197228,
         1.3440860235961183
        ],
        "p": 0.5382461753824618,
        "q": 0.9030329843727954,
        "mdd80": 2.984235412610444,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.79, AIME25 2.18, LCB v6 2.20, Terminal-Bench 2.1 4.69, SWE-bench Verified 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_dense",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.8417508417508418,
        "ci95": [
         -1.6025641048917512,
         3.2710280396300786
        ],
        "p": 0.547945205479452,
        "q": 0.9030329843727954,
        "mdd80": 3.4831720936974215,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.4513888888888889,
        "ci95": [
         -1.370614035820354,
         0.4861111120594268
        ],
        "p": 0.37366263373662634,
        "q": 0.8125187481251874,
        "mdd80": 1.3270074780530505,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.3303964757709251,
        "ci95": [
         -1.1013215873301392,
         1.7584097874165239
        ],
        "p": 0.6807319268073193,
        "q": 0.9870317316094478,
        "mdd80": 2.0438592776347013,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.1235955056179776,
        "ci95": [
         -5.426356593588616,
         3.1007751981622143
        ],
        "p": 0.7279272072792721,
        "q": 0.9870317316094478,
        "mdd80": 6.094368715218112,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.4,
        "ci95": [
         -2.487562190997946,
         1.6806722710882718
        ],
        "p": 0.7499250074992501,
        "q": 0.9870317316094478,
        "mdd80": 2.9790506730536213,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.48, AIME25 1.33, LCB v6 2.04, Terminal-Bench 2.1 6.09, SWE-bench Verified 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_r40",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.6734006734006734,
        "ci95": [
         -3.065134102332263,
         1.7133956408342446
        ],
        "p": 0.6266373362663734,
        "q": 0.9870317316094478,
        "mdd80": 3.4152306874940086,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -2.1180555555555554,
        "ci95": [
         -3.794642858946587,
         -0.4629629601870553
        ],
        "p": 0.0071992800719928,
        "q": 0.16455497307412115,
        "mdd80": 2.3811624166245147,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.3582966226138031,
        "ci95": [
         -2.812939523192113,
         0.07680491701523856
        ],
        "p": 0.07439256074392561,
        "q": 0.4057776040577761,
        "mdd80": 2.065309712746817,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -7.751937989805705,
         2.515723274747911
        ],
        "p": 0.39966003399660033,
        "q": 0.8125187481251874,
        "mdd80": 7.338330767877604,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.3333333333333333,
        "ci95": [
         -2.3809523827747956,
         1.7060367474141656
        ],
        "p": 0.7998200179982001,
        "q": 1.0,
        "mdd80": 2.9209843711523003,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_r60",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "gpqa"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -3.1986531986531985,
        "ci95": [
         -5.817610065335667,
         -0.5847953193747496
        ],
        "p": 0.0192980701929807,
        "q": 0.192980701929807,
        "mdd80": 3.7399096506479914,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5208333333333334,
        "ci95": [
         -1.666666667820985,
         0.6250000008628362
        ],
        "p": 0.42085791420857915,
        "q": 0.824627214697885,
        "mdd80": 1.637861591965283,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.57856093979442,
        "ci95": [
         -3.1345565765433143,
         1.4969508114852375e-09
        ],
        "p": 0.051394860513948606,
        "q": 0.36278725068669604,
        "mdd80": 2.2402777407252183,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -6.6666666726537915,
         1.5503876012205826
        ],
        "p": 0.28877112288771123,
        "q": 0.7418832584826623,
        "mdd80": 5.8727553086953135,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8,
        "ci95": [
         -1.2244897979783236,
         2.8225806471940436
        ],
        "p": 0.48365163483651635,
        "q": 0.8616197203809031,
        "mdd80": 2.8924543576543122,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (GPQA)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_u32",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5050505050505051,
        "ci95": [
         -3.048780490876939,
         2.0202020227201496
        ],
        "p": 0.7452254774522548,
        "q": 0.9870317316094478,
        "mdd80": 3.622818223442847,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0763888888888888,
        "ci95": [
         -2.604166668589098,
         0.383771930981288
        ],
        "p": 0.22477752224777522,
        "q": 0.7048525916639106,
        "mdd80": 2.1354893965436763,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.2114537444933922,
        "ci95": [
         -2.5073746325649204,
         0.07645260072488483
        ],
        "p": 0.0740925907409259,
        "q": 0.4057776040577761,
        "mdd80": 1.8466696939436835,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.8726591760299625,
        "ci95": [
         -7.407407412870204,
         3.703703710591009
        ],
        "p": 0.6041395860413958,
        "q": 0.9666233376662334,
        "mdd80": 7.941147114395706,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.7333333333333334,
        "ci95": [
         -3.746770027790037,
         0.27322404576521475
        ],
        "p": 0.10038996100389962,
        "q": 0.4633382815564598,
        "mdd80": 2.8731027871456214,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.62, AIME25 2.14, LCB v6 1.85, Terminal-Bench 2.1 7.94, SWE-bench Verified 2.87)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_u64",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 1.3468013468013469,
        "ci95": [
         -1.2820512845550498,
         3.977272730223814
        ],
        "p": 0.34266573342665735,
        "q": 0.7907670771384401,
        "mdd80": 3.758855910948986,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0069444444444444,
        "ci95": [
         -2.4088541679907425,
         0.37202381100853765
        ],
        "p": 0.1927807219278072,
        "q": 0.680402547980496,
        "mdd80": 1.9875025002483753,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.697503671071953,
        "ci95": [
         -2.2058823546135056,
         0.811209441040659
        ],
        "p": 0.3935606439356064,
        "q": 0.8125187481251874,
        "mdd80": 2.156325280226567,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -3.9682539728422697,
         4.761904766540168
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 6.239472732396465,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.4,
        "ci95": [
         -1.5686274529077981,
         2.3529411783798437
        ],
        "p": 0.7424257574242575,
        "q": 0.9870317316094478,
        "mdd80": 2.8027578047076207,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.76, AIME25 1.99, LCB v6 2.16, Terminal-Bench 2.1 6.24, SWE-bench Verified 2.80)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "jqs_f_u128",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.0101010101010102,
        "ci95": [
         -3.6458333360513526,
         1.6304347854485504
        ],
        "p": 0.48825117488251174,
        "q": 0.8616197203809031,
        "mdd80": 3.7709659189129674,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.3125,
        "ci95": [
         -0.6944444457129928,
         1.3888888902473728
        ],
        "p": 0.667033296670333,
        "q": 0.9870317316094478,
        "mdd80": 1.488965084171745,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9177679882525698,
        "ci95": [
         -2.3364485996334152,
         0.5028735646035918
        ],
        "p": 0.22317768223177684,
        "q": 0.7048525916639106,
        "mdd80": 2.029272748767788,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -3.745318352059925,
        "ci95": [
         -8.527131787884624,
         0.925925931699995
        ],
        "p": 0.16948305169483052,
        "q": 0.6355614438556144,
        "mdd80": 6.756130975379088,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.0666666666666667,
        "ci95": [
         -1.010101012063798,
         3.12109862863989
        ],
        "p": 0.34096590340965904,
        "q": 0.7907670771384401,
        "mdd80": 2.9525817662371785,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.77, AIME25 1.49, LCB v6 2.03, Terminal-Bench 2.1 6.76, SWE-bench Verified 2.95)"
     }
    ],
    "arm_status_changes": [],
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.0,
        "ci95": [
         -1.8957345992293604,
         1.875901877774111
        ],
        "p": 1.0,
        "n_items": 1384,
        "mean_a": 87.35549132947978,
        "mean_b": 87.35549132947978,
        "per_seed": {
         "42": -0.6535947712418301,
         "43": 0.0,
         "44": 0.6507592190889371
        },
        "p_het": 0.8033196680331967,
        "mdd80": 2.6956008083353282,
        "shift_vs_primary": -0.3351206434316354,
        "q_sub": 1.0,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r40_sxs|dense_sxs": {
        "status": "complete",
        "delta": -1.2301013024602026,
        "ci95": [
         -2.758620691106758,
         0.29282577020875505
        ],
        "p": 0.1381861813818618,
        "n_items": 1382,
        "mean_a": 86.03473227206946,
        "mean_b": 87.26483357452966,
        "per_seed": {
         "42": 0.8733624454148472,
         "43": -2.591792656587473,
         "44": -1.9522776572668112
        },
        "p_het": 0.25307469253074694,
        "mdd80": 2.180878671066714,
        "shift_vs_primary": -0.29050398702396096,
        "q_sub": 0.53994600539946,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r60_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.8664259927797834,
        "ci95": [
         -0.7246376827509688,
         2.4673439783816735
        ],
        "p": 0.3301669833016698,
        "n_items": 1385,
        "mean_a": 88.15884476534296,
        "mean_b": 87.29241877256318,
        "per_seed": {
         "42": 1.7429193899782136,
         "43": 0.8620689655172413,
         "44": 0.0
        },
        "p_het": 0.6933306669333067,
        "mdd80": 2.2813196336399666,
        "shift_vs_primary": -0.1382625537707859,
        "q_sub": 0.7476343274763433,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u32_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.14419610670511895,
        "ci95": [
         -1.6348773858774384,
         1.9169329093085392
        ],
        "p": 0.9345065493450655,
        "n_items": 1387,
        "mean_a": 87.45493871665465,
        "mean_b": 87.31074260994953,
        "per_seed": {
         "42": 0.6521739130434783,
         "43": -0.43103448275862066,
         "44": 0.2159827213822894
        },
        "p_het": 0.8575142485751425,
        "mdd80": 2.5384903240631824,
        "shift_vs_primary": -0.32403131804404495,
        "q_sub": 1.0,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u64_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.0814708002883922,
        "ci95": [
         -0.45317220704092787,
         2.6392961892631295
        ],
        "p": 0.20837916208379162,
        "n_items": 1387,
        "mean_a": 88.32011535688537,
        "mean_b": 87.23864455659697,
        "per_seed": {
         "42": 2.391304347826087,
         "43": -0.646551724137931,
         "44": 1.511879049676026
        },
        "p_het": 0.23637636236376364,
        "mdd80": 2.2101971808936347,
        "shift_vs_primary": -0.32321147395909944,
        "q_sub": 0.6580394592119735,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u128_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.7303532804614274,
        "ci95": [
         0.14749262374960956,
         3.2786885261866288
        ],
        "p": 0.03799620037996201,
        "n_items": 1387,
        "mean_a": 89.04109589041096,
        "mean_b": 87.31074260994953,
        "per_seed": {
         "42": 1.5217391304347827,
         "43": 1.9396551724137931,
         "44": 1.7278617710583153
        },
        "p_het": 0.9923007699230078,
        "mdd80": 2.2378758549846656,
        "shift_vs_primary": -0.14255641853522816,
        "q_sub": 0.28497150284971506,
        "label_sub": "nominal_gain",
        "label_primary": "nominal_gain",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.33715441672285906,
        "ci95": [
         -1.479289942819286,
         2.148997136590814
        ],
        "p": 0.7722227777222278,
        "n_items": 1483,
        "mean_a": 87.25556304787592,
        "mean_b": 86.91840863115307,
        "per_seed": {
         "42": -1.016260162601626,
         "43": 0.8048289738430584,
         "44": 1.214574898785425
        },
        "p_het": 0.48625137486251374,
        "mdd80": 2.593148529494798,
        "shift_vs_primary": 0.002033773291223673,
        "q_sub": 0.9754392981754457,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r40_sxs|dense_sxs": {
        "status": "complete",
        "delta": -0.9453072248480756,
        "ci95": [
         -2.3943661986885223,
         0.5277044869239552
        ],
        "p": 0.23777622237776222,
        "n_items": 1481,
        "mean_a": 85.88791357191087,
        "mean_b": 86.83322079675895,
        "per_seed": {
         "42": 0.814663951120163,
         "43": -1.814516129032258,
         "44": -1.8218623481781377
        },
        "p_het": 0.3758624137586241,
        "mdd80": 2.088413385058772,
        "shift_vs_primary": -0.005709909411834024,
        "q_sub": 0.6793606353650349,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r60_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.0107816711590296,
        "ci95": [
         -0.5412719907298125,
         2.564102565654067
        ],
        "p": 0.23467653234676533,
        "n_items": 1484,
        "mean_a": 87.87061994609165,
        "mean_b": 86.85983827493261,
        "per_seed": {
         "42": 1.829268292682927,
         "43": 1.6096579476861168,
         "44": -0.40404040404040403
        },
        "p_het": 0.4754524547545245,
        "mdd80": 2.219421255312205,
        "shift_vs_primary": 0.006093124608460343,
        "q_sub": 0.6793606353650349,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u32_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.5383580080753702,
        "ci95": [
         -1.19521912521152,
         2.264150945007189
        ],
        "p": 0.5885411458854115,
        "n_items": 1486,
        "mean_a": 87.41588156123822,
        "mean_b": 86.87752355316286,
        "per_seed": {
         "42": 1.0141987829614605,
         "43": 0.2012072434607646,
         "44": 0.4032258064516129
        },
        "p_het": 0.9037096290370963,
        "mdd80": 2.4724229958188544,
        "shift_vs_primary": 0.07013058332620625,
        "q_sub": 0.941516237986591,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u64_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.4131897711978465,
        "ci95": [
         -0.1367989071822313,
         2.9411764721779905
        ],
        "p": 0.0857914208579142,
        "n_items": 1486,
        "mean_a": 88.22341857335128,
        "mean_b": 86.81022880215343,
        "per_seed": {
         "42": 2.636916835699797,
         "43": 0.2012072434607646,
         "44": 1.4112903225806452
        },
        "p_het": 0.43685631436856315,
        "mdd80": 2.1998389747337295,
        "shift_vs_primary": 0.00850749695035491,
        "q_sub": 0.41611838816118385,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u128_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.8842530282637955,
        "ci95": [
         0.27434842086180244,
         3.4782608712774685
        ],
        "p": 0.025897410258974102,
        "n_items": 1486,
        "mean_a": 88.76177658142664,
        "mean_b": 86.87752355316286,
        "per_seed": {
         "42": 2.231237322515213,
         "43": 2.414486921529175,
         "44": 1.0080645161290323
        },
        "p_het": 0.7208279172082792,
        "mdd80": 2.28984660739035,
        "shift_vs_primary": 0.011343329267139879,
        "q_sub": 0.2331195451883383,
        "label_sub": "nominal_gain",
        "label_primary": "nominal_gain",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "unavailable",
      "why": "unavailable: the route-(i) scan was not validated before the START marker"
     },
     "drop_probed": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.4765146358066712,
        "ci95": [
         -1.3353115746736903,
         2.272727274594092
        ],
        "p": 0.6598340165983402,
        "n_items": 1469,
        "mean_a": 87.40639891082368,
        "mean_b": 86.92988427501702,
        "per_seed": {
         "42": -1.0101010101010102,
         "43": 0.8,
         "44": 1.6877637130801688
        },
        "p_het": 0.36496350364963503,
        "mdd80": 2.5786770538179176,
        "shift_vs_primary": 0.1413939923750358,
        "q_sub": 0.9558623085059915,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r40_sxs|dense_sxs": {
        "status": "complete",
        "delta": -0.8174386920980926,
        "ci95": [
         -2.278820376769475,
         0.665778962833512
        ],
        "p": 0.3173682631736826,
        "n_items": 1468,
        "mean_a": 86.03542234332426,
        "mean_b": 86.85286103542235,
        "per_seed": {
         "42": 0.8097165991902834,
         "43": -1.8036072144288577,
         "44": -1.4736842105263157
        },
        "p_het": 0.418958104189581,
        "mdd80": 2.104514687047391,
        "shift_vs_primary": 0.12215862333814898,
        "q_sub": 0.7323882996315751,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r60_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.0204081632653061,
        "ci95": [
         -0.544217688634123,
         2.5940337239320943
        ],
        "p": 0.23247675232476753,
        "n_items": 1470,
        "mean_a": 87.89115646258503,
        "mean_b": 86.87074829931973,
        "per_seed": {
         "42": 1.8181818181818181,
         "43": 1.6,
         "44": -0.42105263157894735
        },
        "p_het": 0.5044495550444955,
        "mdd80": 2.242918450930337,
        "shift_vs_primary": 0.015719616714736873,
        "q_sub": 0.6804197629017587,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u32_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.33967391304347827,
        "ci95": [
         -1.3736263753516869,
         2.051282052893067
        ],
        "p": 0.7492250774922508,
        "n_items": 1472,
        "mean_a": 87.22826086956522,
        "mean_b": 86.88858695652173,
        "per_seed": {
         "42": 0.8064516129032258,
         "43": 0.2,
         "44": 0.0
        },
        "p_het": 0.9341065893410659,
        "mdd80": 2.4477931486615376,
        "shift_vs_primary": -0.12855351170568563,
        "q_sub": 0.9558623085059915,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u64_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.4266304347826086,
        "ci95": [
         -0.1386962567950597,
         2.975420441319205
        ],
        "p": 0.08969103089691031,
        "n_items": 1472,
        "mean_a": 88.24728260869566,
        "mean_b": 86.82065217391305,
        "per_seed": {
         "42": 2.620967741935484,
         "43": 0.2,
         "44": 1.4705882352941178
        },
        "p_het": 0.4273572642735726,
        "mdd80": 2.22566929232709,
        "shift_vs_primary": 0.021948160535117056,
        "q_sub": 0.4167275580134294,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u128_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.9701086956521738,
        "ci95": [
         0.3952569154728477,
         3.5578144868715285
        ],
        "p": 0.019598040195980403,
        "n_items": 1472,
        "mean_a": 88.8586956521739,
        "mean_b": 86.88858695652173,
        "per_seed": {
         "42": 2.217741935483871,
         "43": 2.4,
         "44": 1.2605042016806722
        },
        "p_het": 0.8203179682031797,
        "mdd80": 2.26029014138773,
        "shift_vs_primary": 0.09719899665551823,
        "q_sub": 0.1809049864244345,
        "label_sub": "nominal_gain",
        "label_primary": "nominal_gain",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out": [
       [
        44,
        252
       ],
       [
        44,
        253
       ],
       [
        44,
        254
       ],
       [
        44,
        255
       ],
       [
        44,
        256
       ],
       [
        44,
        257
       ],
       [
        44,
        258
       ],
       [
        44,
        259
       ],
       [
        44,
        263
       ],
       [
        44,
        267
       ],
       [
        44,
        271
       ],
       [
        44,
        272
       ],
       [
        44,
        273
       ],
       [
        44,
        274
       ],
       [
        44,
        275
       ],
       [
        44,
        276
       ],
       [
        44,
        281
       ],
       [
        44,
        298
       ],
       [
        44,
        303
       ],
       [
        44,
        308
       ],
       [
        44,
        310
       ],
       [
        44,
        311
       ],
       [
        44,
        312
       ]
      ],
      "applies_to": [
       "jqs_f_dense_sxs|dense_sxs",
       "jqs_f_r40_sxs|dense_sxs",
       "jqs_f_r60_sxs|dense_sxs",
       "jqs_f_u32_sxs|dense_sxs",
       "jqs_f_u64_sxs|dense_sxs",
       "jqs_f_u128_sxs|dense_sxs"
      ],
      "not_applicable": []
     },
     "by_period_stack": {
      "status": "unavailable",
      "why": "Final registered stack record and split inputs were not completed."
     },
     "zero_as_failure": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.3333333333333333,
        "ci95": [
         -1.4666666684633611,
         2.1333333351300285
        ],
        "p": 0.7747225277472253,
        "n_items": 1500,
        "mean_a": 87.0,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": -0.8,
         "43": 0.8,
         "44": 1.0
        },
        "p_het": 0.6316368363163684,
        "mdd80": 2.572931664772579,
        "shift_vs_primary": -0.001787310098302075,
        "q_sub": 0.9785968771543898,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_dense_sxs": 4,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 8
       },
       "jqs_f_r40_sxs|dense_sxs": {
        "status": "complete",
        "delta": -1.2,
        "ci95": [
         -2.68817204450514,
         0.27322404522429655
        ],
        "p": 0.13838616138386162,
        "n_items": 1500,
        "mean_a": 85.46666666666667,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 0.6,
         "43": -2.0,
         "44": -2.2
        },
        "p_het": 0.36826317368263173,
        "mdd80": 2.1165193787758567,
        "shift_vs_primary": -0.26040268456375837,
        "q_sub": 0.5230726927307269,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r40_sxs": 6,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 10
       },
       "jqs_f_r60_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.0,
        "ci95": [
         -0.5442176886484119,
         2.553763442422336
        ],
        "p": 0.24047595240475952,
        "n_items": 1500,
        "mean_a": 87.66666666666667,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 1.8,
         "43": 1.6,
         "44": -0.4
        },
        "p_het": 0.5078492150784921,
        "mdd80": 2.2141371502898997,
        "shift_vs_primary": -0.0046885465505692725,
        "q_sub": 0.6870741497278844,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r60_sxs": 3,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 7
       },
       "jqs_f_u32_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.6666666666666666,
        "ci95": [
         -1.054018447018279,
         2.371541503656072
        ],
        "p": 0.48965103489651035,
        "n_items": 1500,
        "mean_a": 87.33333333333333,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 1.2,
         "43": 0.2,
         "44": 0.6
        },
        "p_het": 0.8918108189181082,
        "mdd80": 2.4482587938525784,
        "shift_vs_primary": 0.19843924191750273,
        "q_sub": 0.827579213909595,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u32_sxs": 1,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 5
       },
       "jqs_f_u64_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.4666666666666666,
        "ci95": [
         -0.12722646461973086,
         2.9931972804698357
        ],
        "p": 0.0736926307369263,
        "n_items": 1500,
        "mean_a": 88.13333333333334,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 2.8,
         "43": 0.2,
         "44": 1.4
        },
        "p_het": 0.38306169383061695,
        "mdd80": 2.2301769592320246,
        "shift_vs_primary": 0.06198439241917497,
        "q_sub": 0.3719628037196281,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u64_sxs": 1,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 5
       },
       "jqs_f_u128_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.9333333333333333,
        "ci95": [
         0.3861003846076504,
         3.501945526811502
        ],
        "p": 0.018998100189981004,
        "n_items": 1500,
        "mean_a": 88.6,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 2.4,
         "43": 2.4,
         "44": 1.0
        },
        "p_het": 0.7102289771022897,
        "mdd80": 2.2269046169172144,
        "shift_vs_primary": 0.060423634336677745,
        "q_sub": 0.1781360325505911,
        "label_sub": "nominal_gain",
        "label_primary": "nominal_gain",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u128_sxs": 1,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 5
       }
      },
      "other_label_changes": [],
      "rule": "the addendum v2's zero_token_as_failure: every (seed, instance) an item, no pair dropped; a zero-token row (tokens == 0, whatever its resolved field) or a missing row scores 0 on its side; same test and seed tuple as the contrast; the label its p gets substituted into the family's BH; never decides",
      "items_total": 1500
     }
    }
   },
   "B10": {
    "title": "(10) Baselines vs bf16 -- single reference",
    "seed_tuple": [
     20261024,
     22,
     0,
     1
    ],
    "specs": [
     [
      "quest_b2048_s1_sxs",
      "dense_sxs"
     ],
     [
      "sparq_c8_s1_sxs",
      "dense_sxs"
     ],
     [
      "loki_k25_d25_s1_sxs",
      "dense_sxs"
     ],
     [
      "tri_b4096_s1_sxs",
      "dense_sxs"
     ]
    ],
    "replaces": [
     [
      "quest_b2048_s1",
      "dense_s1"
     ],
     [
      "sparq_c8_s1",
      "dense_s1"
     ],
     [
      "loki_k25_d25_s1",
      "dense_s1"
     ],
     [
      "tri_b4096_s1",
      "dense_s1"
     ]
    ],
    "family_m_registered": 80,
    "m": 80,
    "status": "ARCHIVAL ONLY; integrity gate failed; not used in main comparison",
    "removed": [],
    "members": [
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 53,
      "mean_a": 89.05723905723906,
      "mean_b": 90.06734006734007,
      "delta": -1.0101010101010102,
      "ci95": [
       -2.7491408952443113,
       0.7017543877466391
      ],
      "p": 0.30026997300269975,
      "mid_p": 0.262,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": 0.0,
       "44": -2.525252525252525
      },
      "p_het": 0.5342465753424658,
      "mdd80": 2.4663660379330916,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.47)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 23,
      "mean_a": 98.125,
      "mean_b": 98.99305555555556,
      "delta": -0.8680555555555556,
      "ci95": [
       -2.3237179504085157,
       0.4807692323363273
      ],
      "p": 0.3243675632436756,
      "mid_p": 0.30085,
      "per_seed": {
       "42": -1.1458333333333333,
       "43": -0.4166666666666667,
       "44": -1.0416666666666667
      },
      "p_het": 0.7501249875012499,
      "mdd80": 2.0043760746473733,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.00)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 238,
      "mean_a": 81.49779735682819,
      "mean_b": 86.67400881057269,
      "delta": -5.176211453744493,
      "ci95": [
       -7.1637426920305,
       -3.1931464153484086
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -4.405286343612334,
       "43": -5.8370044052863435,
       "44": -5.286343612334802
      },
      "p_het": 0.7572242775722428,
      "mdd80": 2.83779802169615,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 121,
      "a_only": 4,
      "b_only": 117,
      "mean_a": 27.715355805243444,
      "mean_b": 70.0374531835206,
      "rate_a": 27.715355805243448,
      "rate_b": 70.0374531835206,
      "delta": -42.32209737827716,
      "ci95": [
       -50.79365080261101,
       -34.042553183677484
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -44.943820224719104,
       "43": -38.20224719101124,
       "44": -43.82022471910113
      },
      "p_het": 0.5145485451454854,
      "mdd80": 11.97206373345287,
      "key": [
       "qwen3.8-27b",
       "tb",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "quest_b2048_s1_sxs",
      "b": "dense_sxs",
      "n_items": 1413,
      "n_clusters": 492,
      "n_diff_items": 1195,
      "a_only": 0,
      "b_only": 1195,
      "mean_a": 2.264685067232838,
      "mean_b": 86.83651804670913,
      "rate_a": 2.1333333333333333,
      "rate_b": 86.66666666666667,
      "delta": -84.5718329794763,
      "ci95": [
       -87.29508196983062,
       -81.84523809237905
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -81.99566160520607,
       "43": -87.11018711018711,
       "44": -84.50106157112526
      },
      "p_het": 0.0057994200579942,
      "key": [
       "qwen3.8-27b",
       "swe",
       "quest_b2048_s1_sxs",
       "dense_sxs"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "sxs",
      "replaces": [
       "quest_b2048_s1",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       22,
       0,
       1
      ],
      "label_text": "Quest b2048 (sxs) vs bf16 sxs",
      "mdd80": 3.8950210739904962,
      "se": 1.397150807068053,
      "ci95_bootstrap": [
       -87.26884779516358,
       -81.77935943060498
      ],
      "mdd80_cell": 2.2431080643698085,
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 52,
      "mean_a": 89.22558922558923,
      "mean_b": 90.06734006734007,
      "delta": -0.8417508417508418,
      "ci95": [
       -2.4752475263505405,
       0.8090614902600897
      ],
      "p": 0.3665633436656334,
      "mid_p": 0.32045,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": 1.0101010101010102,
       "44": -1.5151515151515151
      },
      "p_het": 0.39486051394860516,
      "mdd80": 2.3473062936946647,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.35)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 98.68055555555556,
      "mean_b": 98.99305555555556,
      "delta": -0.3125,
      "ci95": [
       -1.3257575771524501,
       0.5208333343862288
      ],
      "p": 0.9125087491250875,
      "mid_p": 0.8737,
      "per_seed": {
       "42": 0.10416666666666667,
       "43": -0.4166666666666667,
       "44": -0.625
      },
      "p_het": 0.595940405959404,
      "mdd80": 1.319764506510194,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.9642193675369306,
      "label_source": "no_detected_loss",
      "q": 0.951697038088399,
      "label": "no_detected_loss",
      "q_prev": 0.9642193675369306,
      "label_prev": "no_detected_loss",
      "q_published": 0.9642193675369306,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.32)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 212,
      "mean_a": 87.59177679882525,
      "mean_b": 86.67400881057269,
      "delta": 0.9177679882525698,
      "ci95": [
       -0.7735583701096074,
       2.5974025990536616
      ],
      "p": 0.31226877312268775,
      "mid_p": 0.2925,
      "per_seed": {
       "42": 1.7621145374449338,
       "43": -0.11013215859030837,
       "44": 1.1013215859030836
      },
      "p_het": 0.5998400159984002,
      "mdd80": 2.409236724893141,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.41)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 24,
      "b_only": 18,
      "mean_a": 72.28464419475655,
      "mean_b": 70.0374531835206,
      "rate_a": 72.28464419475655,
      "rate_b": 70.0374531835206,
      "delta": 2.247191011235955,
      "ci95": [
       -2.8985507296163715,
       7.407407412513095
      ],
      "p": 0.4657534246575342,
      "mid_p": 0.3889,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 3.3707865168539324,
       "44": 1.1235955056179776
      },
      "p_het": 0.9802019798020198,
      "mdd80": 7.365701670343845,
      "key": [
       "qwen3.8-27b",
       "tb",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.6009721608484313,
      "label_source": "no_detected_loss",
      "q": 0.5821917808219178,
      "label": "no_detected_loss",
      "q_prev": 0.6009721608484313,
      "label_prev": "no_detected_loss",
      "q_published": 0.5914329202000435,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.37)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "sparq_c8_s1_sxs",
      "b": "dense_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 129,
      "a_only": 80,
      "b_only": 49,
      "mean_a": 88.94101876675603,
      "mean_b": 86.8632707774799,
      "rate_a": 88.66666666666667,
      "rate_b": 86.66666666666667,
      "delta": 2.0777479892761392,
      "ci95": [
       0.5755395667358043,
       3.5612535628283317
      ],
      "p": 0.007499250074992501,
      "mid_p": 0.0056,
      "per_seed": {
       "42": 3.0303030303030303,
       "43": 2.004008016032064,
       "44": 1.2048192771084338
      },
      "p_het": 0.6177382261773823,
      "key": [
       "qwen3.8-27b",
       "swe",
       "sparq_c8_s1_sxs",
       "dense_sxs"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "sxs",
      "replaces": [
       "sparq_c8_s1",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       22,
       0,
       1
      ],
      "label_text": "SparQ c8 (sxs) vs bf16 sxs",
      "mdd80": 2.133899465231445,
      "se": 0.7729923937745107,
      "ci95_bootstrap": [
       0.6012024048096193,
       3.6168787675820497
      ],
      "mdd80_cell": 2.2431080643698085,
      "q": 0.02999700029997,
      "label": "gain_detected",
      "q_prev": 0.46695330466953305,
      "label_prev": "no_detected_loss",
      "q_published": 0.46695330466953305,
      "label_published": "no_detected_loss",
      "changed": true,
      "text": "above, detected (p 0.00750, q 0.0300)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 43,
      "mean_a": 90.4040404040404,
      "mean_b": 90.06734006734007,
      "delta": 0.3367003367003367,
      "ci95": [
       -1.14379085110805,
       1.8333333348144374
      ],
      "p": 0.7471252874712528,
      "mid_p": 0.6692,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 1.5151515151515151,
       "44": 0.5050505050505051
      },
      "p_het": 0.40775922407759224,
      "mdd80": 2.127760300076217,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.8662322173579743,
      "label_source": "no_detected_loss",
      "q": 0.8418313098267637,
      "label": "no_detected_loss",
      "q_prev": 0.8662322173579743,
      "label_prev": "no_detected_loss",
      "q_published": 0.8662322173579743,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.13)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 26,
      "mean_a": 98.125,
      "mean_b": 98.99305555555556,
      "delta": -0.8680555555555556,
      "ci95": [
       -1.996527779199361,
       0.14880952490630892
      ],
      "p": 0.1406859314068593,
      "mid_p": 0.11645,
      "per_seed": {
       "42": -0.3125,
       "43": -0.8333333333333334,
       "44": -1.4583333333333333
      },
      "p_het": 0.6137386261373863,
      "mdd80": 1.5332795210671242,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.3517148285171483,
      "label_source": "no_detected_loss",
      "q": 0.331025720957316,
      "label": "no_detected_loss",
      "q_prev": 0.3517148285171483,
      "label_prev": "no_detected_loss",
      "q_published": 0.3517148285171483,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.53)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 195,
      "mean_a": 86.78414096916299,
      "mean_b": 86.67400881057269,
      "delta": 0.11013215859030837,
      "ci95": [
       -1.2931034496447582,
       1.507936509447021
      ],
      "p": 0.916008399160084,
      "mid_p": 0.87625,
      "per_seed": {
       "42": 1.3215859030837005,
       "43": -0.7709251101321586,
       "44": -0.22026431718061673
      },
      "p_het": 0.48025197480251974,
      "mdd80": 2.0019123327352433,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.9642193675369306,
      "label_source": "no_detected_loss",
      "q": 0.951697038088399,
      "label": "no_detected_loss",
      "q_prev": 0.9642193675369306,
      "label_prev": "no_detected_loss",
      "q_published": 0.9642193675369306,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.00)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 50,
      "a_only": 28,
      "b_only": 22,
      "mean_a": 72.28464419475655,
      "mean_b": 70.0374531835206,
      "rate_a": 72.28464419475655,
      "rate_b": 70.0374531835206,
      "delta": 2.247191011235955,
      "ci95": [
       -3.333333339538966,
       7.801418444961817
      ],
      "p": 0.5097490250974902,
      "mid_p": 0.43,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 4.49438202247191,
       "44": 0.0
      },
      "p_het": 0.7933206679332067,
      "mdd80": 7.958043171424635,
      "key": [
       "qwen3.8-27b",
       "tb",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.6473003493301462,
      "label_source": "no_detected_loss",
      "q": 0.6273834155046033,
      "label": "no_detected_loss",
      "q_prev": 0.6473003493301462,
      "label_prev": "no_detected_loss",
      "q_published": 0.5625243927220182,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.96)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "loki_k25_d25_s1_sxs",
      "b": "dense_sxs",
      "n_items": 1494,
      "n_clusters": 500,
      "n_diff_items": 155,
      "a_only": 87,
      "b_only": 68,
      "mean_a": 88.21954484605087,
      "mean_b": 86.94779116465864,
      "rate_a": 87.93333333333334,
      "rate_b": 86.66666666666667,
      "delta": 1.2717536813922357,
      "ci95": [
       -0.28735632350657414,
       2.8688524606413104
      ],
      "p": 0.13928607139286073,
      "mid_p": 0.11995,
      "per_seed": {
       "42": 1.4141414141414141,
       "43": 0.8,
       "44": 1.6032064128256514
      },
      "p_het": 0.9153084691530847,
      "key": [
       "qwen3.8-27b",
       "swe",
       "loki_k25_d25_s1_sxs",
       "dense_sxs"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "sxs",
      "replaces": [
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       22,
       0,
       1
      ],
      "label_text": "Loki k25 d25 (sxs) vs bf16 sxs",
      "mdd80": 2.255752642572682,
      "se": 0.8130592751977191,
      "ci95_bootstrap": [
       -0.3342245989304813,
       2.8781793842034804
      ],
      "mdd80_cell": 2.2431080643698085,
      "q": 0.331025720957316,
      "label": "no_detected_loss",
      "q_prev": 0.903142562456083,
      "label_prev": "no_detected_loss",
      "q_published": 0.903142562456083,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.26)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 50,
      "mean_a": 88.38383838383838,
      "mean_b": 90.06734006734007,
      "delta": -1.6835016835016836,
      "ci95": [
       -3.703703706167718,
       0.3367003387221277
      ],
      "p": 0.1227877212278772,
      "mid_p": 0.1056,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": -0.5050505050505051,
       "44": -2.525252525252525
      },
      "p_het": 0.5704429557044296,
      "mdd80": 2.887689859776582,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.3168715386525863,
      "label_source": "no_detected_loss",
      "q": 0.306969303069693,
      "label": "no_detected_loss",
      "q_prev": 0.3168715386525863,
      "label_prev": "no_detected_loss",
      "q_published": 0.3168715386525863,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.89)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 54,
      "mean_a": 79.02777777777777,
      "mean_b": 98.99305555555556,
      "delta": -19.96527777777778,
      "ci95": [
       -31.696428583965925,
       -8.333333318829517
      ],
      "p": 0.00019998000199980003,
      "mid_p": 0.0001,
      "per_seed": {
       "42": -21.979166666666668,
       "43": -18.333333333333332,
       "44": -19.583333333333332
      },
      "p_het": 0.15598440155984403,
      "mdd80": 16.69767987076847,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0009410823623520001,
      "label_source": "loss_detected",
      "q": 0.0009410823623520001,
      "label": "loss_detected",
      "q_prev": 0.0009410823623520001,
      "label_prev": "loss_detected",
      "q_published": 0.0009410823623520001,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0002, q 0.0009)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 392,
      "mean_a": 66.37298091042584,
      "mean_b": 86.67400881057269,
      "delta": -20.301027900146842,
      "ci95": [
       -23.611111114234255,
       -17.030567682354253
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -20.044052863436125,
       "43": -19.933920704845814,
       "44": -20.92511013215859
      },
      "p_het": 0.8429157084291571,
      "mdd80": 4.703135708443076,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 25,
      "b_only": 17,
      "mean_a": 73.03370786516854,
      "mean_b": 70.0374531835206,
      "rate_a": 73.03370786516855,
      "rate_b": 70.0374531835206,
      "delta": 2.9962546816479403,
      "ci95": [
       -2.3255814008439457,
       8.333333338275965
      ],
      "p": 0.3344665533446655,
      "mid_p": 0.2712,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 10.112359550561798,
       "44": -5.617977528089888
      },
      "p_het": 0.0173982601739826,
      "mdd80": 7.617960893616241,
      "key": [
       "qwen3.8-27b",
       "tb",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.62)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "tri_b4096_s1_sxs",
      "b": "dense_sxs",
      "n_items": 1489,
      "n_clusters": 500,
      "n_diff_items": 132,
      "a_only": 72,
      "b_only": 60,
      "mean_a": 87.70987239758227,
      "mean_b": 86.90396239086635,
      "rate_a": 87.06666666666666,
      "rate_b": 86.66666666666667,
      "delta": 0.8059100067159167,
      "ci95": [
       -0.7564296537988717,
       2.3643949946574
      ],
      "p": 0.34906509349065096,
      "mid_p": 0.30785,
      "per_seed": {
       "42": 0.2032520325203252,
       "43": -0.2,
       "44": 2.414486921529175
      },
      "p_het": 0.3260673932606739,
      "key": [
       "qwen3.8-27b",
       "swe",
       "tri_b4096_s1_sxs",
       "dense_sxs"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "sxs",
      "replaces": [
       "tri_b4096_s1",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       22,
       0,
       1
      ],
      "label_text": "TriAttention b4096 (sxs) vs bf16 sxs",
      "mdd80": 2.2304634861669355,
      "se": 0.7797616109392145,
      "ci95_bootstrap": [
       -0.6743315987675765,
       2.350570852921424
      ],
      "mdd80_cell": 2.2431080643698085,
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.9746557811751293,
      "label_prev": "no_detected_loss",
      "q_published": 0.9746557811751293,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.23)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 106,
      "mean_a": 81.98653198653199,
      "mean_b": 84.76430976430976,
      "delta": -2.7777777777777777,
      "ci95": [
       -5.188679247533257,
       -0.3472222197249011
      ],
      "p": 0.027497250274972504,
      "mid_p": 0.0228,
      "per_seed": {
       "42": -5.05050505050505,
       "43": -1.2626262626262625,
       "44": -2.0202020202020203
      },
      "p_het": 0.44285571442855715,
      "mdd80": 3.460205021680552,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.08460692392299232,
      "label_source": "loss_detected",
      "q": 0.08147333414806669,
      "label": "loss_detected",
      "q_prev": 0.08460692392299232,
      "label_prev": "loss_detected",
      "q_published": 0.08460692392299232,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0275, q 0.0815)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 50,
      "mean_a": 76.11111111111111,
      "mean_b": 91.80555555555556,
      "delta": -15.694444444444445,
      "ci95": [
       -24.826388900280406,
       -6.650641015200971
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -13.229166666666666,
       "43": -18.4375,
       "44": -15.416666666666666
      },
      "p_het": 0.0174982501749825,
      "mdd80": 12.990265893823617,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 453,
      "mean_a": 59.61820851688693,
      "mean_b": 79.47870778267254,
      "delta": -19.86049926578561,
      "ci95": [
       -22.77091906993387,
       -16.957787478933156
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -19.383259911894275,
       "43": -18.94273127753304,
       "44": -21.255506607929515
      },
      "p_het": 0.5858414158584142,
      "mdd80": 4.154663979735059,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 64,
      "a_only": 6,
      "b_only": 58,
      "mean_a": 22.09737827715356,
      "mean_b": 41.57303370786517,
      "rate_a": 22.097378277153563,
      "rate_b": 41.57303370786517,
      "delta": -19.475655430711612,
      "ci95": [
       -25.58139535514439,
       -13.333333327888639
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -23.59550561797753,
       "43": -15.730337078651685,
       "44": -19.10112359550562
      },
      "p_het": 0.48255174482551744,
      "mdd80": 8.753729608491495,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 760,
      "a_only": 12,
      "b_only": 748,
      "mean_a": 19.4,
      "mean_b": 68.46666666666667,
      "rate_a": 19.400000000000002,
      "rate_b": 68.46666666666665,
      "delta": -49.06666666666667,
      "ci95": [
       -52.82485876104211,
       -45.30612244514715
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -49.6,
       "43": -50.6,
       "44": -47.0
      },
      "p_het": 0.2586741325867413,
      "mdd80": 5.37366520192555,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 95,
      "mean_a": 82.996632996633,
      "mean_b": 84.76430976430976,
      "delta": -1.7676767676767677,
      "ci95": [
       -4.28134556803071,
       0.7407407434962936
      ],
      "p": 0.18958104189581043,
      "mid_p": 0.1684,
      "per_seed": {
       "42": -2.525252525252525,
       "43": -1.7676767676767677,
       "44": -1.0101010101010102
      },
      "p_het": 0.8511148885111489,
      "mdd80": 3.589301355903054,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.424179804241798,
      "label_source": "no_detected_loss",
      "q": 0.4018545513869666,
      "label": "no_detected_loss",
      "q_prev": 0.424179804241798,
      "label_prev": "no_detected_loss",
      "q_published": 0.424179804241798,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.59)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 29,
      "mean_a": 91.11111111111111,
      "mean_b": 91.80555555555556,
      "delta": -0.6944444444444444,
      "ci95": [
       -2.483974361049123,
       1.0416666684090128
      ],
      "p": 0.5264473552644735,
      "mid_p": 0.5026,
      "per_seed": {
       "42": 0.3125,
       "43": -1.3541666666666667,
       "44": -1.0416666666666667
      },
      "p_het": 0.055394460553944605,
      "mdd80": 2.5197870650721255,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.6580591940805919,
      "label_source": "no_detected_loss",
      "q": 0.63811800638118,
      "label": "no_detected_loss",
      "q_prev": 0.6580591940805919,
      "label_prev": "no_detected_loss",
      "q_published": 0.6580591940805919,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.52)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 294,
      "mean_a": 77.67988252569751,
      "mean_b": 79.47870778267254,
      "delta": -1.7988252569750367,
      "ci95": [
       -3.571428573117547,
       1.7298375105492156e-09
      ],
      "p": 0.050994900509949,
      "mid_p": 0.04665,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -2.8634361233480177,
       "44": -1.8722466960352422
      },
      "p_het": 0.6052394760523948,
      "mdd80": 2.5525115720906304,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.14712814432842428,
      "label_source": "no_detected_loss",
      "q": 0.14205476004123724,
      "label": "no_detected_loss",
      "q_prev": 0.14712814432842428,
      "label_prev": "no_detected_loss",
      "q_published": 0.14712814432842428,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.55)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 54,
      "a_only": 25,
      "b_only": 29,
      "mean_a": 40.0749063670412,
      "mean_b": 41.57303370786517,
      "rate_a": 40.0749063670412,
      "rate_b": 41.57303370786517,
      "delta": -1.4981273408239701,
      "ci95": [
       -7.092198586857561,
       4.166666671918152
      ],
      "p": 0.6927307269273073,
      "mid_p": 0.60405,
      "per_seed": {
       "42": -7.865168539325842,
       "43": 2.247191011235955,
       "44": 1.1235955056179776
      },
      "p_het": 0.26777322267773224,
      "mdd80": 8.04674747355468,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.8149773257968321,
      "label_source": "no_detected_loss",
      "q": 0.791692259345494,
      "label": "no_detected_loss",
      "q_prev": 0.8149773257968321,
      "label_prev": "no_detected_loss",
      "q_published": 0.8149773257968321,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.05)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 183,
      "a_only": 98,
      "b_only": 85,
      "mean_a": 69.33333333333333,
      "mean_b": 68.46666666666667,
      "rate_a": 69.33333333333333,
      "rate_b": 68.46666666666665,
      "delta": 0.8666666666666667,
      "ci95": [
       -0.9259259276982204,
       2.6315789493039308
      ],
      "p": 0.37606239376062395,
      "mid_p": 0.3385,
      "per_seed": {
       "42": 1.6,
       "43": -1.2,
       "44": 2.2
      },
      "p_het": 0.2592740725927407,
      "mdd80": 2.542560260134806,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5187067500146537,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.54)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 101,
      "mean_a": 84.34343434343434,
      "mean_b": 84.76430976430976,
      "delta": -0.4208754208754209,
      "ci95": [
       -2.8846153869517766,
       2.0599250963863476
      ],
      "p": 0.7954204579542046,
      "mid_p": 0.7477,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -1.7676767676767677,
       "44": -0.5050505050505051
      },
      "p_het": 0.6631336866313369,
      "mdd80": 3.533879101286657,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.89546600895466,
      "label_source": "no_detected_loss",
      "q": 0.8712642249288584,
      "label": "no_detected_loss",
      "q_prev": 0.89546600895466,
      "label_prev": "no_detected_loss",
      "q_published": 0.89546600895466,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.53)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 25,
      "mean_a": 92.29166666666667,
      "mean_b": 91.80555555555556,
      "delta": 0.4861111111111111,
      "ci95": [
       -0.1602564110125368,
       1.1217948725388331
      ],
      "p": 0.17098290170982902,
      "mid_p": 0.1403,
      "per_seed": {
       "42": 1.3541666666666667,
       "43": -0.9375,
       "44": 1.0416666666666667
      },
      "p_het": 0.0700929907009299,
      "mdd80": 0.9162862055608539,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.40325379226783203,
      "label_source": "no_detected_loss",
      "q": 0.38085080380850805,
      "label": "no_detected_loss",
      "q_prev": 0.40325379226783203,
      "label_prev": "no_detected_loss",
      "q_published": 0.40325379226783203,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.92)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 308,
      "mean_a": 77.23935389133626,
      "mean_b": 79.47870778267254,
      "delta": -2.23935389133627,
      "ci95": [
       -4.092261906639887,
       -0.38051750188418
      ],
      "p": 0.020497950204979503,
      "mid_p": 0.0182,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": -1.1013215859030836,
       "44": -4.73568281938326
      },
      "p_het": 0.15898410158984103,
      "mdd80": 2.6527957502794104,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0655934406559344,
      "label_source": "loss_detected",
      "q": 0.06307061601532155,
      "label": "loss_detected",
      "q_prev": 0.0655934406559344,
      "label_prev": "loss_detected",
      "q_published": 0.0655934406559344,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0205, q 0.0631)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 54,
      "a_only": 24,
      "b_only": 30,
      "mean_a": 39.325842696629216,
      "mean_b": 41.57303370786517,
      "rate_a": 39.325842696629216,
      "rate_b": 41.57303370786517,
      "delta": -2.247191011235955,
      "ci95": [
       -6.14035088174198,
       1.6260162643650804
      ],
      "p": 0.3391660833916608,
      "mid_p": 0.2637,
      "per_seed": {
       "42": -10.112359550561798,
       "43": 0.0,
       "44": 3.3707865168539324
      },
      "p_het": 0.17718228177182282,
      "mdd80": 5.550647758478516,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.55)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 158,
      "a_only": 85,
      "b_only": 73,
      "mean_a": 69.26666666666667,
      "mean_b": 68.46666666666667,
      "rate_a": 69.26666666666667,
      "rate_b": 68.46666666666665,
      "delta": 0.8,
      "ci95": [
       -0.8196721328024502,
       2.426564497088632
      ],
      "p": 0.36946305369463056,
      "mid_p": 0.3297,
      "per_seed": {
       "42": -0.6,
       "43": 1.0,
       "44": 2.0
      },
      "p_het": 0.46605339466053397,
      "mdd80": 2.320095835570661,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.32)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 105,
      "mean_a": 81.14478114478115,
      "mean_b": 84.76430976430976,
      "delta": -3.6195286195286194,
      "ci95": [
       -6.378600826417472,
       -0.8680555527262774
      ],
      "p": 0.011498850114988501,
      "mid_p": 0.0093,
      "per_seed": {
       "42": -4.545454545454546,
       "43": -4.292929292929293,
       "44": -2.0202020202020203
      },
      "p_het": 0.6295370462953704,
      "mdd80": 3.9384045585252023,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.039996000399960006,
      "label_source": "loss_detected",
      "q": 0.038329500383295,
      "label": "loss_detected",
      "q_prev": 0.039996000399960006,
      "label_prev": "loss_detected",
      "q_published": 0.039996000399960006,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0115, q 0.0383)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 63,
      "mean_a": 63.68055555555556,
      "mean_b": 91.80555555555556,
      "delta": -28.125,
      "ci95": [
       -39.772727288615705,
       -16.66666665102798
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -28.854166666666668,
       "43": -28.229166666666668,
       "44": -27.291666666666668
      },
      "p_het": 0.7448255174482552,
      "mdd80": 16.513976389795438,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 345,
      "mean_a": 72.83406754772393,
      "mean_b": 79.47870778267254,
      "delta": -6.644640234948605,
      "ci95": [
       -8.946608948869727,
       -4.354354352015381
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -5.506607929515418,
       "43": -7.488986784140969,
       "44": -6.938325991189427
      },
      "p_het": 0.6674332566743326,
      "mdd80": 3.2820992369861437,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 26,
      "b_only": 25,
      "mean_a": 41.947565543071164,
      "mean_b": 41.57303370786517,
      "rate_a": 41.947565543071164,
      "rate_b": 41.57303370786517,
      "delta": 0.37453183520599254,
      "ci95": [
       -4.444444449196073,
       5.185185189935703
      ],
      "p": 1.0,
      "mid_p": 0.8806,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 1.1235955056179776,
       "44": 2.247191011235955
      },
      "p_het": 0.8422157784221578,
      "mdd80": 6.88232749828439,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.88)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 172,
      "a_only": 92,
      "b_only": 80,
      "mean_a": 69.26666666666667,
      "mean_b": 68.46666666666667,
      "rate_a": 69.26666666666667,
      "rate_b": 68.46666666666665,
      "delta": 0.8,
      "ci95": [
       -0.9222661413557368,
       2.5232403735601534
      ],
      "p": 0.41025897410258977,
      "mid_p": 0.37155,
      "per_seed": {
       "42": 1.2,
       "43": -2.2,
       "44": 3.4
      },
      "p_het": 0.0321967803219678,
      "mdd80": 2.4625146679329255,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5470119654701197,
      "label_source": "no_detected_loss",
      "q": 0.52936641819689,
      "label": "no_detected_loss",
      "q_prev": 0.5470119654701197,
      "label_prev": "no_detected_loss",
      "q_published": 0.5470119654701197,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.46)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 134,
      "mean_a": 72.39057239057239,
      "mean_b": 72.47474747474747,
      "delta": -0.08417508417508418,
      "ci95": [
       -2.9824561433614933,
       2.807017546867923
      ],
      "p": 1.0,
      "mid_p": 0.953,
      "per_seed": {
       "42": 0.0,
       "43": 3.5353535353535355,
       "44": -3.787878787878788
      },
      "p_het": 0.09989001099890012,
      "mdd80": 4.137755601414013,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.14)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 85.48611111111111,
      "mean_b": 88.92361111111111,
      "delta": -3.4375,
      "ci95": [
       -5.9659090943669355,
       -0.892857140120187
      ],
      "p": 0.0013998600139986002,
      "mid_p": 0.0008,
      "per_seed": {
       "42": -2.2916666666666665,
       "43": -3.3333333333333335,
       "44": -4.6875
      },
      "p_het": 0.265973402659734,
      "mdd80": 3.6257266658581173,
      "key": [
       "nemotron3-nano",
       "aime25",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.005894147427362527,
      "label_source": "loss_detected",
      "q": 0.005894147427362527,
      "label": "loss_detected",
      "q_prev": 0.005894147427362527,
      "label_prev": "loss_detected",
      "q_published": 0.005894147427362527,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.00140, q 0.00589)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 217,
      "mean_a": 67.40088105726872,
      "mean_b": 69.60352422907489,
      "delta": -2.202643171806167,
      "ci95": [
       -3.8179148327437407,
       -0.5804311756194442
      ],
      "p": 0.009099090090990901,
      "mid_p": 0.0082,
      "per_seed": {
       "42": -2.643171806167401,
       "43": -1.6519823788546255,
       "44": -2.3127753303964758
      },
      "p_het": 0.8778122187781222,
      "mdd80": 2.313840057578973,
      "key": [
       "nemotron3-nano",
       "lcb",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.034663200346632006,
      "label_source": "loss_detected",
      "q": 0.033087600330876,
      "label": "loss_detected",
      "q_prev": 0.034663200346632006,
      "label_prev": "loss_detected",
      "q_published": 0.034663200346632006,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.00910, q 0.0331)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 18,
      "a_only": 10,
      "b_only": 8,
      "mean_a": 4.868913857677903,
      "mean_b": 4.119850187265918,
      "rate_a": 4.868913857677903,
      "rate_b": 4.119850187265918,
      "delta": 0.7490636704119851,
      "ci95": [
       -2.0408163290556454,
       3.508771933054236
      ],
      "p": 0.8012198780121987,
      "mid_p": 0.62025,
      "per_seed": {
       "42": 0.0,
       "43": 4.49438202247191,
       "44": -2.247191011235955
      },
      "p_het": 0.2937706229377062,
      "mdd80": 3.966308708827846,
      "key": [
       "nemotron3-nano",
       "tb",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.89546600895466,
      "label_source": "no_detected_loss",
      "q": 0.8712642249288584,
      "label": "no_detected_loss",
      "q_prev": 0.89546600895466,
      "label_prev": "no_detected_loss",
      "q_published": 0.89546600895466,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.97)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 247,
      "a_only": 104,
      "b_only": 143,
      "mean_a": 19.333333333333332,
      "mean_b": 21.933333333333334,
      "rate_a": 19.333333333333332,
      "rate_b": 21.933333333333334,
      "delta": -2.6,
      "ci95": [
       -4.521963826150607,
       -0.6802721068892984
      ],
      "p": 0.0100989901009899,
      "mid_p": 0.00815,
      "per_seed": {
       "42": -4.0,
       "43": -2.6,
       "44": -1.2
      },
      "p_het": 0.577942205779422,
      "mdd80": 2.7456695169210468,
      "key": [
       "nemotron3-nano",
       "swe",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.036723600367236,
      "label_source": "loss_detected",
      "q": 0.03512692209039965,
      "label": "loss_detected",
      "q_prev": 0.036723600367236,
      "label_prev": "loss_detected",
      "q_published": 0.036723600367236,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0101, q 0.0351)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 130,
      "mean_a": 71.21212121212122,
      "mean_b": 72.47474747474747,
      "delta": -1.2626262626262625,
      "ci95": [
       -4.1218638023229905,
       1.6304347857217778
      ],
      "p": 0.42475752424757524,
      "mid_p": 0.3934,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": 0.5050505050505051,
       "44": -3.787878787878788
      },
      "p_het": 0.38766123387661233,
      "mdd80": 4.111186435453857,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5570590481935414,
      "label_source": "no_detected_loss",
      "q": 0.5393746339651749,
      "label": "no_detected_loss",
      "q_prev": 0.5570590481935414,
      "label_prev": "no_detected_loss",
      "q_published": 0.5570590481935414,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.11)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 39,
      "mean_a": 87.15277777777777,
      "mean_b": 88.92361111111111,
      "delta": -1.7708333333333333,
      "ci95": [
       -3.7109375018262867,
       0.16025641249069347
      ],
      "p": 0.08709129087091291,
      "mid_p": 0.07965,
      "per_seed": {
       "42": -0.625,
       "43": -2.7083333333333335,
       "44": -1.9791666666666667
      },
      "p_het": 0.23147685231476853,
      "mdd80": 2.766754831299732,
      "key": [
       "nemotron3-nano",
       "aime25",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.24025183688527701,
      "label_source": "no_detected_loss",
      "q": 0.23224344232243446,
      "label": "no_detected_loss",
      "q_prev": 0.24025183688527701,
      "label_prev": "no_detected_loss",
      "q_published": 0.24025183688527701,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.77)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 224,
      "mean_a": 68.64904552129222,
      "mean_b": 69.60352422907489,
      "delta": -0.9544787077826725,
      "ci95": [
       -2.444444445943024,
       0.5208333346404521
      ],
      "p": 0.22947705229477053,
      "mid_p": 0.21105,
      "per_seed": {
       "42": -1.1013215859030836,
       "43": -0.5506607929515418,
       "44": -1.2114537444933922
      },
      "p_het": 0.9466053394660534,
      "mdd80": 2.1192936358039813,
      "key": [
       "nemotron3-nano",
       "lcb",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.46695330466953305,
      "label_source": "no_detected_loss",
      "q": 0.4555641996775932,
      "label": "no_detected_loss",
      "q_prev": 0.46695330466953305,
      "label_prev": "no_detected_loss",
      "q_published": 0.46695330466953305,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.12)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 14,
      "a_only": 5,
      "b_only": 9,
      "mean_a": 2.6217228464419478,
      "mean_b": 4.119850187265918,
      "rate_a": 2.6217228464419478,
      "rate_b": 4.119850187265918,
      "delta": -1.4981273408239701,
      "ci95": [
       -4.065040653194817,
       0.8547008573805842
      ],
      "p": 0.401959804019598,
      "mid_p": 0.2761,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 2.247191011235955,
       "44": -3.3707865168539324
      },
      "p_het": 0.23357664233576642,
      "mdd80": 3.516155195116837,
      "key": [
       "nemotron3-nano",
       "tb",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.545030242738438,
      "label_source": "no_detected_loss",
      "q": 0.5271603987142269,
      "label": "no_detected_loss",
      "q_prev": 0.545030242738438,
      "label_prev": "no_detected_loss",
      "q_published": 0.545030242738438,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.52)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 263,
      "a_only": 100,
      "b_only": 163,
      "mean_a": 17.733333333333334,
      "mean_b": 21.933333333333334,
      "rate_a": 17.733333333333334,
      "rate_b": 21.933333333333334,
      "delta": -4.2,
      "ci95": [
       -6.349206351337289,
       -2.074688794484463
      ],
      "p": 0.00029997000299970003,
      "mid_p": 0.00015,
      "per_seed": {
       "42": -4.6,
       "43": -4.6,
       "44": -3.4
      },
      "p_het": 0.8885111488851115,
      "mdd80": 3.05501154518753,
      "key": [
       "nemotron3-nano",
       "swe",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.001333200013332,
      "label_source": "loss_detected",
      "q": 0.001333200013332,
      "label": "loss_detected",
      "q_prev": 0.001333200013332,
      "label_prev": "loss_detected",
      "q_published": 0.001333200013332,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0003, q 0.00133)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 124,
      "mean_a": 73.4006734006734,
      "mean_b": 72.47474747474747,
      "delta": 0.9259259259259259,
      "ci95": [
       -1.8867924554503221,
       3.7634408632346643
      ],
      "p": 0.5517448255174483,
      "mid_p": 0.5166,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 5.05050505050505,
       "44": -2.7777777777777777
      },
      "p_het": 0.035396460353964605,
      "mdd80": 4.038240056801857,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.6790705544830133,
      "label_source": "no_detected_loss",
      "q": 0.6587997916626248,
      "label": "no_detected_loss",
      "q_prev": 0.6790705544830133,
      "label_prev": "no_detected_loss",
      "q_published": 0.6790705544830133,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.04)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 88.40277777777777,
      "mean_b": 88.92361111111111,
      "delta": -0.5208333333333334,
      "ci95": [
       -1.5625000011234553,
       0.5208333343159892
      ],
      "p": 0.36126387361263873,
      "mid_p": 0.32685,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -1.0416666666666667,
       "44": -0.10416666666666667
      },
      "p_het": 0.8274172582741726,
      "mdd80": 1.488965083799441,
      "key": [
       "nemotron3-nano",
       "aime25",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.49)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 206,
      "mean_a": 68.64904552129222,
      "mean_b": 69.60352422907489,
      "delta": -0.9544787077826725,
      "ci95": [
       -2.4691358040615237,
       0.5555555569819539
      ],
      "p": 0.23347665233476653,
      "mid_p": 0.2169,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": -2.092511013215859,
       "44": -0.3303964757709251
      },
      "p_het": 0.5782421757824218,
      "mdd80": 2.1617567142291105,
      "key": [
       "nemotron3-nano",
       "lcb",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.46695330466953305,
      "label_source": "no_detected_loss",
      "q": 0.4555641996775932,
      "label": "no_detected_loss",
      "q_prev": 0.46695330466953305,
      "label_prev": "no_detected_loss",
      "q_published": 0.46695330466953305,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.16)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 15,
      "a_only": 7,
      "b_only": 8,
      "mean_a": 3.745318352059925,
      "mean_b": 4.119850187265918,
      "rate_a": 3.745318352059925,
      "rate_b": 4.119850187265918,
      "delta": -0.37453183520599254,
      "ci95": [
       -3.0303030338813466,
       2.2727272753999577
      ],
      "p": 1.0,
      "mid_p": 0.7942,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 1.1235955056179776,
       "44": -5.617977528089888
      },
      "p_het": 0.0354964503549645,
      "mdd80": 3.7900929412164746,
      "key": [
       "nemotron3-nano",
       "tb",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.79)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 257,
      "a_only": 118,
      "b_only": 139,
      "mean_a": 20.533333333333335,
      "mean_b": 21.933333333333334,
      "rate_a": 20.53333333333333,
      "rate_b": 21.933333333333334,
      "delta": -1.4,
      "ci95": [
       -3.4578146632684277,
       0.6587615303583185
      ],
      "p": 0.206979302069793,
      "mid_p": 0.18595,
      "per_seed": {
       "42": -2.4,
       "43": -0.8,
       "44": -1.0
      },
      "p_het": 0.8216178382161784,
      "mdd80": 2.9421303412386135,
      "key": [
       "nemotron3-nano",
       "swe",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.447522815286039,
      "label_source": "no_detected_loss",
      "q": 0.42457292732265234,
      "label": "no_detected_loss",
      "q_prev": 0.447522815286039,
      "label_prev": "no_detected_loss",
      "q_published": 0.447522815286039,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.94)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 131,
      "mean_a": 70.70707070707071,
      "mean_b": 72.47474747474747,
      "delta": -1.7676767676767677,
      "ci95": [
       -4.761904764539125,
       1.215277780853518
      ],
      "p": 0.2733726627337266,
      "mid_p": 0.2492,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": 2.0202020202020203,
       "44": -3.787878787878788
      },
      "p_het": 0.1357864213578642,
      "mdd80": 4.271911728282236,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.520709833778527,
      "label_source": "no_detected_loss",
      "q": 0.5086003027604217,
      "label": "no_detected_loss",
      "q_prev": 0.520709833778527,
      "label_prev": "no_detected_loss",
      "q_published": 0.520709833778527,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.27)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 43,
      "mean_a": 71.80555555555556,
      "mean_b": 88.92361111111111,
      "delta": -17.118055555555557,
      "ci95": [
       -26.23697917519958,
       -8.124999986517375
      ],
      "p": 0.00019998000199980003,
      "mid_p": 5e-05,
      "per_seed": {
       "42": -16.458333333333332,
       "43": -16.458333333333332,
       "44": -18.4375
      },
      "p_het": 0.5497450254974503,
      "mdd80": 12.944690199929747,
      "key": [
       "nemotron3-nano",
       "aime25",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0009410823623520001,
      "label_source": "loss_detected",
      "q": 0.0009410823623520001,
      "label": "loss_detected",
      "q_prev": 0.0009410823623520001,
      "label_prev": "loss_detected",
      "q_published": 0.0009410823623520001,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0002, q 0.0009)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 289,
      "mean_a": 59.10425844346549,
      "mean_b": 69.60352422907489,
      "delta": -10.499265785609397,
      "ci95": [
       -12.820512823042321,
       -8.183183180818485
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -9.030837004405287,
       "43": -11.56387665198238,
       "44": -10.90308370044053
      },
      "p_het": 0.45925407459254075,
      "mdd80": 3.3143145179323827,
      "key": [
       "nemotron3-nano",
       "lcb",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 20,
      "a_only": 14,
      "b_only": 6,
      "mean_a": 7.116104868913857,
      "mean_b": 4.119850187265918,
      "rate_a": 7.116104868913858,
      "rate_b": 4.119850187265918,
      "delta": 2.9962546816479403,
      "ci95": [
       -0.7575757613739754,
       6.666666670290898
      ],
      "p": 0.1713828617138286,
      "mid_p": 0.11975,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 5.617977528089888,
       "44": 2.247191011235955
      },
      "p_het": 0.5657434256574343,
      "mdd80": 5.306130116753257,
      "key": [
       "nemotron3-nano",
       "tb",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.40325379226783203,
      "label_source": "no_detected_loss",
      "q": 0.38085080380850805,
      "label": "no_detected_loss",
      "q_prev": 0.40325379226783203,
      "label_prev": "no_detected_loss",
      "q_published": 0.40325379226783203,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.31)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 271,
      "a_only": 133,
      "b_only": 138,
      "mean_a": 21.6,
      "mean_b": 21.933333333333334,
      "rate_a": 21.599999999999998,
      "rate_b": 21.933333333333334,
      "delta": -0.3333333333333333,
      "ci95": [
       -2.4000000020581385,
       1.7333333353914715
      ],
      "p": 0.805919408059194,
      "mid_p": 0.7589,
      "per_seed": {
       "42": -1.4,
       "43": 0.2,
       "44": 0.2
      },
      "p_het": 0.7978202179782021,
      "mdd80": 2.954106726213602,
      "key": [
       "nemotron3-nano",
       "swe",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.89546600895466,
      "label_source": "no_detected_loss",
      "q": 0.8712642249288584,
      "label": "no_detected_loss",
      "q_prev": 0.89546600895466,
      "label_prev": "no_detected_loss",
      "q_published": 0.89546600895466,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.95)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 147,
      "mean_a": 74.41077441077441,
      "mean_b": 76.26262626262626,
      "delta": -1.8518518518518519,
      "ci95": [
       -4.833333336284078,
       1.1111111138935432
      ],
      "p": 0.24027597240275972,
      "mid_p": 0.2186,
      "per_seed": {
       "42": -3.282828282828283,
       "43": -3.5353535353535355,
       "44": 1.2626262626262625
      },
      "p_het": 0.2947705229477052,
      "mdd80": 4.2485137055769595,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.46883116566392136,
      "label_source": "no_detected_loss",
      "q": 0.45766851886239945,
      "label": "no_detected_loss",
      "q_prev": 0.46883116566392136,
      "label_prev": "no_detected_loss",
      "q_published": 0.46883116566392136,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.25)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 42,
      "mean_a": 85.83333333333333,
      "mean_b": 87.60416666666667,
      "delta": -1.7708333333333333,
      "ci95": [
       -3.6057692328957223,
       1.5673994204222452e-09
      ],
      "p": 0.0514948505149485,
      "mid_p": 0.04445,
      "per_seed": {
       "42": -3.125,
       "43": -1.5625,
       "44": -0.625
      },
      "p_het": 0.39206079392060794,
      "mdd80": 2.5770549527646067,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.14712814432842428,
      "label_source": "no_detected_loss",
      "q": 0.14205476004123724,
      "label": "no_detected_loss",
      "q_prev": 0.14712814432842428,
      "label_prev": "no_detected_loss",
      "q_published": 0.14712814432842428,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.58)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "quest_b2048_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 202,
      "mean_a": 77.45961820851689,
      "mean_b": 79.77239353891336,
      "delta": -2.3127753303964758,
      "ci95": [
       -4.035874441211674,
       -0.5925925908577527
      ],
      "p": 0.008999100089991,
      "mid_p": 0.00785,
      "per_seed": {
       "42": -1.8722466960352422,
       "43": -2.643171806167401,
       "44": -2.4229074889867843
      },
      "p_het": 0.9123087691230877,
      "mdd80": 2.4609246929636828,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "quest_b2048_s1",
       "bf16"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.034663200346632006,
      "label_source": "loss_detected",
      "q": 0.033087600330876,
      "label": "loss_detected",
      "q_prev": 0.034663200346632006,
      "label_prev": "loss_detected",
      "q_published": 0.034663200346632006,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.00900, q 0.0331)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 17,
      "b_only": 26,
      "mean_a": 20.59925093632959,
      "mean_b": 23.970037453183522,
      "rate_a": 20.59925093632959,
      "rate_b": 23.970037453183522,
      "delta": -3.3707865168539324,
      "ci95": [
       -9.09090909669776,
       2.3809523870458635
      ],
      "p": 0.3200679932006799,
      "mid_p": 0.26505,
      "per_seed": {
       "42": -5.617977528089888,
       "43": -1.1235955056179776,
       "44": -3.3707865168539324
      },
      "p_het": 0.7334266573342666,
      "mdd80": 8.198976565540775,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.20)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "quest_b2048_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 267,
      "a_only": 94,
      "b_only": 173,
      "mean_a": 43.13333333333333,
      "mean_b": 48.4,
      "rate_a": 43.13333333333333,
      "rate_b": 48.400000000000006,
      "delta": -5.266666666666667,
      "ci95": [
       -7.607192256919701,
       -2.945113786163665
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -5.2,
       "43": -4.4,
       "44": -6.2
      },
      "p_het": 0.787921207879212,
      "mdd80": 3.332002585858206,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "quest_b2048_s1",
       "dense_s1"
      ],
      "row_arm": "quest_b2048_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 134,
      "mean_a": 75.08417508417509,
      "mean_b": 76.26262626262626,
      "delta": -1.1784511784511784,
      "ci95": [
       -3.639846746093883,
       1.2820512843846628
      ],
      "p": 0.38906109389061094,
      "mid_p": 0.35275,
      "per_seed": {
       "42": -2.7777777777777777,
       "43": -3.0303030303030303,
       "44": 2.272727272727273
      },
      "p_het": 0.18318168183181682,
      "mdd80": 3.5176964668776627,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.545030242738438,
      "label_source": "no_detected_loss",
      "q": 0.5271603987142269,
      "label": "no_detected_loss",
      "q_prev": 0.545030242738438,
      "label_prev": "no_detected_loss",
      "q_published": 0.545030242738438,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.52)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 42,
      "mean_a": 88.19444444444444,
      "mean_b": 87.60416666666667,
      "delta": 0.5902777777777778,
      "ci95": [
       -0.6510416678359505,
       1.8429487194032808
      ],
      "p": 0.3972602739726027,
      "mid_p": 0.36745,
      "per_seed": {
       "42": 1.6666666666666667,
       "43": 0.10416666666666667,
       "44": 0.0
      },
      "p_het": 0.3234676532346765,
      "mdd80": 1.7824630090447664,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.545030242738438,
      "label_source": "no_detected_loss",
      "q": 0.5271603987142269,
      "label": "no_detected_loss",
      "q_prev": 0.545030242738438,
      "label_prev": "no_detected_loss",
      "q_published": 0.545030242738438,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.78)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "sparq_c8_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 192,
      "mean_a": 79.00146842878121,
      "mean_b": 79.77239353891336,
      "delta": -0.7709251101321586,
      "ci95": [
       -2.2935779832319323,
       0.7473841570011153
      ],
      "p": 0.3447655234476552,
      "mid_p": 0.32235,
      "per_seed": {
       "42": -0.5506607929515418,
       "43": -0.8810572687224669,
       "44": -0.8810572687224669
      },
      "p_het": 0.9848015198480152,
      "mdd80": 2.1733854928251053,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "sparq_c8_s1",
       "bf16"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.17)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 18,
      "b_only": 25,
      "mean_a": 21.348314606741575,
      "mean_b": 23.970037453183522,
      "rate_a": 21.34831460674157,
      "rate_b": 23.970037453183522,
      "delta": -2.6217228464419478,
      "ci95": [
       -7.246376816055165,
       2.040816330762709
      ],
      "p": 0.35236476352364765,
      "mid_p": 0.279,
      "per_seed": {
       "42": -7.865168539325842,
       "43": -1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.31656834316568344,
      "mdd80": 6.63758702790421,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.64)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "sparq_c8_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 323,
      "a_only": 85,
      "b_only": 238,
      "mean_a": 38.2,
      "mean_b": 48.4,
      "rate_a": 38.199999999999996,
      "rate_b": 48.400000000000006,
      "delta": -10.2,
      "ci95": [
       -12.820512823161254,
       -7.563025207319987
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -8.8,
       "43": -11.0,
       "44": -10.8
      },
      "p_het": 0.6626337366263374,
      "mdd80": 3.757543430679269,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "sparq_c8_s1",
       "dense_s1"
      ],
      "row_arm": "sparq_c8_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 138,
      "mean_a": 75.42087542087542,
      "mean_b": 76.26262626262626,
      "delta": -0.8417508417508418,
      "ci95": [
       -3.44202898830597,
       1.7857142880276953
      ],
      "p": 0.5718428157184282,
      "mid_p": 0.53155,
      "per_seed": {
       "42": -5.303030303030303,
       "43": 1.0101010101010102,
       "44": 1.7676767676767677
      },
      "p_het": 0.054094590540945904,
      "mdd80": 3.736285054876362,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.6931428069314282,
      "label_source": "no_detected_loss",
      "q": 0.6727562537863861,
      "label": "no_detected_loss",
      "q_prev": 0.6931428069314282,
      "label_prev": "no_detected_loss",
      "q_published": 0.6931428069314282,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.74)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 39,
      "mean_a": 88.125,
      "mean_b": 87.60416666666667,
      "delta": 0.5208333333333334,
      "ci95": [
       -0.42892156947436433,
       1.4583333342791525
      ],
      "p": 0.3127687231276872,
      "mid_p": 0.27905,
      "per_seed": {
       "42": 1.0416666666666667,
       "43": -0.10416666666666667,
       "44": 0.625
      },
      "p_het": 0.7221277872212779,
      "mdd80": 1.348827193477191,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.35)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "loki_k25_d25_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 184,
      "mean_a": 78.56093979441997,
      "mean_b": 79.77239353891336,
      "delta": -1.2114537444933922,
      "ci95": [
       -2.61136712896001,
       0.16025641175087524
      ],
      "p": 0.1014898510148985,
      "mid_p": 0.0907,
      "per_seed": {
       "42": -0.5506607929515418,
       "43": -1.3215859030837005,
       "44": -1.7621145374449338
      },
      "p_het": 0.795020497950205,
      "mdd80": 1.9808883232238954,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "loki_k25_d25_s1",
       "bf16"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.27063960270639603,
      "label_source": "no_detected_loss",
      "q": 0.2619092929416736,
      "label": "no_detected_loss",
      "q_prev": 0.27063960270639603,
      "label_prev": "no_detected_loss",
      "q_published": 0.27063960270639603,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 25,
      "b_only": 18,
      "mean_a": 26.591760299625467,
      "mean_b": 23.970037453183522,
      "rate_a": 26.591760299625467,
      "rate_b": 23.970037453183522,
      "delta": 2.6217228464419478,
      "ci95": [
       -2.222222227014214,
       7.407407412132084
      ],
      "p": 0.3548645135486451,
      "mid_p": 0.28555,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 1.1235955056179776,
       "44": 2.247191011235955
      },
      "p_het": 0.8959104089591041,
      "mdd80": 6.882327498294768,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.5372319910866057,
      "label_source": "no_detected_loss",
      "q": 0.5185446367643938,
      "label": "no_detected_loss",
      "q_prev": 0.5372319910866057,
      "label_prev": "no_detected_loss",
      "q_published": 0.5372319910866057,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.88)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "loki_k25_d25_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 227,
      "a_only": 124,
      "b_only": 103,
      "mean_a": 49.8,
      "mean_b": 48.4,
      "rate_a": 49.79999999999999,
      "rate_b": 48.400000000000006,
      "delta": 1.4,
      "ci95": [
       -0.5925925948003573,
       3.401360546254811
      ],
      "p": 0.19088091190880913,
      "mid_p": 0.17175,
      "per_seed": {
       "42": 3.6,
       "43": 0.8,
       "44": -0.2
      },
      "p_het": 0.28287171282871715,
      "mdd80": 2.854491248328179,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "loki_k25_d25_s1",
       "dense_s1"
      ],
      "row_arm": "loki_k25_d25_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.424179804241798,
      "label_source": "no_detected_loss",
      "q": 0.4018545513869666,
      "label": "no_detected_loss",
      "q_prev": 0.424179804241798,
      "label_prev": "no_detected_loss",
      "q_published": 0.424179804241798,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.85)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 135,
      "mean_a": 72.89562289562289,
      "mean_b": 76.26262626262626,
      "delta": -3.367003367003367,
      "ci95": [
       -5.992509366214071,
       -0.7326007297418518
      ],
      "p": 0.012798720127987202,
      "mid_p": 0.0103,
      "per_seed": {
       "42": -2.7777777777777777,
       "43": -4.545454545454546,
       "44": -2.7777777777777777
      },
      "p_het": 0.8289171082891711,
      "mdd80": 3.75927374196711,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.042662400426624,
      "label_source": "loss_detected",
      "q": 0.04095590440955904,
      "label": "loss_detected",
      "q_prev": 0.042662400426624,
      "label_prev": "loss_detected",
      "q_published": 0.042662400426624,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0128, q 0.0410)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 50,
      "mean_a": 72.70833333333333,
      "mean_b": 87.60416666666667,
      "delta": -14.895833333333334,
      "ci95": [
       -24.10714286700908,
       -5.763888879752601
      ],
      "p": 0.00019998000199980003,
      "mid_p": 0.0001,
      "per_seed": {
       "42": -15.208333333333334,
       "43": -15.520833333333334,
       "44": -13.958333333333334
      },
      "p_het": 0.6762323767623237,
      "mdd80": 13.109983047685773,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0009410823623520001,
      "label_source": "loss_detected",
      "q": 0.0009410823623520001,
      "label": "loss_detected",
      "q_prev": 0.0009410823623520001,
      "label_prev": "loss_detected",
      "q_published": 0.0009410823623520001,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0002, q 0.0009)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "tri_b4096_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 251,
      "mean_a": 69.38325991189427,
      "mean_b": 79.77239353891336,
      "delta": -10.38913362701909,
      "ci95": [
       -12.57062147101926,
       -8.218125957793351
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -9.140969162995594,
       "43": -11.45374449339207,
       "44": -10.572687224669604
      },
      "p_het": 0.45485451454854514,
      "mdd80": 3.1107426432170575,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "tri_b4096_s1",
       "bf16"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.0005713714342851429,
      "label_source": "loss_detected",
      "q": 0.0005713714342851429,
      "label": "loss_detected",
      "q_prev": 0.0005713714342851429,
      "label_prev": "loss_detected",
      "q_published": 0.0005713714342851429,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0006)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 32,
      "a_only": 15,
      "b_only": 17,
      "mean_a": 23.220973782771537,
      "mean_b": 23.970037453183522,
      "rate_a": 23.220973782771534,
      "rate_b": 23.970037453183522,
      "delta": -0.7490636704119851,
      "ci95": [
       -5.072463772282192,
       3.6036036088308303
      ],
      "p": 0.8659134086591341,
      "mid_p": 0.74335,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 3.3707865168539324,
       "44": -4.49438202247191
      },
      "p_het": 0.3394660533946605,
      "mdd80": 6.200813463412293,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "source_md5": "1ded660f60eb0e62be283230fcf20064",
      "q_source": 0.9361226039558208,
      "label_source": "no_detected_loss",
      "q": 0.9236409692364098,
      "label": "no_detected_loss",
      "q_prev": 0.9361226039558208,
      "label_prev": "no_detected_loss",
      "q_published": 0.9361226039558208,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.20)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "tri_b4096_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 231,
      "a_only": 111,
      "b_only": 120,
      "mean_a": 47.8,
      "mean_b": 48.4,
      "rate_a": 47.800000000000004,
      "rate_b": 48.400000000000006,
      "delta": -0.6,
      "ci95": [
       -2.61707989188724,
       1.400560226187191
      ],
      "p": 0.6005399460053995,
      "mid_p": 0.557,
      "per_seed": {
       "42": 1.0,
       "43": 0.2,
       "44": -3.0
      },
      "p_het": 0.2323767623237676,
      "mdd80": 2.871420407537837,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "tri_b4096_s1",
       "dense_s1"
      ],
      "row_arm": "tri_b4096_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines.json",
      "source_md5": "43f941cb31291a43abf467ac32990a9e",
      "q_source": 0.7170626220959995,
      "label_source": "no_detected_loss",
      "q": 0.6962781982671299,
      "label": "no_detected_loss",
      "q_prev": 0.7170626220959995,
      "label_prev": "no_detected_loss",
      "q_published": 0.7170626220959995,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.87)"
     }
    ],
    "counts": {
     "m": 80,
     "by_bench": {
      "gpqa": 16,
      "aime25": 16,
      "lcb": 16,
      "tb": 16,
      "swe": 16
     },
     "n_p05": 27,
     "n_p05_below": 26,
     "n_p05_above": 1,
     "loss_detected": 26,
     "nominal_loss": 0,
     "gain_detected": 1,
     "nominal_gain": 0,
     "no_detected_loss": 53,
     "smallest_q_below": 0.0005713714342851429
    },
    "counts_prev": {
     "m": 80,
     "by_bench": {
      "gpqa": 16,
      "aime25": 16,
      "lcb": 16,
      "tb": 16,
      "swe": 16
     },
     "n_p05": 27,
     "n_p05_below": 26,
     "n_p05_above": 1,
     "loss_detected": 26,
     "nominal_loss": 0,
     "gain_detected": 0,
     "nominal_gain": 0,
     "no_detected_loss": 54,
     "smallest_q_below": 0.0005713714342851429
    },
    "label_changes": [
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "sparq_c8_s1_sxs",
       "dense_sxs"
      ],
      "source": "sxs",
      "delta": 2.0777479892761392,
      "p": 0.007499250074992501,
      "q_prev": 0.46695330466953305,
      "q": 0.02999700029997,
      "label_prev": "no_detected_loss",
      "label": "gain_detected"
     }
    ],
    "sources": [
     {
      "source": "published",
      "file": "log/sparse/dev/stats/paired_baselines.json",
      "md5": "43f941cb31291a43abf467ac32990a9e",
      "members": 60
     },
     {
      "source": "tbp v1",
      "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json",
      "md5": "1ded660f60eb0e62be283230fcf20064",
      "members": 16
     },
     {
      "source": "sxs",
      "file": null,
      "md5": null,
      "members": 4
     }
    ],
    "ruler": {
     "unchanged": true,
     "m": 16,
     "source": "log/sparse/dev/stats/paired_baselines.json",
     "why": "no RULER member is replaced: RULER keeps its own BH (prereg family_bh)"
    },
    "arm_status": [
     {
      "model": "qwen3.8-27b",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb",
       "tb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.0101010101010102,
        "ci95": [
         -2.7491408952443113,
         0.7017543877466391
        ],
        "p": 0.30026997300269975,
        "q": 0.5185446367643938,
        "mdd80": 2.4663660379330916,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.8680555555555556,
        "ci95": [
         -2.3237179504085157,
         0.4807692323363273
        ],
        "p": 0.3243675632436756,
        "q": 0.5185446367643938,
        "mdd80": 2.0043760746473733,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -5.176211453744493,
        "ci95": [
         -7.1637426920305,
         -3.1931464153484086
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 2.83779802169615,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -42.32209737827716,
        "ci95": [
         -50.79365080261101,
         -34.042553183677484
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 11.97206373345287,
        "verdict": "loss_detected",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -84.5718329794763,
        "ci95": [
         -87.29508196983062,
         -81.84523809237905
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.8950210739904962,
        "verdict": "loss_detected",
        "source": "sxs"
       }
      },
      "status_text": "loss detected (LCB v6, Terminal-Bench 2.1, SWE-bench Verified)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "sparq_c8_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": -0.8417508417508418,
        "ci95": [
         -2.4752475263505405,
         0.8090614902600897
        ],
        "p": 0.3665633436656334,
        "q": 0.5185446367643938,
        "mdd80": 2.3473062936946647,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3125,
        "ci95": [
         -1.3257575771524501,
         0.5208333343862288
        ],
        "p": 0.9125087491250875,
        "q": 0.951697038088399,
        "mdd80": 1.319764506510194,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.9177679882525698,
        "ci95": [
         -0.7735583701096074,
         2.5974025990536616
        ],
        "p": 0.31226877312268775,
        "q": 0.5185446367643938,
        "mdd80": 2.409236724893141,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.247191011235955,
        "ci95": [
         -2.8985507296163715,
         7.407407412513095
        ],
        "p": 0.4657534246575342,
        "q": 0.5821917808219178,
        "mdd80": 7.365701670343845,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.0777479892761392,
        "ci95": [
         0.5755395667358043,
         3.5612535628283317
        ],
        "p": 0.007499250074992501,
        "q": 0.02999700029997,
        "mdd80": 2.133899465231445,
        "verdict": "gain_detected",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.35, AIME25 1.32, LCB v6 2.41, Terminal-Bench 2.1 7.37, SWE-bench Verified 2.13)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "loki_k25_d25_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.3367003367003367,
        "ci95": [
         -1.14379085110805,
         1.8333333348144374
        ],
        "p": 0.7471252874712528,
        "q": 0.8418313098267637,
        "mdd80": 2.127760300076217,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.8680555555555556,
        "ci95": [
         -1.996527779199361,
         0.14880952490630892
        ],
        "p": 0.1406859314068593,
        "q": 0.331025720957316,
        "mdd80": 1.5332795210671242,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.11013215859030837,
        "ci95": [
         -1.2931034496447582,
         1.507936509447021
        ],
        "p": 0.916008399160084,
        "q": 0.951697038088399,
        "mdd80": 2.0019123327352433,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.247191011235955,
        "ci95": [
         -3.333333339538966,
         7.801418444961817
        ],
        "p": 0.5097490250974902,
        "q": 0.6273834155046033,
        "mdd80": 7.958043171424635,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.2717536813922357,
        "ci95": [
         -0.28735632350657414,
         2.8688524606413104
        ],
        "p": 0.13928607139286073,
        "q": 0.331025720957316,
        "mdd80": 2.255752642572682,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.13, AIME25 1.53, LCB v6 2.00, Terminal-Bench 2.1 7.96, SWE-bench Verified 2.26)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.6835016835016836,
        "ci95": [
         -3.703703706167718,
         0.3367003387221277
        ],
        "p": 0.1227877212278772,
        "q": 0.306969303069693,
        "mdd80": 2.887689859776582,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -19.96527777777778,
        "ci95": [
         -31.696428583965925,
         -8.333333318829517
        ],
        "p": 0.00019998000199980003,
        "q": 0.0009410823623520001,
        "mdd80": 16.69767987076847,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -20.301027900146842,
        "ci95": [
         -23.611111114234255,
         -17.030567682354253
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 4.703135708443076,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -2.3255814008439457,
         8.333333338275965
        ],
        "p": 0.3344665533446655,
        "q": 0.5185446367643938,
        "mdd80": 7.617960893616241,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8059100067159167,
        "ci95": [
         -0.7564296537988717,
         2.3643949946574
        ],
        "p": 0.34906509349065096,
        "q": 0.5185446367643938,
        "mdd80": 2.2304634861669355,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "loss detected (AIME25, LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -2.7777777777777777,
        "ci95": [
         -5.188679247533257,
         -0.3472222197249011
        ],
        "p": 0.027497250274972504,
        "q": 0.08147333414806669,
        "mdd80": 3.460205021680552,
        "verdict": "loss_detected",
        "source": "published"
       },
       "aime25": {
        "delta": -15.694444444444445,
        "ci95": [
         -24.826388900280406,
         -6.650641015200971
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 12.990265893823617,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -19.86049926578561,
        "ci95": [
         -22.77091906993387,
         -16.957787478933156
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 4.154663979735059,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -19.475655430711612,
        "ci95": [
         -25.58139535514439,
         -13.333333327888639
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 8.753729608491495,
        "verdict": "loss_detected",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -49.06666666666667,
        "ci95": [
         -52.82485876104211,
         -45.30612244514715
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 5.37366520192555,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (GPQA, AIME25, LCB v6, Terminal-Bench 2.1, SWE-bench Verified)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "sparq_c8_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.7676767676767677,
        "ci95": [
         -4.28134556803071,
         0.7407407434962936
        ],
        "p": 0.18958104189581043,
        "q": 0.4018545513869666,
        "mdd80": 3.589301355903054,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.6944444444444444,
        "ci95": [
         -2.483974361049123,
         1.0416666684090128
        ],
        "p": 0.5264473552644735,
        "q": 0.63811800638118,
        "mdd80": 2.5197870650721255,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.7988252569750367,
        "ci95": [
         -3.571428573117547,
         1.7298375105492156e-09
        ],
        "p": 0.050994900509949,
        "q": 0.14205476004123724,
        "mdd80": 2.5525115720906304,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.4981273408239701,
        "ci95": [
         -7.092198586857561,
         4.166666671918152
        ],
        "p": 0.6927307269273073,
        "q": 0.791692259345494,
        "mdd80": 8.04674747355468,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8666666666666667,
        "ci95": [
         -0.9259259276982204,
         2.6315789493039308
        ],
        "p": 0.37606239376062395,
        "q": 0.5187067500146537,
        "mdd80": 2.542560260134806,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.59, AIME25 2.52, LCB v6 2.55, Terminal-Bench 2.1 8.05, SWE-bench Verified 2.54)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "loki_k25_d25_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.4208754208754209,
        "ci95": [
         -2.8846153869517766,
         2.0599250963863476
        ],
        "p": 0.7954204579542046,
        "q": 0.8712642249288584,
        "mdd80": 3.533879101286657,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.4861111111111111,
        "ci95": [
         -0.1602564110125368,
         1.1217948725388331
        ],
        "p": 0.17098290170982902,
        "q": 0.38085080380850805,
        "mdd80": 0.9162862055608539,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.23935389133627,
        "ci95": [
         -4.092261906639887,
         -0.38051750188418
        ],
        "p": 0.020497950204979503,
        "q": 0.06307061601532155,
        "mdd80": 2.6527957502794104,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -2.247191011235955,
        "ci95": [
         -6.14035088174198,
         1.6260162643650804
        ],
        "p": 0.3391660833916608,
        "q": 0.5185446367643938,
        "mdd80": 5.550647758478516,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8,
        "ci95": [
         -0.8196721328024502,
         2.426564497088632
        ],
        "p": 0.36946305369463056,
        "q": 0.5185446367643938,
        "mdd80": 2.320095835570661,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "gpqa",
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -3.6195286195286194,
        "ci95": [
         -6.378600826417472,
         -0.8680555527262774
        ],
        "p": 0.011498850114988501,
        "q": 0.038329500383295,
        "mdd80": 3.9384045585252023,
        "verdict": "loss_detected",
        "source": "published"
       },
       "aime25": {
        "delta": -28.125,
        "ci95": [
         -39.772727288615705,
         -16.66666665102798
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 16.513976389795438,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -6.644640234948605,
        "ci95": [
         -8.946608948869727,
         -4.354354352015381
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.2820992369861437,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -4.444444449196073,
         5.185185189935703
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 6.88232749828439,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8,
        "ci95": [
         -0.9222661413557368,
         2.5232403735601534
        ],
        "p": 0.41025897410258977,
        "q": 0.52936641819689,
        "mdd80": 2.4625146679329255,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (GPQA, AIME25, LCB v6)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "aime25",
       "lcb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.08417508417508418,
        "ci95": [
         -2.9824561433614933,
         2.807017546867923
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.137755601414013,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -3.4375,
        "ci95": [
         -5.9659090943669355,
         -0.892857140120187
        ],
        "p": 0.0013998600139986002,
        "q": 0.005894147427362527,
        "mdd80": 3.6257266658581173,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -2.202643171806167,
        "ci95": [
         -3.8179148327437407,
         -0.5804311756194442
        ],
        "p": 0.009099090090990901,
        "q": 0.033087600330876,
        "mdd80": 2.313840057578973,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 0.7490636704119851,
        "ci95": [
         -2.0408163290556454,
         3.508771933054236
        ],
        "p": 0.8012198780121987,
        "q": 0.8712642249288584,
        "mdd80": 3.966308708827846,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -2.6,
        "ci95": [
         -4.521963826150607,
         -0.6802721068892984
        ],
        "p": 0.0100989901009899,
        "q": 0.03512692209039965,
        "mdd80": 2.7456695169210468,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (AIME25, LCB v6, SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "sparq_c8_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.2626262626262625,
        "ci95": [
         -4.1218638023229905,
         1.6304347857217778
        ],
        "p": 0.42475752424757524,
        "q": 0.5393746339651749,
        "mdd80": 4.111186435453857,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.7708333333333333,
        "ci95": [
         -3.7109375018262867,
         0.16025641249069347
        ],
        "p": 0.08709129087091291,
        "q": 0.23224344232243446,
        "mdd80": 2.766754831299732,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9544787077826725,
        "ci95": [
         -2.444444445943024,
         0.5208333346404521
        ],
        "p": 0.22947705229477053,
        "q": 0.4555641996775932,
        "mdd80": 2.1192936358039813,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.4981273408239701,
        "ci95": [
         -4.065040653194817,
         0.8547008573805842
        ],
        "p": 0.401959804019598,
        "q": 0.5271603987142269,
        "mdd80": 3.516155195116837,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -4.2,
        "ci95": [
         -6.349206351337289,
         -2.074688794484463
        ],
        "p": 0.00029997000299970003,
        "q": 0.001333200013332,
        "mdd80": 3.05501154518753,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "loki_k25_d25_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.9259259259259259,
        "ci95": [
         -1.8867924554503221,
         3.7634408632346643
        ],
        "p": 0.5517448255174483,
        "q": 0.6587997916626248,
        "mdd80": 4.038240056801857,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5208333333333334,
        "ci95": [
         -1.5625000011234553,
         0.5208333343159892
        ],
        "p": 0.36126387361263873,
        "q": 0.5185446367643938,
        "mdd80": 1.488965083799441,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9544787077826725,
        "ci95": [
         -2.4691358040615237,
         0.5555555569819539
        ],
        "p": 0.23347665233476653,
        "q": 0.4555641996775932,
        "mdd80": 2.1617567142291105,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -3.0303030338813466,
         2.2727272753999577
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 3.7900929412164746,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.4,
        "ci95": [
         -3.4578146632684277,
         0.6587615303583185
        ],
        "p": 0.206979302069793,
        "q": 0.42457292732265234,
        "mdd80": 2.9421303412386135,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 4.04, AIME25 1.49, LCB v6 2.16, Terminal-Bench 2.1 3.79, SWE-bench Verified 2.94)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.7676767676767677,
        "ci95": [
         -4.761904764539125,
         1.215277780853518
        ],
        "p": 0.2733726627337266,
        "q": 0.5086003027604217,
        "mdd80": 4.271911728282236,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -17.118055555555557,
        "ci95": [
         -26.23697917519958,
         -8.124999986517375
        ],
        "p": 0.00019998000199980003,
        "q": 0.0009410823623520001,
        "mdd80": 12.944690199929747,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -10.499265785609397,
        "ci95": [
         -12.820512823042321,
         -8.183183180818485
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.3143145179323827,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -0.7575757613739754,
         6.666666670290898
        ],
        "p": 0.1713828617138286,
        "q": 0.38085080380850805,
        "mdd80": 5.306130116753257,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.3333333333333333,
        "ci95": [
         -2.4000000020581385,
         1.7333333353914715
        ],
        "p": 0.805919408059194,
        "q": 0.8712642249288584,
        "mdd80": 2.954106726213602,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (AIME25, LCB v6)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.8518518518518519,
        "ci95": [
         -4.833333336284078,
         1.1111111138935432
        ],
        "p": 0.24027597240275972,
        "q": 0.45766851886239945,
        "mdd80": 4.2485137055769595,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.7708333333333333,
        "ci95": [
         -3.6057692328957223,
         1.5673994204222452e-09
        ],
        "p": 0.0514948505149485,
        "q": 0.14205476004123724,
        "mdd80": 2.5770549527646067,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.3127753303964758,
        "ci95": [
         -4.035874441211674,
         -0.5925925908577527
        ],
        "p": 0.008999100089991,
        "q": 0.033087600330876,
        "mdd80": 2.4609246929636828,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -3.3707865168539324,
        "ci95": [
         -9.09090909669776,
         2.3809523870458635
        ],
        "p": 0.3200679932006799,
        "q": 0.5185446367643938,
        "mdd80": 8.198976565540775,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -5.266666666666667,
        "ci95": [
         -7.607192256919701,
         -2.945113786163665
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.332002585858206,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (LCB v6, SWE-bench Verified)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "sparq_c8_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.1784511784511784,
        "ci95": [
         -3.639846746093883,
         1.2820512843846628
        ],
        "p": 0.38906109389061094,
        "q": 0.5271603987142269,
        "mdd80": 3.5176964668776627,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.5902777777777778,
        "ci95": [
         -0.6510416678359505,
         1.8429487194032808
        ],
        "p": 0.3972602739726027,
        "q": 0.5271603987142269,
        "mdd80": 1.7824630090447664,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.7709251101321586,
        "ci95": [
         -2.2935779832319323,
         0.7473841570011153
        ],
        "p": 0.3447655234476552,
        "q": 0.5185446367643938,
        "mdd80": 2.1733854928251053,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -7.246376816055165,
         2.040816330762709
        ],
        "p": 0.35236476352364765,
        "q": 0.5185446367643938,
        "mdd80": 6.63758702790421,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -10.2,
        "ci95": [
         -12.820512823161254,
         -7.563025207319987
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.757543430679269,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (SWE-bench Verified)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "loki_k25_d25_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.8417508417508418,
        "ci95": [
         -3.44202898830597,
         1.7857142880276953
        ],
        "p": 0.5718428157184282,
        "q": 0.6727562537863861,
        "mdd80": 3.736285054876362,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.5208333333333334,
        "ci95": [
         -0.42892156947436433,
         1.4583333342791525
        ],
        "p": 0.3127687231276872,
        "q": 0.5185446367643938,
        "mdd80": 1.348827193477191,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.2114537444933922,
        "ci95": [
         -2.61136712896001,
         0.16025641175087524
        ],
        "p": 0.1014898510148985,
        "q": 0.2619092929416736,
        "mdd80": 1.9808883232238954,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.6217228464419478,
        "ci95": [
         -2.222222227014214,
         7.407407412132084
        ],
        "p": 0.3548645135486451,
        "q": 0.5185446367643938,
        "mdd80": 6.882327498294768,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.4,
        "ci95": [
         -0.5925925948003573,
         3.401360546254811
        ],
        "p": 0.19088091190880913,
        "q": 0.4018545513869666,
        "mdd80": 2.854491248328179,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.74, AIME25 1.35, LCB v6 1.98, Terminal-Bench 2.1 6.88, SWE-bench Verified 2.85)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "gpqa",
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -3.367003367003367,
        "ci95": [
         -5.992509366214071,
         -0.7326007297418518
        ],
        "p": 0.012798720127987202,
        "q": 0.04095590440955904,
        "mdd80": 3.75927374196711,
        "verdict": "loss_detected",
        "source": "published"
       },
       "aime25": {
        "delta": -14.895833333333334,
        "ci95": [
         -24.10714286700908,
         -5.763888879752601
        ],
        "p": 0.00019998000199980003,
        "q": 0.0009410823623520001,
        "mdd80": 13.109983047685773,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -10.38913362701909,
        "ci95": [
         -12.57062147101926,
         -8.218125957793351
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.1107426432170575,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -0.7490636704119851,
        "ci95": [
         -5.072463772282192,
         3.6036036088308303
        ],
        "p": 0.8659134086591341,
        "q": 0.9236409692364098,
        "mdd80": 6.200813463412293,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.6,
        "ci95": [
         -2.61707989188724,
         1.400560226187191
        ],
        "p": 0.6005399460053995,
        "q": 0.6962781982671299,
        "mdd80": 2.871420407537837,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (GPQA, AIME25, LCB v6)"
     }
    ],
    "arm_status_prev": [
     {
      "model": "qwen3.8-27b",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb",
       "tb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.0101010101010102,
        "ci95": [
         -2.7491408952443113,
         0.7017543877466391
        ],
        "p": 0.30026997300269975,
        "q": 0.5372319910866057,
        "mdd80": 2.4663660379330916,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.8680555555555556,
        "ci95": [
         -2.3237179504085157,
         0.4807692323363273
        ],
        "p": 0.3243675632436756,
        "q": 0.5372319910866057,
        "mdd80": 2.0043760746473733,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -5.176211453744493,
        "ci95": [
         -7.1637426920305,
         -3.1931464153484086
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 2.83779802169615,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -42.32209737827716,
        "ci95": [
         -50.79365080261101,
         -34.042553183677484
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 11.97206373345287,
        "verdict": "loss_detected",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -84.5718329794763,
        "ci95": [
         -87.29508196983062,
         -81.84523809237905
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.8950210739904962,
        "verdict": "loss_detected",
        "source": "sxs"
       }
      },
      "status_text": "loss detected (LCB v6, Terminal-Bench 2.1, SWE-bench Verified)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "sparq_c8_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.8417508417508418,
        "ci95": [
         -2.4752475263505405,
         0.8090614902600897
        ],
        "p": 0.3665633436656334,
        "q": 0.5372319910866057,
        "mdd80": 2.3473062936946647,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3125,
        "ci95": [
         -1.3257575771524501,
         0.5208333343862288
        ],
        "p": 0.9125087491250875,
        "q": 0.9642193675369306,
        "mdd80": 1.319764506510194,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.9177679882525698,
        "ci95": [
         -0.7735583701096074,
         2.5974025990536616
        ],
        "p": 0.31226877312268775,
        "q": 0.5372319910866057,
        "mdd80": 2.409236724893141,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.247191011235955,
        "ci95": [
         -2.8985507296163715,
         7.407407412513095
        ],
        "p": 0.4657534246575342,
        "q": 0.6009721608484313,
        "mdd80": 7.365701670343845,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.0777479892761392,
        "ci95": [
         0.5755395667358043,
         3.5612535628283317
        ],
        "p": 0.007499250074992501,
        "q": 0.46695330466953305,
        "mdd80": 2.133899465231445,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.35, AIME25 1.32, LCB v6 2.41, Terminal-Bench 2.1 7.37, SWE-bench Verified 2.13)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "loki_k25_d25_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.3367003367003367,
        "ci95": [
         -1.14379085110805,
         1.8333333348144374
        ],
        "p": 0.7471252874712528,
        "q": 0.8662322173579743,
        "mdd80": 2.127760300076217,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.8680555555555556,
        "ci95": [
         -1.996527779199361,
         0.14880952490630892
        ],
        "p": 0.1406859314068593,
        "q": 0.3517148285171483,
        "mdd80": 1.5332795210671242,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.11013215859030837,
        "ci95": [
         -1.2931034496447582,
         1.507936509447021
        ],
        "p": 0.916008399160084,
        "q": 0.9642193675369306,
        "mdd80": 2.0019123327352433,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.247191011235955,
        "ci95": [
         -3.333333339538966,
         7.801418444961817
        ],
        "p": 0.5097490250974902,
        "q": 0.6473003493301462,
        "mdd80": 7.958043171424635,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.2717536813922357,
        "ci95": [
         -0.28735632350657414,
         2.8688524606413104
        ],
        "p": 0.13928607139286073,
        "q": 0.903142562456083,
        "mdd80": 2.255752642572682,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.13, AIME25 1.53, LCB v6 2.00, Terminal-Bench 2.1 7.96, SWE-bench Verified 2.26)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.6835016835016836,
        "ci95": [
         -3.703703706167718,
         0.3367003387221277
        ],
        "p": 0.1227877212278772,
        "q": 0.3168715386525863,
        "mdd80": 2.887689859776582,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -19.96527777777778,
        "ci95": [
         -31.696428583965925,
         -8.333333318829517
        ],
        "p": 0.00019998000199980003,
        "q": 0.0009410823623520001,
        "mdd80": 16.69767987076847,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -20.301027900146842,
        "ci95": [
         -23.611111114234255,
         -17.030567682354253
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 4.703135708443076,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -2.3255814008439457,
         8.333333338275965
        ],
        "p": 0.3344665533446655,
        "q": 0.5372319910866057,
        "mdd80": 7.617960893616241,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8059100067159167,
        "ci95": [
         -0.7564296537988717,
         2.3643949946574
        ],
        "p": 0.34906509349065096,
        "q": 0.9746557811751293,
        "mdd80": 2.2304634861669355,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "loss detected (AIME25, LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -2.7777777777777777,
        "ci95": [
         -5.188679247533257,
         -0.3472222197249011
        ],
        "p": 0.027497250274972504,
        "q": 0.08460692392299232,
        "mdd80": 3.460205021680552,
        "verdict": "loss_detected",
        "source": "published"
       },
       "aime25": {
        "delta": -15.694444444444445,
        "ci95": [
         -24.826388900280406,
         -6.650641015200971
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 12.990265893823617,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -19.86049926578561,
        "ci95": [
         -22.77091906993387,
         -16.957787478933156
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 4.154663979735059,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -19.475655430711612,
        "ci95": [
         -25.58139535514439,
         -13.333333327888639
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 8.753729608491495,
        "verdict": "loss_detected",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -49.06666666666667,
        "ci95": [
         -52.82485876104211,
         -45.30612244514715
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 5.37366520192555,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (GPQA, AIME25, LCB v6, Terminal-Bench 2.1, SWE-bench Verified)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "sparq_c8_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.7676767676767677,
        "ci95": [
         -4.28134556803071,
         0.7407407434962936
        ],
        "p": 0.18958104189581043,
        "q": 0.424179804241798,
        "mdd80": 3.589301355903054,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.6944444444444444,
        "ci95": [
         -2.483974361049123,
         1.0416666684090128
        ],
        "p": 0.5264473552644735,
        "q": 0.6580591940805919,
        "mdd80": 2.5197870650721255,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.7988252569750367,
        "ci95": [
         -3.571428573117547,
         1.7298375105492156e-09
        ],
        "p": 0.050994900509949,
        "q": 0.14712814432842428,
        "mdd80": 2.5525115720906304,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.4981273408239701,
        "ci95": [
         -7.092198586857561,
         4.166666671918152
        ],
        "p": 0.6927307269273073,
        "q": 0.8149773257968321,
        "mdd80": 8.04674747355468,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8666666666666667,
        "ci95": [
         -0.9259259276982204,
         2.6315789493039308
        ],
        "p": 0.37606239376062395,
        "q": 0.5372319910866057,
        "mdd80": 2.542560260134806,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.59, AIME25 2.52, LCB v6 2.55, Terminal-Bench 2.1 8.05, SWE-bench Verified 2.54)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "loki_k25_d25_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.4208754208754209,
        "ci95": [
         -2.8846153869517766,
         2.0599250963863476
        ],
        "p": 0.7954204579542046,
        "q": 0.89546600895466,
        "mdd80": 3.533879101286657,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.4861111111111111,
        "ci95": [
         -0.1602564110125368,
         1.1217948725388331
        ],
        "p": 0.17098290170982902,
        "q": 0.40325379226783203,
        "mdd80": 0.9162862055608539,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.23935389133627,
        "ci95": [
         -4.092261906639887,
         -0.38051750188418
        ],
        "p": 0.020497950204979503,
        "q": 0.0655934406559344,
        "mdd80": 2.6527957502794104,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -2.247191011235955,
        "ci95": [
         -6.14035088174198,
         1.6260162643650804
        ],
        "p": 0.3391660833916608,
        "q": 0.5372319910866057,
        "mdd80": 5.550647758478516,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8,
        "ci95": [
         -0.8196721328024502,
         2.426564497088632
        ],
        "p": 0.36946305369463056,
        "q": 0.5372319910866057,
        "mdd80": 2.320095835570661,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (LCB v6)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "gpqa",
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -3.6195286195286194,
        "ci95": [
         -6.378600826417472,
         -0.8680555527262774
        ],
        "p": 0.011498850114988501,
        "q": 0.039996000399960006,
        "mdd80": 3.9384045585252023,
        "verdict": "loss_detected",
        "source": "published"
       },
       "aime25": {
        "delta": -28.125,
        "ci95": [
         -39.772727288615705,
         -16.66666665102798
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 16.513976389795438,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -6.644640234948605,
        "ci95": [
         -8.946608948869727,
         -4.354354352015381
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.2820992369861437,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 0.37453183520599254,
        "ci95": [
         -4.444444449196073,
         5.185185189935703
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 6.88232749828439,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.8,
        "ci95": [
         -0.9222661413557368,
         2.5232403735601534
        ],
        "p": 0.41025897410258977,
        "q": 0.5470119654701197,
        "mdd80": 2.4625146679329255,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (GPQA, AIME25, LCB v6)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "aime25",
       "lcb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.08417508417508418,
        "ci95": [
         -2.9824561433614933,
         2.807017546867923
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 4.137755601414013,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -3.4375,
        "ci95": [
         -5.9659090943669355,
         -0.892857140120187
        ],
        "p": 0.0013998600139986002,
        "q": 0.005894147427362527,
        "mdd80": 3.6257266658581173,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -2.202643171806167,
        "ci95": [
         -3.8179148327437407,
         -0.5804311756194442
        ],
        "p": 0.009099090090990901,
        "q": 0.034663200346632006,
        "mdd80": 2.313840057578973,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 0.7490636704119851,
        "ci95": [
         -2.0408163290556454,
         3.508771933054236
        ],
        "p": 0.8012198780121987,
        "q": 0.89546600895466,
        "mdd80": 3.966308708827846,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -2.6,
        "ci95": [
         -4.521963826150607,
         -0.6802721068892984
        ],
        "p": 0.0100989901009899,
        "q": 0.036723600367236,
        "mdd80": 2.7456695169210468,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (AIME25, LCB v6, SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "sparq_c8_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.2626262626262625,
        "ci95": [
         -4.1218638023229905,
         1.6304347857217778
        ],
        "p": 0.42475752424757524,
        "q": 0.5570590481935414,
        "mdd80": 4.111186435453857,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.7708333333333333,
        "ci95": [
         -3.7109375018262867,
         0.16025641249069347
        ],
        "p": 0.08709129087091291,
        "q": 0.24025183688527701,
        "mdd80": 2.766754831299732,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9544787077826725,
        "ci95": [
         -2.444444445943024,
         0.5208333346404521
        ],
        "p": 0.22947705229477053,
        "q": 0.46695330466953305,
        "mdd80": 2.1192936358039813,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -1.4981273408239701,
        "ci95": [
         -4.065040653194817,
         0.8547008573805842
        ],
        "p": 0.401959804019598,
        "q": 0.545030242738438,
        "mdd80": 3.516155195116837,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -4.2,
        "ci95": [
         -6.349206351337289,
         -2.074688794484463
        ],
        "p": 0.00029997000299970003,
        "q": 0.001333200013332,
        "mdd80": 3.05501154518753,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (SWE-bench Verified)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "loki_k25_d25_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.9259259259259259,
        "ci95": [
         -1.8867924554503221,
         3.7634408632346643
        ],
        "p": 0.5517448255174483,
        "q": 0.6790705544830133,
        "mdd80": 4.038240056801857,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.5208333333333334,
        "ci95": [
         -1.5625000011234553,
         0.5208333343159892
        ],
        "p": 0.36126387361263873,
        "q": 0.5372319910866057,
        "mdd80": 1.488965083799441,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.9544787077826725,
        "ci95": [
         -2.4691358040615237,
         0.5555555569819539
        ],
        "p": 0.23347665233476653,
        "q": 0.46695330466953305,
        "mdd80": 2.1617567142291105,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -0.37453183520599254,
        "ci95": [
         -3.0303030338813466,
         2.2727272753999577
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 3.7900929412164746,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -1.4,
        "ci95": [
         -3.4578146632684277,
         0.6587615303583185
        ],
        "p": 0.206979302069793,
        "q": 0.447522815286039,
        "mdd80": 2.9421303412386135,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 4.04, AIME25 1.49, LCB v6 2.16, Terminal-Bench 2.1 3.79, SWE-bench Verified 2.94)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.7676767676767677,
        "ci95": [
         -4.761904764539125,
         1.215277780853518
        ],
        "p": 0.2733726627337266,
        "q": 0.520709833778527,
        "mdd80": 4.271911728282236,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -17.118055555555557,
        "ci95": [
         -26.23697917519958,
         -8.124999986517375
        ],
        "p": 0.00019998000199980003,
        "q": 0.0009410823623520001,
        "mdd80": 12.944690199929747,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -10.499265785609397,
        "ci95": [
         -12.820512823042321,
         -8.183183180818485
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.3143145179323827,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -0.7575757613739754,
         6.666666670290898
        ],
        "p": 0.1713828617138286,
        "q": 0.40325379226783203,
        "mdd80": 5.306130116753257,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.3333333333333333,
        "ci95": [
         -2.4000000020581385,
         1.7333333353914715
        ],
        "p": 0.805919408059194,
        "q": 0.89546600895466,
        "mdd80": 2.954106726213602,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (AIME25, LCB v6)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "quest_b2048_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "lcb",
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.8518518518518519,
        "ci95": [
         -4.833333336284078,
         1.1111111138935432
        ],
        "p": 0.24027597240275972,
        "q": 0.46883116566392136,
        "mdd80": 4.2485137055769595,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.7708333333333333,
        "ci95": [
         -3.6057692328957223,
         1.5673994204222452e-09
        ],
        "p": 0.0514948505149485,
        "q": 0.14712814432842428,
        "mdd80": 2.5770549527646067,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -2.3127753303964758,
        "ci95": [
         -4.035874441211674,
         -0.5925925908577527
        ],
        "p": 0.008999100089991,
        "q": 0.034663200346632006,
        "mdd80": 2.4609246929636828,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -3.3707865168539324,
        "ci95": [
         -9.09090909669776,
         2.3809523870458635
        ],
        "p": 0.3200679932006799,
        "q": 0.5372319910866057,
        "mdd80": 8.198976565540775,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -5.266666666666667,
        "ci95": [
         -7.607192256919701,
         -2.945113786163665
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.332002585858206,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (LCB v6, SWE-bench Verified)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "sparq_c8_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "swe"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.1784511784511784,
        "ci95": [
         -3.639846746093883,
         1.2820512843846628
        ],
        "p": 0.38906109389061094,
        "q": 0.545030242738438,
        "mdd80": 3.5176964668776627,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.5902777777777778,
        "ci95": [
         -0.6510416678359505,
         1.8429487194032808
        ],
        "p": 0.3972602739726027,
        "q": 0.545030242738438,
        "mdd80": 1.7824630090447664,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.7709251101321586,
        "ci95": [
         -2.2935779832319323,
         0.7473841570011153
        ],
        "p": 0.3447655234476552,
        "q": 0.5372319910866057,
        "mdd80": 2.1733854928251053,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": -2.6217228464419478,
        "ci95": [
         -7.246376816055165,
         2.040816330762709
        ],
        "p": 0.35236476352364765,
        "q": 0.5372319910866057,
        "mdd80": 6.63758702790421,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -10.2,
        "ci95": [
         -12.820512823161254,
         -7.563025207319987
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.757543430679269,
        "verdict": "loss_detected",
        "source": "published"
       }
      },
      "status_text": "loss detected (SWE-bench Verified)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "loki_k25_d25_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.8417508417508418,
        "ci95": [
         -3.44202898830597,
         1.7857142880276953
        ],
        "p": 0.5718428157184282,
        "q": 0.6931428069314282,
        "mdd80": 3.736285054876362,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.5208333333333334,
        "ci95": [
         -0.42892156947436433,
         1.4583333342791525
        ],
        "p": 0.3127687231276872,
        "q": 0.5372319910866057,
        "mdd80": 1.348827193477191,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -1.2114537444933922,
        "ci95": [
         -2.61136712896001,
         0.16025641175087524
        ],
        "p": 0.1014898510148985,
        "q": 0.27063960270639603,
        "mdd80": 1.9808883232238954,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.6217228464419478,
        "ci95": [
         -2.222222227014214,
         7.407407412132084
        ],
        "p": 0.3548645135486451,
        "q": 0.5372319910866057,
        "mdd80": 6.882327498294768,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.4,
        "ci95": [
         -0.5925925948003573,
         3.401360546254811
        ],
        "p": 0.19088091190880913,
        "q": 0.424179804241798,
        "mdd80": 2.854491248328179,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.74, AIME25 1.35, LCB v6 1.98, Terminal-Bench 2.1 6.88, SWE-bench Verified 2.85)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "tri_b4096_s1",
      "status": "loss detected",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [
       "gpqa",
       "aime25",
       "lcb"
      ],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -3.367003367003367,
        "ci95": [
         -5.992509366214071,
         -0.7326007297418518
        ],
        "p": 0.012798720127987202,
        "q": 0.042662400426624,
        "mdd80": 3.75927374196711,
        "verdict": "loss_detected",
        "source": "published"
       },
       "aime25": {
        "delta": -14.895833333333334,
        "ci95": [
         -24.10714286700908,
         -5.763888879752601
        ],
        "p": 0.00019998000199980003,
        "q": 0.0009410823623520001,
        "mdd80": 13.109983047685773,
        "verdict": "loss_detected",
        "source": "published"
       },
       "lcb": {
        "delta": -10.38913362701909,
        "ci95": [
         -12.57062147101926,
         -8.218125957793351
        ],
        "p": 9.999000099990002e-05,
        "q": 0.0005713714342851429,
        "mdd80": 3.1107426432170575,
        "verdict": "loss_detected",
        "source": "published"
       },
       "tb": {
        "delta": -0.7490636704119851,
        "ci95": [
         -5.072463772282192,
         3.6036036088308303
        ],
        "p": 0.8659134086591341,
        "q": 0.9361226039558208,
        "mdd80": 6.200813463412293,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": -0.6,
        "ci95": [
         -2.61707989188724,
         1.400560226187191
        ],
        "p": 0.6005399460053995,
        "q": 0.7170626220959995,
        "mdd80": 2.871420407537837,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "loss detected (GPQA, AIME25, LCB v6)"
     }
    ],
    "arm_status_changes": [],
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "members": {
       "quest_b2048_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": -84.8854961832061,
        "ci95": [
         -87.71653543598326,
         -82.06686929810857
        ],
        "p": 9.999000099990002e-05,
        "n_items": 1310,
        "mean_a": 2.2900763358778624,
        "mean_b": 87.17557251908397,
        "per_seed": {
         "42": -82.24299065420561,
         "43": -87.4439461883408,
         "44": -84.86238532110092
        },
        "p_het": 0.0072992700729927005,
        "mdd80": 4.037834690839355,
        "shift_vs_primary": -0.31366320372980283,
        "q_sub": 0.0005713714342851429,
        "label_sub": "loss_detected",
        "label_primary": "loss_detected",
        "label_changed": false
       },
       "sparq_c8_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.9508670520231215,
        "ci95": [
         0.4243281456056628,
         3.4965034979976295
        ],
        "p": 0.0150984901509849,
        "n_items": 1384,
        "mean_a": 89.16184971098266,
        "mean_b": 87.21098265895954,
        "per_seed": {
         "42": 3.2679738562091503,
         "43": 1.511879049676026,
         "44": 1.0822510822510822
        },
        "p_het": 0.4747525247475253,
        "mdd80": 2.1956936766703232,
        "shift_vs_primary": -0.12688093725301774,
        "q_sub": 0.04831516848315168,
        "label_sub": "gain_detected",
        "label_primary": "gain_detected",
        "label_changed": false
       },
       "loki_k25_d25_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.937950937950938,
        "ci95": [
         -0.735294119346326,
         2.6315789489876034
        ],
        "p": 0.31256874312568744,
        "n_items": 1386,
        "mean_a": 88.23953823953823,
        "mean_b": 87.3015873015873,
        "per_seed": {
         "42": 1.3071895424836601,
         "43": 0.0,
         "44": 1.511879049676026
        },
        "p_het": 0.744025597440256,
        "mdd80": 2.4063150889276526,
        "shift_vs_primary": -0.3338027434412977,
        "q_sub": 0.5278043624209008,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "tri_b4096_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.28964518464880523,
        "ci95": [
         -1.3081395364846,
         1.8759018774784721
        ],
        "p": 0.7908209179082092,
        "n_items": 1381,
        "mean_a": 87.54525706010138,
        "mean_b": 87.25561187545257,
        "per_seed": {
         "42": 0.0,
         "43": -0.8620689655172413,
         "44": 1.735357917570499
        },
        "p_het": 0.38206179382061795,
        "mdd80": 2.2756447132654345,
        "shift_vs_primary": -0.5162648220671116,
        "q_sub": 0.8712642249288584,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "members": {
       "quest_b2048_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": -84.51704545454545,
        "ci95": [
         -87.26287263134091,
         -81.79104477326263
        ],
        "p": 9.999000099990002e-05,
        "n_items": 1408,
        "mean_a": 2.272727272727273,
        "mean_b": 86.78977272727273,
        "per_seed": {
         "42": -81.95652173913044,
         "43": -87.05636743215031,
         "44": -84.43496801705757
        },
        "p_het": 0.006199380061993801,
        "mdd80": 3.910733096161541,
        "shift_vs_primary": 0.05478752493084471,
        "q_sub": 0.0005713714342851429,
        "label_sub": "loss_detected",
        "label_primary": "loss_detected",
        "label_changed": false
       },
       "sparq_c8_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 2.0903573836817264,
        "ci95": [
         0.5788711995380653,
         3.5809018582299377
        ],
        "p": 0.007499250074992501,
        "n_items": 1483,
        "mean_a": 88.87390424814565,
        "mean_b": 86.78354686446393,
        "per_seed": {
         "42": 3.048780487804878,
         "43": 2.0161290322580645,
         "44": 1.2121212121212122
        },
        "p_het": 0.6177382261773823,
        "mdd80": 2.145561036849045,
        "shift_vs_primary": 0.012609394405587171,
        "q_sub": 0.02999700029997,
        "label_sub": "gain_detected",
        "label_primary": "gain_detected",
        "label_changed": false
       },
       "loki_k25_d25_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.2794612794612794,
        "ci95": [
         -0.2890173427236224,
         2.884615386249979
        ],
        "p": 0.13928607139286073,
        "n_items": 1485,
        "mean_a": 88.14814814814815,
        "mean_b": 86.86868686868686,
        "per_seed": {
         "42": 1.4227642276422765,
         "43": 0.8048289738430584,
         "44": 1.6129032258064515
        },
        "p_het": 0.9153084691530847,
        "mdd80": 2.2682055923845117,
        "shift_vs_primary": 0.007707598069043753,
        "q_sub": 0.331025720957316,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "tri_b4096_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.8108108108108109,
        "ci95": [
         -0.7623888197771036,
         2.3746701862186597
        ],
        "p": 0.34906509349065096,
        "n_items": 1480,
        "mean_a": 87.63513513513513,
        "mean_b": 86.82432432432432,
        "per_seed": {
         "42": 0.20449897750511248,
         "43": -0.2012072434607646,
         "44": 2.42914979757085
        },
        "p_het": 0.3260673932606739,
        "mdd80": 2.2420662340916313,
        "shift_vs_primary": 0.004900804094894129,
        "q_sub": 0.5185446367643938,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "unavailable",
      "why": "unavailable: the route-(i) scan was not validated before the START marker"
     },
     "drop_probed": {
      "status": "complete",
      "members": {
       "quest_b2048_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": -84.46043165467626,
        "ci95": [
         -87.21804511565506,
         -81.70347002853245
        ],
        "p": 9.999000099990002e-05,
        "n_items": 1390,
        "mean_a": 2.302158273381295,
        "mean_b": 86.76258992805755,
        "per_seed": {
         "42": -81.99566160520607,
         "43": -87.11018711018711,
         "44": -84.15178571428571
        },
        "p_het": 0.006099390060993901,
        "mdd80": 3.941284679239219,
        "shift_vs_primary": 0.11140132480004183,
        "q_sub": 0.0005713714342851429,
        "label_sub": "loss_detected",
        "label_primary": "loss_detected",
        "label_changed": false
       },
       "sparq_c8_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.9741320626276377,
        "ci95": [
         0.5063291125595287,
         3.463203464775422
        ],
        "p": 0.010698930106989302,
        "n_items": 1469,
        "mean_a": 88.76786929884275,
        "mean_b": 86.79373723621511,
        "per_seed": {
         "42": 3.0303030303030303,
         "43": 2.004008016032064,
         "44": 0.8421052631578947
        },
        "p_het": 0.5108489151084892,
        "mdd80": 2.1132876783267536,
        "shift_vs_primary": -0.1036159266485015,
        "q_sub": 0.037213669937354095,
        "label_sub": "gain_detected",
        "label_primary": "gain_detected",
        "label_changed": false
       },
       "loki_k25_d25_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.3596193065941535,
        "ci95": [
         -0.27063599620975765,
         2.981029811913322
        ],
        "p": 0.11868813118688132,
        "n_items": 1471,
        "mean_a": 88.23929299796058,
        "mean_b": 86.87967369136642,
        "per_seed": {
         "42": 1.4141414141414141,
         "43": 0.8,
         "44": 1.8907563025210083
        },
        "p_het": 0.8684131586841316,
        "mdd80": 2.323976086840899,
        "shift_vs_primary": 0.08786562520191787,
        "q_sub": 0.29672032796720327,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "tri_b4096_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.6821282401091405,
        "ci95": [
         -0.8888888905927899,
         2.2535211283803025
        ],
        "p": 0.44025597440255976,
        "n_items": 1466,
        "mean_a": 87.51705320600273,
        "mean_b": 86.83492496589359,
        "per_seed": {
         "42": 0.2032520325203252,
         "43": -0.2,
         "44": 2.109704641350211
        },
        "p_het": 0.43245675432456754,
        "mdd80": 2.2458906204011413,
        "shift_vs_primary": -0.1237817666067762,
        "q_sub": 0.5590552055905521,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out": [
       [
        44,
        252
       ],
       [
        44,
        253
       ],
       [
        44,
        254
       ],
       [
        44,
        255
       ],
       [
        44,
        256
       ],
       [
        44,
        257
       ],
       [
        44,
        258
       ],
       [
        44,
        259
       ],
       [
        44,
        263
       ],
       [
        44,
        267
       ],
       [
        44,
        271
       ],
       [
        44,
        272
       ],
       [
        44,
        273
       ],
       [
        44,
        274
       ],
       [
        44,
        275
       ],
       [
        44,
        276
       ],
       [
        44,
        281
       ],
       [
        44,
        298
       ],
       [
        44,
        303
       ],
       [
        44,
        308
       ],
       [
        44,
        310
       ],
       [
        44,
        311
       ],
       [
        44,
        312
       ]
      ],
      "applies_to": [
       "quest_b2048_s1_sxs|dense_sxs",
       "sparq_c8_s1_sxs|dense_sxs",
       "loki_k25_d25_s1_sxs|dense_sxs",
       "tri_b4096_s1_sxs|dense_sxs"
      ],
      "not_applicable": []
     },
     "by_period_stack": {
      "status": "unavailable",
      "why": "Final registered stack record and split inputs were not completed."
     },
     "zero_as_failure": {
      "status": "complete",
      "members": {
       "quest_b2048_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": -84.53333333333333,
        "ci95": [
         -87.19898606083204,
         -81.88105117291687
        ],
        "p": 9.999000099990002e-05,
        "n_items": 1500,
        "mean_a": 2.1333333333333333,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": -82.0,
         "43": -87.0,
         "44": -84.6
        },
        "p_het": 0.005699430056994301,
        "mdd80": 3.8007452918495,
        "shift_vs_primary": 0.038499646142966526,
        "q_sub": 0.0005713714342851429,
        "label_sub": "loss_detected",
        "label_primary": "loss_detected",
        "label_changed": false,
        "zero_token_rows": {
         "quest_b2048_s1_sxs": 83,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "quest_b2048_s1_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "quest_b2048_s1_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 87
       },
       "sparq_c8_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 2.0,
        "ci95": [
         0.4424778743877946,
         3.5310734479483044
        ],
        "p": 0.011398860113988602,
        "n_items": 1500,
        "mean_a": 88.66666666666667,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 3.2,
         "43": 1.8,
         "44": 1.0
        },
        "p_het": 0.5030496950304969,
        "mdd80": 2.2074292619328073,
        "shift_vs_primary": -0.07774798927613924,
        "q_sub": 0.038329500383295,
        "label_sub": "gain_detected",
        "label_primary": "gain_detected",
        "label_changed": false,
        "zero_token_rows": {
         "sparq_c8_s1_sxs": 5,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "sparq_c8_s1_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "sparq_c8_s1_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 8
       },
       "loki_k25_d25_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.2666666666666666,
        "ci95": [
         -0.28860029027914663,
         2.8735632201226844
        ],
        "p": 0.1424857514248575,
        "n_items": 1500,
        "mean_a": 87.93333333333334,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 1.4,
         "43": 0.8,
         "44": 1.6
        },
        "p_het": 0.9381061893810619,
        "mdd80": 2.2600085047167204,
        "shift_vs_primary": -0.00508701472556905,
        "q_sub": 0.3352605915879,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "loki_k25_d25_s1_sxs": 3,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "loki_k25_d25_s1_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "loki_k25_d25_s1_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 6
       },
       "tri_b4096_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.4,
        "ci95": [
         -1.1627906991879975,
         1.9753086434279403
        ],
        "p": 0.679032096790321,
        "n_items": 1500,
        "mean_a": 87.06666666666666,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": -0.6,
         "43": -0.2,
         "44": 2.0
        },
        "p_het": 0.35206479352064796,
        "mdd80": 2.2428097660442416,
        "shift_vs_primary": -0.4059100067159167,
        "q_sub": 0.7872835904815315,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "tri_b4096_s1_sxs": 9,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "tri_b4096_s1_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "tri_b4096_s1_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 11
       }
      },
      "other_label_changes": [],
      "rule": "the addendum v2's zero_token_as_failure: every (seed, instance) an item, no pair dropped; a zero-token row (tokens == 0, whatever its resolved field) or a missing row scores 0 on its side; same test and seed tuple as the contrast; the label its p gets substituted into the family's BH; never decides",
      "items_total": 1500
     }
    }
   },
   "B12": {
    "title": "(12) TRT-LLM-native baselines vs bf16 (FP8 KV, BLASST t50)",
    "seed_tuple": [
     20261024,
     23,
     0,
     1
    ],
    "specs": [
     [
      "fp8kv_s1_sxs",
      "dense_sxs"
     ],
     [
      "blasst_t50_s1_sxs",
      "dense_sxs"
     ]
    ],
    "replaces": [
     [
      "fp8kv_s1",
      "dense_s1"
     ],
     [
      "blasst_t50_s1",
      "dense_s1"
     ]
    ],
    "family_m_registered": 40,
    "m": 40,
    "status": "ARCHIVAL ONLY; integrity gate failed; not used in main comparison",
    "removed": [],
    "members": [
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 40,
      "mean_a": 90.06734006734007,
      "mean_b": 90.06734006734007,
      "delta": 0.0,
      "ci95": [
       -1.630434784362527,
       1.630434784362527
      ],
      "p": 1.0,
      "mid_p": 0.95875,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": 1.5151515151515151,
       "44": -2.525252525252525
      },
      "p_het": 0.018998100189981004,
      "mdd80": 2.3305540443587236,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.33)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 20,
      "mean_a": 98.61111111111111,
      "mean_b": 98.99305555555556,
      "delta": -0.3819444444444444,
      "ci95": [
       -1.3257575770593744,
       0.37202381034328436
      ],
      "p": 0.9078092190780922,
      "mid_p": 0.8494,
      "per_seed": {
       "42": -0.3125,
       "43": -0.625,
       "44": -0.20833333333333334
      },
      "p_het": 0.9054094590540946,
      "mdd80": 1.2134098575415464,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.21)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 205,
      "mean_a": 86.34361233480176,
      "mean_b": 86.67400881057269,
      "delta": -0.3303964757709251,
      "ci95": [
       -1.7806267820305808,
       1.1111111126691067
      ],
      "p": 0.6862313768623137,
      "mid_p": 0.65015,
      "per_seed": {
       "42": 0.0,
       "43": -0.11013215859030837,
       "44": -0.8810572687224669
      },
      "p_het": 0.8941105889411058,
      "mdd80": 2.066734441130288,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.9149751691497516,
      "label_source": "no_detected_loss",
      "q": 0.9149751691497516,
      "label": "no_detected_loss",
      "q_prev": 0.9149751691497516,
      "label_prev": "no_detected_loss",
      "q_published": 0.9149751691497516,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.07)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 56,
      "a_only": 32,
      "b_only": 24,
      "mean_a": 73.03370786516854,
      "mean_b": 70.0374531835206,
      "rate_a": 73.03370786516854,
      "rate_b": 70.0374531835206,
      "delta": 2.9962546816479403,
      "ci95": [
       -3.100775200097675,
       9.166666673530106
      ],
      "p": 0.39976002399760024,
      "mid_p": 0.34005,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 6.741573033707865,
       "44": -1.1235955056179776
      },
      "p_het": 0.5005499450054994,
      "mdd80": 8.767580447474622,
      "key": [
       "qwen3.8-27b",
       "tb",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.8552744725527447,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.77)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "fp8kv_s1_sxs",
      "b": "dense_sxs",
      "n_items": 1489,
      "n_clusters": 500,
      "n_diff_items": 128,
      "a_only": 74,
      "b_only": 54,
      "mean_a": 88.31430490261921,
      "mean_b": 86.97112155809268,
      "rate_a": 87.73333333333333,
      "rate_b": 86.66666666666667,
      "delta": 1.3431833445265278,
      "ci95": [
       -0.1362397835148158,
       2.8169014099951077
      ],
      "p": 0.08869113088691132,
      "mid_p": 0.07525,
      "per_seed": {
       "42": 1.4141414141414141,
       "43": 1.8,
       "44": 0.8097165991902834
      },
      "p_het": 0.8758124187581242,
      "key": [
       "qwen3.8-27b",
       "swe",
       "fp8kv_s1_sxs",
       "dense_sxs"
      ],
      "row_arm": "fp8kv_s1",
      "source": "sxs",
      "replaces": [
       "fp8kv_s1",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       23,
       0,
       1
      ],
      "label_text": "FP8 KV (sxs) vs bf16 sxs",
      "mdd80": 2.1106195777060246,
      "se": 0.7504240632683928,
      "ci95_bootstrap": [
       -0.06926293425254687,
       2.826379542395693
      ],
      "mdd80_cell": 2.1291694553743,
      "q": 0.5382318910966046,
      "label": "no_detected_loss",
      "q_prev": 0.001999800019998,
      "label_prev": "gain_detected",
      "q_published": 0.001999800019998,
      "label_published": "gain_detected",
      "changed": true,
      "text": "no detected loss (MDD80 2.11)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 43,
      "mean_a": 89.56228956228956,
      "mean_b": 90.06734006734007,
      "delta": -0.5050505050505051,
      "ci95": [
       -2.0618556716894254,
       1.0416666682593871
      ],
      "p": 0.6167383261673832,
      "mid_p": 0.54775,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 1.0101010101010102,
       "44": -1.5151515151515151
      },
      "p_het": 0.3675632436756324,
      "mdd80": 2.218097470225805,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8810547516676903,
      "label": "no_detected_loss",
      "q_prev": 0.8810547516676903,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.22)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 99.09722222222223,
      "mean_b": 98.99305555555556,
      "delta": 0.10416666666666667,
      "ci95": [
       -0.3205128210143112,
       0.5208333337325618
      ],
      "p": 0.8055194480551945,
      "mid_p": 0.7041,
      "per_seed": {
       "42": -0.10416666666666667,
       "43": -0.20833333333333334,
       "44": 0.625
      },
      "p_het": 0.46485351464853514,
      "mdd80": 0.6013128223394801,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.9680208449743262,
      "label_source": "no_detected_loss",
      "q": 0.9680208449743262,
      "label": "no_detected_loss",
      "q_prev": 0.9680208449743262,
      "label_prev": "no_detected_loss",
      "q_published": 0.9680208449743262,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.60)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 202,
      "mean_a": 87.59177679882525,
      "mean_b": 86.67400881057269,
      "delta": 0.9177679882525698,
      "ci95": [
       -0.5231689102829274,
       2.3696682480067355
      ],
      "p": 0.23637636236376364,
      "mid_p": 0.2195,
      "per_seed": {
       "42": 2.202643171806167,
       "43": 0.9911894273127754,
       "44": -0.44052863436123346
      },
      "p_het": 0.35826417358264173,
      "mdd80": 2.067520088379109,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.07)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 54,
      "a_only": 29,
      "b_only": 25,
      "mean_a": 71.53558052434457,
      "mean_b": 70.0374531835206,
      "rate_a": 71.53558052434455,
      "rate_b": 70.0374531835206,
      "delta": 1.4981273408239701,
      "ci95": [
       -3.968253974029337,
       7.017543866105296
      ],
      "p": 0.685031496850315,
      "mid_p": 0.5897,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 8.98876404494382,
       "44": -6.741573033707865
      },
      "p_het": 0.07219278072192781,
      "mdd80": 7.8515853048496655,
      "key": [
       "qwen3.8-27b",
       "tb",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.9149751691497516,
      "label_source": "no_detected_loss",
      "q": 0.9149751691497516,
      "label": "no_detected_loss",
      "q_prev": 0.9149751691497516,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.85)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "blasst_t50_s1_sxs",
      "b": "dense_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 129,
      "a_only": 75,
      "b_only": 54,
      "mean_a": 88.33780160857908,
      "mean_b": 86.93029490616622,
      "rate_a": 87.93333333333334,
      "rate_b": 86.66666666666667,
      "delta": 1.4075067024128687,
      "ci95": [
       -0.1262626277042151,
       2.878787880449983
      ],
      "p": 0.07929207079292071,
      "mid_p": 0.0651,
      "per_seed": {
       "42": 2.4242424242424243,
       "43": 2.6052104208416833,
       "44": -0.8032128514056225
      },
      "p_het": 0.11818818118188182,
      "key": [
       "qwen3.8-27b",
       "swe",
       "blasst_t50_s1_sxs",
       "dense_sxs"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "sxs",
      "replaces": [
       "blasst_t50_s1",
       "dense_s1"
      ],
      "seed_tuple": [
       20261024,
       23,
       0,
       1
      ],
      "label_text": "BLASST t50 (sxs) vs bf16 sxs",
      "mdd80": 2.1477193330425757,
      "se": 0.7674568295826687,
      "ci95_bootstrap": [
       -0.06697923643670463,
       2.9451137884872827
      ],
      "mdd80_cell": 2.1291694553743,
      "q": 0.5382318910966046,
      "label": "no_detected_loss",
      "q_prev": 0.001999800019998,
      "label_prev": "gain_detected",
      "q_published": 0.001999800019998,
      "label_published": "gain_detected",
      "changed": true,
      "text": "no detected loss (MDD80 2.15)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 97,
      "mean_a": 82.996632996633,
      "mean_b": 84.76430976430976,
      "delta": -1.7676767676767677,
      "ci95": [
       -3.8194444465536432,
       0.33003300535645375
      ],
      "p": 0.11248875112488751,
      "mid_p": 0.09605,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": 0.25252525252525254,
       "44": -2.0202020202020203
      },
      "p_het": 0.44275572442755723,
      "mdd80": 2.9656449771173903,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.5624437556244376,
      "label_source": "no_detected_loss",
      "q": 0.5624437556244376,
      "label": "no_detected_loss",
      "q_prev": 0.5624437556244376,
      "label_prev": "no_detected_loss",
      "q_published": 0.5624437556244376,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.97)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 23,
      "mean_a": 92.01388888888889,
      "mean_b": 91.80555555555556,
      "delta": 0.20833333333333334,
      "ci95": [
       -0.4340277785922392,
       0.8333333339680795
      ],
      "p": 0.6032396760323968,
      "mid_p": 0.53555,
      "per_seed": {
       "42": 1.1458333333333333,
       "43": -0.5208333333333334,
       "44": 0.0
      },
      "p_het": 0.1974802519748025,
      "mdd80": 0.9057870927647228,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8810547516676903,
      "label": "no_detected_loss",
      "q_prev": 0.8810547516676903,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 0.91)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 296,
      "mean_a": 78.78120411160059,
      "mean_b": 79.47870778267254,
      "delta": -0.697503671071953,
      "ci95": [
       -2.4745269304333233,
       1.0917030585350347
      ],
      "p": 0.46815318468153183,
      "mid_p": 0.4429,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": -1.9823788546255507,
       "44": -0.5506607929515418
      },
      "p_het": 0.5432456754324567,
      "mdd80": 2.548796125922065,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.55)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 49,
      "a_only": 32,
      "b_only": 17,
      "mean_a": 47.19101123595506,
      "mean_b": 41.57303370786517,
      "rate_a": 47.19101123595507,
      "rate_b": 41.57303370786517,
      "delta": 5.617977528089888,
      "ci95": [
       -5.793464987489628e-09,
       11.111111117358856
      ],
      "p": 0.064993500649935,
      "mid_p": 0.04965,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 7.865168539325842,
       "44": 6.741573033707865
      },
      "p_het": 0.6967303269673033,
      "mdd80": 7.94114711417494,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.47595240475952405,
      "label_source": "no_detected_loss",
      "q": 0.5382318910966046,
      "label": "no_detected_loss",
      "q_prev": 0.47595240475952405,
      "label_prev": "no_detected_loss",
      "q_published": 0.47595240475952405,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.94)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 165,
      "a_only": 85,
      "b_only": 80,
      "mean_a": 68.8,
      "mean_b": 68.46666666666667,
      "rate_a": 68.8,
      "rate_b": 68.46666666666665,
      "delta": 0.3333333333333333,
      "ci95": [
       -1.2820512837723983,
       1.9531250015801054
      ],
      "p": 0.7468253174682532,
      "mid_p": 0.6885,
      "per_seed": {
       "42": 0.8,
       "43": -2.0,
       "44": 2.2
      },
      "p_het": 0.12808719128087193,
      "mdd80": 2.312190971498939,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.9521547845215478,
      "label_source": "no_detected_loss",
      "q": 0.9521547845215478,
      "label": "no_detected_loss",
      "q_prev": 0.9521547845215478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9521547845215478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.31)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 90,
      "mean_a": 84.006734006734,
      "mean_b": 84.76430976430976,
      "delta": -0.7575757575757576,
      "ci95": [
       -2.7777777797338405,
       1.257861637099707
      ],
      "p": 0.5138486151384861,
      "mid_p": 0.4643,
      "per_seed": {
       "42": -2.525252525252525,
       "43": -0.7575757575757576,
       "44": 1.0101010101010102
      },
      "p_het": 0.4353564643535646,
      "mdd80": 2.884284564669728,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.88)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 22,
      "mean_a": 92.08333333333333,
      "mean_b": 91.80555555555556,
      "delta": 0.2777777777777778,
      "ci95": [
       -0.5208333341989333,
       1.041666667631973
      ],
      "p": 0.53004699530047,
      "mid_p": 0.48015,
      "per_seed": {
       "42": 0.7291666666666666,
       "43": 0.3125,
       "44": -0.20833333333333334
      },
      "p_het": 0.3942605739426057,
      "mdd80": 1.116723813029202,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 314,
      "mean_a": 78.70778267254038,
      "mean_b": 79.47870778267254,
      "delta": -0.7709251101321586,
      "ci95": [
       -2.5423728830547305,
       1.0014306168911848
      ],
      "p": 0.42645735426457354,
      "mid_p": 0.40455,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -0.6607929515418502,
       "44": -0.9911894273127754
      },
      "p_het": 0.9911008899110089,
      "mdd80": 2.532767841567087,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.53)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 56,
      "a_only": 33,
      "b_only": 23,
      "mean_a": 45.3183520599251,
      "mean_b": 41.57303370786517,
      "rate_a": 45.3183520599251,
      "rate_b": 41.57303370786517,
      "delta": 3.745318352059925,
      "ci95": [
       -1.2345679053302583,
       8.695652178697763
      ],
      "p": 0.18138186181381863,
      "mid_p": 0.14225,
      "per_seed": {
       "42": 0.0,
       "43": 8.98876404494382,
       "44": 2.247191011235955
      },
      "p_het": 0.41375862413758624,
      "mdd80": 7.0971604630148475,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.7255274472552745,
      "label_source": "no_detected_loss",
      "q": 0.7255274472552745,
      "label": "no_detected_loss",
      "q_prev": 0.7255274472552745,
      "label_prev": "no_detected_loss",
      "q_published": 0.7255274472552745,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.10)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 171,
      "a_only": 97,
      "b_only": 74,
      "mean_a": 70.0,
      "mean_b": 68.46666666666667,
      "rate_a": 70.0,
      "rate_b": 68.46666666666665,
      "delta": 1.5333333333333334,
      "ci95": [
       -1.7301928840340625e-09,
       3.142076504377961
      ],
      "p": 0.07139286071392861,
      "mid_p": 0.06055,
      "per_seed": {
       "42": 1.6,
       "43": -1.0,
       "44": 4.0
      },
      "p_het": 0.07839216078392161,
      "mdd80": 2.2456522576761544,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.47595240475952405,
      "label_source": "no_detected_loss",
      "q": 0.5382318910966046,
      "label": "no_detected_loss",
      "q_prev": 0.47595240475952405,
      "label_prev": "no_detected_loss",
      "q_published": 0.47595240475952405,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.25)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 127,
      "mean_a": 73.56902356902357,
      "mean_b": 72.47474747474747,
      "delta": 1.0942760942760943,
      "ci95": [
       -1.456310682063262,
       3.645833335958234
      ],
      "p": 0.4313568643135686,
      "mid_p": 0.3951,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": 7.575757575757576,
       "44": -2.272727272727273
      },
      "p_het": 0.0026997300269973002,
      "mdd80": 3.646518858081705,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.65)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 87.84722222222223,
      "mean_b": 88.92361111111111,
      "delta": -1.0763888888888888,
      "ci95": [
       -2.083333334420301,
       -0.08680555430573689
      ],
      "p": 0.0390960903909609,
      "mid_p": 0.03335,
      "per_seed": {
       "42": 0.0,
       "43": -3.125,
       "44": -0.10416666666666667
      },
      "p_het": 0.07189281071892811,
      "mdd80": 1.426924872202047,
      "key": [
       "nemotron3-nano",
       "aime25",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.390960903909609,
      "label_source": "nominal_loss",
      "q": 0.5382318910966046,
      "label": "nominal_loss",
      "q_prev": 0.390960903909609,
      "label_prev": "nominal_loss",
      "q_published": 0.390960903909609,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0391, q 0.54)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 205,
      "mean_a": 69.60352422907489,
      "mean_b": 69.60352422907489,
      "delta": 0.0,
      "ci95": [
       -1.579778832661435,
       1.5972222237275422
      ],
      "p": 1.0,
      "mid_p": 0.9816,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": 1.2114537444933922,
       "44": -0.7709251101321586
      },
      "p_het": 0.49705029497050296,
      "mdd80": 2.270612946899982,
      "key": [
       "nemotron3-nano",
       "lcb",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.27)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 19,
      "a_only": 12,
      "b_only": 7,
      "mean_a": 5.992509363295881,
      "mean_b": 4.119850187265918,
      "rate_a": 5.99250936329588,
      "rate_b": 4.119850187265918,
      "delta": 1.8726591760299625,
      "ci95": [
       -1.6260162639479452,
       5.405405409654057
      ],
      "p": 0.43215678432156784,
      "mid_p": 0.32975,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 4.49438202247191,
       "44": -2.247191011235955
      },
      "p_het": 0.17948205179482052,
      "mdd80": 5.025379848422401,
      "key": [
       "nemotron3-nano",
       "tb",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.8552744725527447,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.03)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 266,
      "a_only": 141,
      "b_only": 125,
      "mean_a": 23.0,
      "mean_b": 21.933333333333334,
      "rate_a": 23.0,
      "rate_b": 21.933333333333334,
      "delta": 1.0666666666666667,
      "ci95": [
       -1.066666668799463,
       3.2000000021327972
      ],
      "p": 0.36446355364463556,
      "mid_p": 0.3344,
      "per_seed": {
       "42": 0.8,
       "43": 0.0,
       "44": 2.4
      },
      "p_het": 0.6678332166783322,
      "mdd80": 3.0494004915871473,
      "key": [
       "nemotron3-nano",
       "swe",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.05)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 127,
      "mean_a": 72.89562289562289,
      "mean_b": 72.47474747474747,
      "delta": 0.4208754208754209,
      "ci95": [
       -2.48226950659365,
       3.3653846181874503
      ],
      "p": 0.8228177182281772,
      "mid_p": 0.77825,
      "per_seed": {
       "42": 0.0,
       "43": 2.0202020202020203,
       "44": -0.7575757575757576
      },
      "p_het": 0.654034596540346,
      "mdd80": 4.17933734646369,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.9680208449743262,
      "label_source": "no_detected_loss",
      "q": 0.9680208449743262,
      "label": "no_detected_loss",
      "q_prev": 0.9680208449743262,
      "label_prev": "no_detected_loss",
      "q_published": 0.9680208449743262,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.18)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 38,
      "mean_a": 88.54166666666667,
      "mean_b": 88.92361111111111,
      "delta": -0.3819444444444444,
      "ci95": [
       -1.4583333344188745,
       0.6944444457996455
      ],
      "p": 0.5345465453454654,
      "mid_p": 0.4902,
      "per_seed": {
       "42": 1.875,
       "43": -1.4583333333333333,
       "44": -1.5625
      },
      "p_het": 0.0927907209279072,
      "mdd80": 1.5385972534484094,
      "key": [
       "nemotron3-nano",
       "aime25",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.54)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 202,
      "mean_a": 68.94273127753304,
      "mean_b": 69.60352422907489,
      "delta": -0.6607929515418502,
      "ci95": [
       -2.0740740754942104,
       0.7544581631832463
      ],
      "p": 0.39336066393360664,
      "mid_p": 0.36665,
      "per_seed": {
       "42": -1.5418502202643172,
       "43": -0.7709251101321586,
       "44": 0.3303964757709251
      },
      "p_het": 0.6275372462753724,
      "mdd80": 2.0215611540164,
      "key": [
       "nemotron3-nano",
       "lcb",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.02)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 20,
      "a_only": 14,
      "b_only": 6,
      "mean_a": 7.116104868913857,
      "mean_b": 4.119850187265918,
      "rate_a": 7.116104868913858,
      "rate_b": 4.119850187265918,
      "delta": 2.9962546816479403,
      "ci95": [
       -0.7407407444385912,
       6.666666670286942
      ],
      "p": 0.1576842315768423,
      "mid_p": 0.11185,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 6.741573033707865,
       "44": -1.1235955056179776
      },
      "p_het": 0.1451854814518548,
      "mdd80": 5.294098075609654,
      "key": [
       "nemotron3-nano",
       "tb",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.700818807008188,
      "label_source": "no_detected_loss",
      "q": 0.700818807008188,
      "label": "no_detected_loss",
      "q_prev": 0.700818807008188,
      "label_prev": "no_detected_loss",
      "q_published": 0.700818807008188,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.29)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 254,
      "a_only": 132,
      "b_only": 122,
      "mean_a": 22.6,
      "mean_b": 21.933333333333334,
      "rate_a": 22.600000000000005,
      "rate_b": 21.933333333333334,
      "delta": 0.6666666666666666,
      "ci95": [
       -1.4048531309686005,
       2.7559055138627038
      ],
      "p": 0.5661433856614339,
      "mid_p": 0.525,
      "per_seed": {
       "42": 2.4,
       "43": -0.8,
       "44": 0.4
      },
      "p_het": 0.48075192480751927,
      "mdd80": 2.9737076822436155,
      "key": [
       "nemotron3-nano",
       "swe",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8709898240945135,
      "label": "no_detected_loss",
      "q_prev": 0.8709898240945135,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.97)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 145,
      "mean_a": 75.08417508417509,
      "mean_b": 76.26262626262626,
      "delta": -1.1784511784511784,
      "ci95": [
       -3.763440862958816,
       1.4035087746143782
      ],
      "p": 0.4106589341065893,
      "mid_p": 0.3751,
      "per_seed": {
       "42": -0.7575757575757576,
       "43": -4.545454545454546,
       "44": 1.7676767676767677
      },
      "p_het": 0.20757924207579243,
      "mdd80": 3.692835644313187,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.69)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 44,
      "mean_a": 87.43055555555556,
      "mean_b": 87.60416666666667,
      "delta": -0.1736111111111111,
      "ci95": [
       -1.1111111120570314,
       0.7440476200395889
      ],
      "p": 0.7617238276172382,
      "mid_p": 0.7068,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": 0.10416666666666667,
       "44": -1.0416666666666667
      },
      "p_het": 0.5451454854514548,
      "mdd80": 1.3258879556184198,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.9521547845215478,
      "label_source": "no_detected_loss",
      "q": 0.9521547845215478,
      "label": "no_detected_loss",
      "q_prev": 0.9521547845215478,
      "label_prev": "no_detected_loss",
      "q_published": 0.9521547845215478,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.33)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "fp8kv_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 179,
      "mean_a": 79.66226138032306,
      "mean_b": 79.77239353891336,
      "delta": -0.11013215859030837,
      "ci95": [
       -1.5873015887531663,
       1.3687600660308705
      ],
      "p": 0.9253074692530747,
      "mid_p": 0.8888,
      "per_seed": {
       "42": 0.7709251101321586,
       "43": -0.6607929515418502,
       "44": -0.44052863436123346
      },
      "p_het": 0.6582341765823417,
      "mdd80": 2.112706840839471,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "fp8kv_s1",
       "bf16"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.11)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 23,
      "b_only": 18,
      "mean_a": 25.84269662921348,
      "mean_b": 23.970037453183522,
      "rate_a": 25.84269662921348,
      "rate_b": 23.970037453183522,
      "delta": 1.8726591760299625,
      "ci95": [
       -2.8985507292533508,
       6.666666671401507
      ],
      "p": 0.5344465553444655,
      "mid_p": 0.4439,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 6.741573033707865,
       "44": 1.1235955056179776
      },
      "p_het": 0.3498650134986501,
      "mdd80": 6.836291862781411,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 0.8552744725527447,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.84)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "fp8kv_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 239,
      "a_only": 133,
      "b_only": 106,
      "mean_a": 50.2,
      "mean_b": 48.4,
      "rate_a": 50.199999999999996,
      "rate_b": 48.400000000000006,
      "delta": 1.8,
      "ci95": [
       -0.2583979348050569,
       3.8095238115667645
      ],
      "p": 0.09419058094190581,
      "mid_p": 0.0818,
      "per_seed": {
       "42": 3.6,
       "43": 1.6,
       "44": 0.2
      },
      "p_het": 0.42525747425257476,
      "mdd80": 2.9073568501693776,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "fp8kv_s1",
       "dense_s1"
      ],
      "row_arm": "fp8kv_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.5382318910966046,
      "label_source": "no_detected_loss",
      "q": 0.5382318910966046,
      "label": "no_detected_loss",
      "q_prev": 0.5382318910966046,
      "label_prev": "no_detected_loss",
      "q_published": 0.5382318910966046,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.91)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 137,
      "mean_a": 76.43097643097643,
      "mean_b": 76.26262626262626,
      "delta": 0.16835016835016836,
      "ci95": [
       -2.5157232729413543,
       2.8619528646417667
      ],
      "p": 0.9486051394860514,
      "mid_p": 0.8982,
      "per_seed": {
       "42": -1.2626262626262625,
       "43": 1.0101010101010102,
       "44": 0.7575757575757576
      },
      "p_het": 0.7526247375262474,
      "mdd80": 3.8434425565190344,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.84)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 39,
      "mean_a": 87.91666666666667,
      "mean_b": 87.60416666666667,
      "delta": 0.3125,
      "ci95": [
       -0.47348484956914483,
       1.116071429443339
      ],
      "p": 0.5286471352864713,
      "mid_p": 0.47425,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": -0.10416666666666667,
       "44": 0.20833333333333334
      },
      "p_het": 0.7073292670732927,
      "mdd80": 1.1360610219797183,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.14)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "blasst_t50_s1",
      "b": "bf16",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 182,
      "mean_a": 80.46989720998532,
      "mean_b": 79.77239353891336,
      "delta": 0.697503671071953,
      "ci95": [
       -0.6329113936770066,
       2.045454546844798
      ],
      "p": 0.3280671932806719,
      "mid_p": 0.30295,
      "per_seed": {
       "42": -0.5506607929515418,
       "43": 0.0,
       "44": 2.643171806167401
      },
      "p_het": 0.1523847615238476,
      "mdd80": 1.9142368142606505,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "blasst_t50_s1",
       "bf16"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.8506735533343217,
      "label_source": "no_detected_loss",
      "q": 0.8552744725527447,
      "label": "no_detected_loss",
      "q_prev": 0.8552744725527447,
      "label_prev": "no_detected_loss",
      "q_published": 0.8506735533343217,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.91)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 32,
      "a_only": 16,
      "b_only": 16,
      "mean_a": 23.970037453183522,
      "mean_b": 23.970037453183522,
      "rate_a": 23.970037453183522,
      "rate_b": 23.970037453183522,
      "delta": 0.0,
      "ci95": [
       -4.44444444883845,
       4.5045045099257885
      ],
      "p": 1.0,
      "mid_p": 0.93435,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": -2.247191011235955,
       "44": 1.1235955056179776
      },
      "p_het": 0.8307169283071693,
      "mdd80": 6.395842810959819,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "source_md5": "1b7ec7410db857f613ff3caa388d09f3",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.40)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "blasst_t50_s1",
      "b": "dense_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 233,
      "a_only": 133,
      "b_only": 100,
      "mean_a": 50.6,
      "mean_b": 48.4,
      "rate_a": 50.6,
      "rate_b": 48.400000000000006,
      "delta": 2.2,
      "ci95": [
       0.2721088415733056,
       4.104477613711747
      ],
      "p": 0.030396960303969604,
      "mid_p": 0.02525,
      "per_seed": {
       "42": 3.4,
       "43": 2.4,
       "44": 0.8
      },
      "p_het": 0.5967403259674032,
      "mdd80": 2.7390063764106354,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "blasst_t50_s1",
       "dense_s1"
      ],
      "row_arm": "blasst_t50_s1",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "source_md5": "36c8c67e65e750babb97a5f8f94dace6",
      "q_source": 0.390960903909609,
      "label_source": "nominal_gain",
      "q": 0.5382318910966046,
      "label": "nominal_gain",
      "q_prev": 0.390960903909609,
      "label_prev": "nominal_gain",
      "q_published": 0.390960903909609,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.0304, q 0.54)"
     }
    ],
    "counts": {
     "m": 40,
     "by_bench": {
      "gpqa": 8,
      "aime25": 8,
      "lcb": 8,
      "tb": 8,
      "swe": 8
     },
     "n_p05": 2,
     "n_p05_below": 1,
     "n_p05_above": 1,
     "loss_detected": 0,
     "nominal_loss": 1,
     "gain_detected": 0,
     "nominal_gain": 1,
     "no_detected_loss": 38,
     "smallest_q_below": 0.5382318910966046
    },
    "counts_prev": {
     "m": 40,
     "by_bench": {
      "gpqa": 8,
      "aime25": 8,
      "lcb": 8,
      "tb": 8,
      "swe": 8
     },
     "n_p05": 2,
     "n_p05_below": 1,
     "n_p05_above": 1,
     "loss_detected": 0,
     "nominal_loss": 1,
     "gain_detected": 2,
     "nominal_gain": 1,
     "no_detected_loss": 36,
     "smallest_q_below": 0.390960903909609
    },
    "label_changes": [
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "fp8kv_s1_sxs",
       "dense_sxs"
      ],
      "source": "sxs",
      "delta": 1.3431833445265278,
      "p": 0.08869113088691132,
      "q_prev": 0.001999800019998,
      "q": 0.5382318910966046,
      "label_prev": "gain_detected",
      "label": "no_detected_loss"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "blasst_t50_s1_sxs",
       "dense_sxs"
      ],
      "source": "sxs",
      "delta": 1.4075067024128687,
      "p": 0.07929207079292071,
      "q_prev": 0.001999800019998,
      "q": 0.5382318910966046,
      "label_prev": "gain_detected",
      "label": "no_detected_loss"
     }
    ],
    "sources": [
     {
      "source": "published",
      "file": "log/sparse/dev/stats/paired_baselines_bl2.json",
      "md5": "36c8c67e65e750babb97a5f8f94dace6",
      "members": 30
     },
     {
      "source": "tbp v1",
      "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json",
      "md5": "1b7ec7410db857f613ff3caa388d09f3",
      "members": 8
     },
     {
      "source": "sxs",
      "file": null,
      "md5": null,
      "members": 2
     }
    ],
    "ruler": {
     "unchanged": true,
     "m": 8,
     "source": "log/sparse/dev/stats/paired_baselines_bl2.json",
     "why": "no RULER member is replaced: RULER keeps its own BH (prereg family_bh)"
    },
    "arm_status": [
     {
      "model": "qwen3.8-27b",
      "arm": "fp8kv_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.0,
        "ci95": [
         -1.630434784362527,
         1.630434784362527
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.3305540443587236,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3819444444444444,
        "ci95": [
         -1.3257575770593744,
         0.37202381034328436
        ],
        "p": 0.9078092190780922,
        "q": 1.0,
        "mdd80": 1.2134098575415464,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.3303964757709251,
        "ci95": [
         -1.7806267820305808,
         1.1111111126691067
        ],
        "p": 0.6862313768623137,
        "q": 0.9149751691497516,
        "mdd80": 2.066734441130288,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -3.100775200097675,
         9.166666673530106
        ],
        "p": 0.39976002399760024,
        "q": 0.8552744725527447,
        "mdd80": 8.767580447474622,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.3431833445265278,
        "ci95": [
         -0.1362397835148158,
         2.8169014099951077
        ],
        "p": 0.08869113088691132,
        "q": 0.5382318910966046,
        "mdd80": 2.1106195777060246,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.33, AIME25 1.21, LCB v6 2.07, Terminal-Bench 2.1 8.77, SWE-bench Verified 2.11)",
      "throughput_caveat_carried": true,
      "throughput_quotes_published": {
       "tb_s7prime": "no detected loss (MDD80 9.18)",
       "swe_s9": "above, detected (p 0.0001, q 0.00200)"
      },
      "r4b": "Unchanged in the main study; this archive does not end its published reference/window caveat.",
      "hypothetical_promotion_r4b": "ended: the rerun's own same-window reference (dense_sxs) replaces R4 (b)'s dense_s1d reading and the (w) flag"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.5050505050505051,
        "ci95": [
         -2.0618556716894254,
         1.0416666682593871
        ],
        "p": 0.6167383261673832,
        "q": 0.8810547516676903,
        "mdd80": 2.218097470225805,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.10416666666666667,
        "ci95": [
         -0.3205128210143112,
         0.5208333337325618
        ],
        "p": 0.8055194480551945,
        "q": 0.9680208449743262,
        "mdd80": 0.6013128223394801,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.9177679882525698,
        "ci95": [
         -0.5231689102829274,
         2.3696682480067355
        ],
        "p": 0.23637636236376364,
        "q": 0.8552744725527447,
        "mdd80": 2.067520088379109,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.4981273408239701,
        "ci95": [
         -3.968253974029337,
         7.017543866105296
        ],
        "p": 0.685031496850315,
        "q": 0.9149751691497516,
        "mdd80": 7.8515853048496655,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.4075067024128687,
        "ci95": [
         -0.1262626277042151,
         2.878787880449983
        ],
        "p": 0.07929207079292071,
        "q": 0.5382318910966046,
        "mdd80": 2.1477193330425757,
        "verdict": "no_detected_loss",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.22, AIME25 0.60, LCB v6 2.07, Terminal-Bench 2.1 7.85, SWE-bench Verified 2.15)",
      "throughput_caveat_carried": false,
      "throughput_quotes_published": null,
      "r4b": "Unchanged in the main study; this archive does not end its published reference/window caveat.",
      "hypothetical_promotion_r4b": "ended: the rerun's own same-window reference (dense_sxs) replaces R4 (b)'s dense_s1d reading and the (w) flag"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "fp8kv_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.7676767676767677,
        "ci95": [
         -3.8194444465536432,
         0.33003300535645375
        ],
        "p": 0.11248875112488751,
        "q": 0.5624437556244376,
        "mdd80": 2.9656449771173903,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.20833333333333334,
        "ci95": [
         -0.4340277785922392,
         0.8333333339680795
        ],
        "p": 0.6032396760323968,
        "q": 0.8810547516676903,
        "mdd80": 0.9057870927647228,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.697503671071953,
        "ci95": [
         -2.4745269304333233,
         1.0917030585350347
        ],
        "p": 0.46815318468153183,
        "q": 0.8552744725527447,
        "mdd80": 2.548796125922065,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 5.617977528089888,
        "ci95": [
         -5.793464987489628e-09,
         11.111111117358856
        ],
        "p": 0.064993500649935,
        "q": 0.5382318910966046,
        "mdd80": 7.94114711417494,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.3333333333333333,
        "ci95": [
         -1.2820512837723983,
         1.9531250015801054
        ],
        "p": 0.7468253174682532,
        "q": 0.9521547845215478,
        "mdd80": 2.312190971498939,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.97, AIME25 0.91, LCB v6 2.55, Terminal-Bench 2.1 7.94, SWE-bench Verified 2.31)",
      "throughput_caveat_carried": true,
      "throughput_quotes_published": {
       "tb_s7prime": "above, nominal (p 0.0488, q 0.39)",
       "swe_s9": null
      }
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.7575757575757576,
        "ci95": [
         -2.7777777797338405,
         1.257861637099707
        ],
        "p": 0.5138486151384861,
        "q": 0.8552744725527447,
        "mdd80": 2.884284564669728,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.2777777777777778,
        "ci95": [
         -0.5208333341989333,
         1.041666667631973
        ],
        "p": 0.53004699530047,
        "q": 0.8552744725527447,
        "mdd80": 1.116723813029202,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.7709251101321586,
        "ci95": [
         -2.5423728830547305,
         1.0014306168911848
        ],
        "p": 0.42645735426457354,
        "q": 0.8552744725527447,
        "mdd80": 2.532767841567087,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 3.745318352059925,
        "ci95": [
         -1.2345679053302583,
         8.695652178697763
        ],
        "p": 0.18138186181381863,
        "q": 0.7255274472552745,
        "mdd80": 7.0971604630148475,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.5333333333333334,
        "ci95": [
         -1.7301928840340625e-09,
         3.142076504377961
        ],
        "p": 0.07139286071392861,
        "q": 0.5382318910966046,
        "mdd80": 2.2456522576761544,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.88, AIME25 1.12, LCB v6 2.53, Terminal-Bench 2.1 7.10, SWE-bench Verified 2.25)",
      "throughput_caveat_carried": false,
      "throughput_quotes_published": null
     },
     {
      "model": "nemotron3-nano",
      "arm": "fp8kv_s1",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 1.0942760942760943,
        "ci95": [
         -1.456310682063262,
         3.645833335958234
        ],
        "p": 0.4313568643135686,
        "q": 0.8552744725527447,
        "mdd80": 3.646518858081705,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0763888888888888,
        "ci95": [
         -2.083333334420301,
         -0.08680555430573689
        ],
        "p": 0.0390960903909609,
        "q": 0.5382318910966046,
        "mdd80": 1.426924872202047,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.0,
        "ci95": [
         -1.579778832661435,
         1.5972222237275422
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.270612946899982,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.8726591760299625,
        "ci95": [
         -1.6260162639479452,
         5.405405409654057
        ],
        "p": 0.43215678432156784,
        "q": 0.8552744725527447,
        "mdd80": 5.025379848422401,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.0666666666666667,
        "ci95": [
         -1.066666668799463,
         3.2000000021327972
        ],
        "p": 0.36446355364463556,
        "q": 0.8552744725527447,
        "mdd80": 3.0494004915871473,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25)",
      "throughput_caveat_carried": true,
      "throughput_quotes_published": {
       "tb_s7prime": "no detected loss (MDD80 5.04)",
       "swe_s9": null
      }
     },
     {
      "model": "nemotron3-nano",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.4208754208754209,
        "ci95": [
         -2.48226950659365,
         3.3653846181874503
        ],
        "p": 0.8228177182281772,
        "q": 0.9680208449743262,
        "mdd80": 4.17933734646369,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3819444444444444,
        "ci95": [
         -1.4583333344188745,
         0.6944444457996455
        ],
        "p": 0.5345465453454654,
        "q": 0.8552744725527447,
        "mdd80": 1.5385972534484094,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.6607929515418502,
        "ci95": [
         -2.0740740754942104,
         0.7544581631832463
        ],
        "p": 0.39336066393360664,
        "q": 0.8552744725527447,
        "mdd80": 2.0215611540164,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -0.7407407444385912,
         6.666666670286942
        ],
        "p": 0.1576842315768423,
        "q": 0.700818807008188,
        "mdd80": 5.294098075609654,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.6666666666666666,
        "ci95": [
         -1.4048531309686005,
         2.7559055138627038
        ],
        "p": 0.5661433856614339,
        "q": 0.8709898240945135,
        "mdd80": 2.9737076822436155,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 4.18, AIME25 1.54, LCB v6 2.02, Terminal-Bench 2.1 5.29, SWE-bench Verified 2.97)",
      "throughput_caveat_carried": false,
      "throughput_quotes_published": null
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "fp8kv_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.1784511784511784,
        "ci95": [
         -3.763440862958816,
         1.4035087746143782
        ],
        "p": 0.4106589341065893,
        "q": 0.8552744725527447,
        "mdd80": 3.692835644313187,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.1736111111111111,
        "ci95": [
         -1.1111111120570314,
         0.7440476200395889
        ],
        "p": 0.7617238276172382,
        "q": 0.9521547845215478,
        "mdd80": 1.3258879556184198,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.11013215859030837,
        "ci95": [
         -1.5873015887531663,
         1.3687600660308705
        ],
        "p": 0.9253074692530747,
        "q": 1.0,
        "mdd80": 2.112706840839471,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.8726591760299625,
        "ci95": [
         -2.8985507292533508,
         6.666666671401507
        ],
        "p": 0.5344465553444655,
        "q": 0.8552744725527447,
        "mdd80": 6.836291862781411,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.8,
        "ci95": [
         -0.2583979348050569,
         3.8095238115667645
        ],
        "p": 0.09419058094190581,
        "q": 0.5382318910966046,
        "mdd80": 2.9073568501693776,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.69, AIME25 1.33, LCB v6 2.11, Terminal-Bench 2.1 6.84, SWE-bench Verified 2.91)",
      "throughput_caveat_carried": true,
      "throughput_quotes_published": {
       "tb_s7prime": "no detected loss (MDD80 7.33)",
       "swe_s9": null
      }
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.16835016835016836,
        "ci95": [
         -2.5157232729413543,
         2.8619528646417667
        ],
        "p": 0.9486051394860514,
        "q": 1.0,
        "mdd80": 3.8434425565190344,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.3125,
        "ci95": [
         -0.47348484956914483,
         1.116071429443339
        ],
        "p": 0.5286471352864713,
        "q": 0.8552744725527447,
        "mdd80": 1.1360610219797183,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.697503671071953,
        "ci95": [
         -0.6329113936770066,
         2.045454546844798
        ],
        "p": 0.3280671932806719,
        "q": 0.8552744725527447,
        "mdd80": 1.9142368142606505,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.0,
        "ci95": [
         -4.44444444883845,
         4.5045045099257885
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 6.395842810959819,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.2,
        "ci95": [
         0.2721088415733056,
         4.104477613711747
        ],
        "p": 0.030396960303969604,
        "q": 0.5382318910966046,
        "mdd80": 2.7390063764106354,
        "verdict": "nominal_gain",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.84, AIME25 1.14, LCB v6 1.91, Terminal-Bench 2.1 6.40, SWE-bench Verified 2.74)",
      "throughput_caveat_carried": false,
      "throughput_quotes_published": null
     }
    ],
    "arm_status_prev": [
     {
      "model": "qwen3.8-27b",
      "arm": "fp8kv_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.0,
        "ci95": [
         -1.630434784362527,
         1.630434784362527
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.3305540443587236,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3819444444444444,
        "ci95": [
         -1.3257575770593744,
         0.37202381034328436
        ],
        "p": 0.9078092190780922,
        "q": 1.0,
        "mdd80": 1.2134098575415464,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.3303964757709251,
        "ci95": [
         -1.7806267820305808,
         1.1111111126691067
        ],
        "p": 0.6862313768623137,
        "q": 0.9149751691497516,
        "mdd80": 2.066734441130288,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -3.100775200097675,
         9.166666673530106
        ],
        "p": 0.39976002399760024,
        "q": 0.8552744725527447,
        "mdd80": 8.767580447474622,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.3431833445265278,
        "ci95": [
         -0.1362397835148158,
         2.8169014099951077
        ],
        "p": 0.08869113088691132,
        "q": 0.001999800019998,
        "mdd80": 2.1106195777060246,
        "verdict": "gain_detected",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.33, AIME25 1.21, LCB v6 2.07, Terminal-Bench 2.1 8.77, SWE-bench Verified 2.11)"
     },
     {
      "model": "qwen3.8-27b",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": -0.5050505050505051,
        "ci95": [
         -2.0618556716894254,
         1.0416666682593871
        ],
        "p": 0.6167383261673832,
        "q": 0.8810547516676903,
        "mdd80": 2.218097470225805,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.10416666666666667,
        "ci95": [
         -0.3205128210143112,
         0.5208333337325618
        ],
        "p": 0.8055194480551945,
        "q": 0.9680208449743262,
        "mdd80": 0.6013128223394801,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.9177679882525698,
        "ci95": [
         -0.5231689102829274,
         2.3696682480067355
        ],
        "p": 0.23637636236376364,
        "q": 0.8552744725527447,
        "mdd80": 2.067520088379109,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.4981273408239701,
        "ci95": [
         -3.968253974029337,
         7.017543866105296
        ],
        "p": 0.685031496850315,
        "q": 0.9149751691497516,
        "mdd80": 7.8515853048496655,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.4075067024128687,
        "ci95": [
         -0.1262626277042151,
         2.878787880449983
        ],
        "p": 0.07929207079292071,
        "q": 0.001999800019998,
        "mdd80": 2.1477193330425757,
        "verdict": "gain_detected",
        "source": "sxs"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.22, AIME25 0.60, LCB v6 2.07, Terminal-Bench 2.1 7.85, SWE-bench Verified 2.15)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "fp8kv_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.7676767676767677,
        "ci95": [
         -3.8194444465536432,
         0.33003300535645375
        ],
        "p": 0.11248875112488751,
        "q": 0.5624437556244376,
        "mdd80": 2.9656449771173903,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.20833333333333334,
        "ci95": [
         -0.4340277785922392,
         0.8333333339680795
        ],
        "p": 0.6032396760323968,
        "q": 0.8810547516676903,
        "mdd80": 0.9057870927647228,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.697503671071953,
        "ci95": [
         -2.4745269304333233,
         1.0917030585350347
        ],
        "p": 0.46815318468153183,
        "q": 0.8552744725527447,
        "mdd80": 2.548796125922065,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 5.617977528089888,
        "ci95": [
         -5.793464987489628e-09,
         11.111111117358856
        ],
        "p": 0.064993500649935,
        "q": 0.47595240475952405,
        "mdd80": 7.94114711417494,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.3333333333333333,
        "ci95": [
         -1.2820512837723983,
         1.9531250015801054
        ],
        "p": 0.7468253174682532,
        "q": 0.9521547845215478,
        "mdd80": 2.312190971498939,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.97, AIME25 0.91, LCB v6 2.55, Terminal-Bench 2.1 7.94, SWE-bench Verified 2.31)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -0.7575757575757576,
        "ci95": [
         -2.7777777797338405,
         1.257861637099707
        ],
        "p": 0.5138486151384861,
        "q": 0.8552744725527447,
        "mdd80": 2.884284564669728,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.2777777777777778,
        "ci95": [
         -0.5208333341989333,
         1.041666667631973
        ],
        "p": 0.53004699530047,
        "q": 0.8552744725527447,
        "mdd80": 1.116723813029202,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.7709251101321586,
        "ci95": [
         -2.5423728830547305,
         1.0014306168911848
        ],
        "p": 0.42645735426457354,
        "q": 0.8552744725527447,
        "mdd80": 2.532767841567087,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 3.745318352059925,
        "ci95": [
         -1.2345679053302583,
         8.695652178697763
        ],
        "p": 0.18138186181381863,
        "q": 0.7255274472552745,
        "mdd80": 7.0971604630148475,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.5333333333333334,
        "ci95": [
         -1.7301928840340625e-09,
         3.142076504377961
        ],
        "p": 0.07139286071392861,
        "q": 0.47595240475952405,
        "mdd80": 2.2456522576761544,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 2.88, AIME25 1.12, LCB v6 2.53, Terminal-Bench 2.1 7.10, SWE-bench Verified 2.25)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "fp8kv_s1",
      "status": "nominal only",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": false,
      "detected": [],
      "nominal": [
       "aime25"
      ],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 1.0942760942760943,
        "ci95": [
         -1.456310682063262,
         3.645833335958234
        ],
        "p": 0.4313568643135686,
        "q": 0.8552744725527447,
        "mdd80": 3.646518858081705,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -1.0763888888888888,
        "ci95": [
         -2.083333334420301,
         -0.08680555430573689
        ],
        "p": 0.0390960903909609,
        "q": 0.390960903909609,
        "mdd80": 1.426924872202047,
        "verdict": "nominal_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.0,
        "ci95": [
         -1.579778832661435,
         1.5972222237275422
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 2.270612946899982,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.8726591760299625,
        "ci95": [
         -1.6260162639479452,
         5.405405409654057
        ],
        "p": 0.43215678432156784,
        "q": 0.8552744725527447,
        "mdd80": 5.025379848422401,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.0666666666666667,
        "ci95": [
         -1.066666668799463,
         3.2000000021327972
        ],
        "p": 0.36446355364463556,
        "q": 0.8552744725527447,
        "mdd80": 3.0494004915871473,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "nominal only (AIME25)"
     },
     {
      "model": "nemotron3-nano",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": 0.4208754208754209,
        "ci95": [
         -2.48226950659365,
         3.3653846181874503
        ],
        "p": 0.8228177182281772,
        "q": 0.9680208449743262,
        "mdd80": 4.17933734646369,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.3819444444444444,
        "ci95": [
         -1.4583333344188745,
         0.6944444457996455
        ],
        "p": 0.5345465453454654,
        "q": 0.8552744725527447,
        "mdd80": 1.5385972534484094,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.6607929515418502,
        "ci95": [
         -2.0740740754942104,
         0.7544581631832463
        ],
        "p": 0.39336066393360664,
        "q": 0.8552744725527447,
        "mdd80": 2.0215611540164,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 2.9962546816479403,
        "ci95": [
         -0.7407407444385912,
         6.666666670286942
        ],
        "p": 0.1576842315768423,
        "q": 0.700818807008188,
        "mdd80": 5.294098075609654,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 0.6666666666666666,
        "ci95": [
         -1.4048531309686005,
         2.7559055138627038
        ],
        "p": 0.5661433856614339,
        "q": 0.8709898240945135,
        "mdd80": 2.9737076822436155,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 4.18, AIME25 1.54, LCB v6 2.02, Terminal-Bench 2.1 5.29, SWE-bench Verified 2.97)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "fp8kv_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [],
      "cells": {
       "gpqa": {
        "delta": -1.1784511784511784,
        "ci95": [
         -3.763440862958816,
         1.4035087746143782
        ],
        "p": 0.4106589341065893,
        "q": 0.8552744725527447,
        "mdd80": 3.692835644313187,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": -0.1736111111111111,
        "ci95": [
         -1.1111111120570314,
         0.7440476200395889
        ],
        "p": 0.7617238276172382,
        "q": 0.9521547845215478,
        "mdd80": 1.3258879556184198,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": -0.11013215859030837,
        "ci95": [
         -1.5873015887531663,
         1.3687600660308705
        ],
        "p": 0.9253074692530747,
        "q": 1.0,
        "mdd80": 2.112706840839471,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 1.8726591760299625,
        "ci95": [
         -2.8985507292533508,
         6.666666671401507
        ],
        "p": 0.5344465553444655,
        "q": 0.8552744725527447,
        "mdd80": 6.836291862781411,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 1.8,
        "ci95": [
         -0.2583979348050569,
         3.8095238115667645
        ],
        "p": 0.09419058094190581,
        "q": 0.5382318910966046,
        "mdd80": 2.9073568501693776,
        "verdict": "no_detected_loss",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.69, AIME25 1.33, LCB v6 2.11, Terminal-Bench 2.1 6.84, SWE-bench Verified 2.91)"
     },
     {
      "model": "nemotron3.5-lightning",
      "arm": "blasst_t50_s1",
      "status": "no detected loss",
      "benches": [
       "gpqa",
       "aime25",
       "lcb",
       "tb",
       "swe"
      ],
      "all_five": true,
      "lossless_on_five": true,
      "detected": [],
      "nominal": [],
      "above": [
       "swe"
      ],
      "cells": {
       "gpqa": {
        "delta": 0.16835016835016836,
        "ci95": [
         -2.5157232729413543,
         2.8619528646417667
        ],
        "p": 0.9486051394860514,
        "q": 1.0,
        "mdd80": 3.8434425565190344,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "aime25": {
        "delta": 0.3125,
        "ci95": [
         -0.47348484956914483,
         1.116071429443339
        ],
        "p": 0.5286471352864713,
        "q": 0.8552744725527447,
        "mdd80": 1.1360610219797183,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "lcb": {
        "delta": 0.697503671071953,
        "ci95": [
         -0.6329113936770066,
         2.045454546844798
        ],
        "p": 0.3280671932806719,
        "q": 0.8552744725527447,
        "mdd80": 1.9142368142606505,
        "verdict": "no_detected_loss",
        "source": "published"
       },
       "tb": {
        "delta": 0.0,
        "ci95": [
         -4.44444444883845,
         4.5045045099257885
        ],
        "p": 1.0,
        "q": 1.0,
        "mdd80": 6.395842810959819,
        "verdict": "no_detected_loss",
        "source": "tbp v1"
       },
       "swe": {
        "delta": 2.2,
        "ci95": [
         0.2721088415733056,
         4.104477613711747
        ],
        "p": 0.030396960303969604,
        "q": 0.390960903909609,
        "mdd80": 2.7390063764106354,
        "verdict": "nominal_gain",
        "source": "published"
       }
      },
      "status_text": "no detected loss on the five (MDD80 GPQA 3.84, AIME25 1.14, LCB v6 1.91, Terminal-Bench 2.1 6.40, SWE-bench Verified 2.74)"
     }
    ],
    "arm_status_changes": [],
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "members": {
       "fp8kv_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 0.941346850108617,
        "ci95": [
         -0.5540166219252517,
         2.4182076828111176
        ],
        "p": 0.24367563243675633,
        "n_items": 1381,
        "mean_a": 88.26937002172339,
        "mean_b": 87.32802317161477,
        "per_seed": {
         "42": 1.0893246187363834,
         "43": 1.293103448275862,
         "44": 0.4366812227074236
        },
        "p_het": 0.9205079492050795,
        "mdd80": 2.1242583391193275,
        "shift_vs_primary": -0.4018364944179108,
        "q_sub": 0.8552744725527447,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "blasst_t50_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.083815028901734,
        "ci95": [
         -0.45523520646707416,
         2.620689656637405
        ],
        "p": 0.20187981201879812,
        "n_items": 1384,
        "mean_a": 88.36705202312139,
        "mean_b": 87.28323699421965,
        "per_seed": {
         "42": 2.178649237472767,
         "43": 2.159827213822894,
         "44": -1.0822510822510822
        },
        "p_het": 0.1566843315668433,
        "mdd80": 2.1983734641231,
        "shift_vs_primary": -0.3236916735111346,
        "q_sub": 0.8552744725527447,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "members": {
       "fp8kv_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.4864864864864864,
        "ci95": [
         -1.4960290861451931e-09,
         2.9457364357826092
        ],
        "p": 0.060493950604939506,
        "n_items": 1480,
        "mean_a": 88.37837837837837,
        "mean_b": 86.89189189189189,
        "per_seed": {
         "42": 1.6260162601626016,
         "43": 1.8108651911468814,
         "44": 1.0183299389002036
        },
        "p_het": 0.9271072892710729,
        "mdd80": 2.1053273744398084,
        "shift_vs_primary": 0.14330314195995864,
        "q_sub": 0.5286138052861381,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "blasst_t50_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.416048550236008,
        "ci95": [
         -0.12674271374187684,
         2.8947368435476104
        ],
        "p": 0.07929207079292071,
        "n_items": 1483,
        "mean_a": 88.2670262980445,
        "mean_b": 86.8509777478085,
        "per_seed": {
         "42": 2.4390243902439024,
         "43": 2.620967741935484,
         "44": -0.8080808080808081
        },
        "p_het": 0.11818818118188182,
        "mdd80": 2.1594612276814913,
        "shift_vs_primary": 0.008541847823139381,
        "q_sub": 0.5286138052861381,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "unavailable",
      "why": "unavailable: the route-(i) scan was not validated before the START marker"
     },
     "drop_probed": {
      "status": "complete",
      "members": {
       "fp8kv_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.6371077762619373,
        "ci95": [
         0.14064697455307312,
         3.09973045966168
        ],
        "p": 0.0385961403859614,
        "n_items": 1466,
        "mean_a": 88.54024556616643,
        "mean_b": 86.9031377899045,
        "per_seed": {
         "42": 1.4141414141414141,
         "43": 1.8,
         "44": 1.6985138004246285
        },
        "p_het": 0.9802019798020198,
        "mdd80": 2.1148665527616646,
        "shift_vs_primary": 0.2939244317354095,
        "q_sub": 0.46795320467953205,
        "label_sub": "nominal_gain",
        "label_primary": "no_detected_loss",
        "label_changed": true
       },
       "blasst_t50_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.5656909462219197,
        "ci95": [
         0.13106159757155872,
         3.0346820824796312
        ],
        "p": 0.046795320467953205,
        "n_items": 1469,
        "mean_a": 88.42750170183798,
        "mean_b": 86.86181075561606,
        "per_seed": {
         "42": 2.4242424242424243,
         "43": 2.6052104208416833,
         "44": -0.42105263157894735
        },
        "p_het": 0.19768023197680232,
        "mdd80": 2.0752269668458863,
        "shift_vs_primary": 0.15818424380905105,
        "q_sub": 0.46795320467953205,
        "label_sub": "nominal_gain",
        "label_primary": "no_detected_loss",
        "label_changed": true
       }
      },
      "other_label_changes": [],
      "left_out": [
       [
        44,
        252
       ],
       [
        44,
        253
       ],
       [
        44,
        254
       ],
       [
        44,
        255
       ],
       [
        44,
        256
       ],
       [
        44,
        257
       ],
       [
        44,
        258
       ],
       [
        44,
        259
       ],
       [
        44,
        263
       ],
       [
        44,
        267
       ],
       [
        44,
        271
       ],
       [
        44,
        272
       ],
       [
        44,
        273
       ],
       [
        44,
        274
       ],
       [
        44,
        275
       ],
       [
        44,
        276
       ],
       [
        44,
        281
       ],
       [
        44,
        298
       ],
       [
        44,
        303
       ],
       [
        44,
        308
       ],
       [
        44,
        310
       ],
       [
        44,
        311
       ],
       [
        44,
        312
       ]
      ],
      "applies_to": [
       "fp8kv_s1_sxs|dense_sxs",
       "blasst_t50_s1_sxs|dense_sxs"
      ],
      "not_applicable": []
     },
     "by_period_stack": {
      "status": "unavailable",
      "why": "Final registered stack record and split inputs were not completed."
     },
     "zero_as_failure": {
      "status": "complete",
      "members": {
       "fp8kv_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.0666666666666667,
        "ci95": [
         -0.40650406653561644,
         2.544529263496594
        ],
        "p": 0.18418158184181582,
        "n_items": 1500,
        "mean_a": 87.73333333333333,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 1.6,
         "43": 1.8,
         "44": -0.2
        },
        "p_het": 0.5414458554144586,
        "mdd80": 2.109113080850077,
        "shift_vs_primary": -0.2765166778598611,
        "q_sub": 0.7367263273672633,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "fp8kv_s1_sxs": 8,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "fp8kv_s1_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "fp8kv_s1_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 11
       },
       "blasst_t50_s1_sxs|dense_sxs": {
        "status": "complete",
        "delta": 1.2666666666666666,
        "ci95": [
         -0.26666666819627555,
         2.777777779345816
        ],
        "p": 0.12568743125687432,
        "n_items": 1500,
        "mean_a": 87.93333333333334,
        "mean_b": 86.66666666666667,
        "per_seed": {
         "42": 2.4,
         "43": 2.4,
         "44": -1.0
        },
        "p_het": 0.10568943105689431,
        "mdd80": 2.175874309139817,
        "shift_vs_primary": -0.14084003574620207,
        "q_sub": 0.7182138928964247,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "blasst_t50_s1_sxs": 7,
         "dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "blasst_t50_s1_sxs": 0,
         "dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "blasst_t50_s1_sxs": 0,
         "dense_sxs": 0
        },
        "pairs_restored": 8
       }
      },
      "other_label_changes": [],
      "rule": "the addendum v2's zero_token_as_failure: every (seed, instance) an item, no pair dropped; a zero-token row (tokens == 0, whatever its resolved field) or a missing row scores 0 on its side; same test and seed tuple as the contrast; the label its p gets substituted into the family's BH; never decides",
      "items_total": 1500
     }
    },
    "hypothetical_promotion_notes": [
     "R5 throughput caveat carried per arm from the published B12 arm status (throughput_caveat_carried); its quotes of (s7') / (s9) refer to the published cells -- the Qwen3.8 SWE-bench (s9) quote is not recomputed for the rerun cell (not in the sxs plan): the promotion states the caveat without it",
     "R4 (b) (dense_s1d) and the (w) flag of the two Qwen3.8 SWE-bench cells end (prereg contrasts.B12.source)"
    ],
    "notes": [
     "No promotion occurred. R4(b), the (w) flag and other main-study caveats remain as published. The hypothetical_promotion_notes field preserves the superseded procedure metadata only."
    ]
   },
   "F6": {
    "title": "(6) Sparse vs dense within the final method",
    "seed_tuple": [
     20261024,
     26,
     0,
     1
    ],
    "specs": [
     [
      "jqs_f_r40_sxs",
      "jqs_f_dense_sxs"
     ],
     [
      "jqs_f_r60_sxs",
      "jqs_f_dense_sxs"
     ],
     [
      "jqs_f_u32_sxs",
      "jqs_f_dense_sxs"
     ],
     [
      "jqs_f_u64_sxs",
      "jqs_f_dense_sxs"
     ],
     [
      "jqs_f_u128_sxs",
      "jqs_f_dense_sxs"
     ]
    ],
    "replaces": [
     [
      "jqs_f_r40",
      "jqs_f_dense"
     ],
     [
      "jqs_f_r60",
      "jqs_f_dense"
     ],
     [
      "jqs_f_u32",
      "jqs_f_dense"
     ],
     [
      "jqs_f_u64",
      "jqs_f_dense"
     ],
     [
      "jqs_f_u128",
      "jqs_f_dense"
     ]
    ],
    "family_m_registered": 100,
    "m": 100,
    "status": "ARCHIVAL ONLY; integrity gate failed; not used in main comparison",
    "removed": [],
    "members": [
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 31,
      "mean_a": 89.05723905723906,
      "mean_b": 90.57239057239057,
      "delta": -1.5151515151515151,
      "ci95": [
       -3.6303630383778174,
       0.653594773342882
      ],
      "p": 0.22207779222077792,
      "mid_p": 0.17255,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": -2.525252525252525,
       "44": -1.5151515151515151
      },
      "p_het": 0.6556344365563443,
      "mdd80": 3.061758525923317,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7815885078158851,
      "label_source": "no_detected_loss",
      "q": 0.7563759753056952,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.06)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 98.88888888888889,
      "mean_b": 98.68055555555556,
      "delta": 0.20833333333333334,
      "ci95": [
       -0.8680555569111224,
       1.3257575772950256
      ],
      "p": 0.8122187781221878,
      "mid_p": 0.7204,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": 1.25,
       "44": -0.8333333333333334
      },
      "p_het": 0.10338966103389662,
      "mdd80": 1.567925353877446,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.57)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 162,
      "mean_a": 86.63729809104258,
      "mean_b": 86.63729809104258,
      "delta": 0.0,
      "ci95": [
       -1.9259259278691137,
       1.9259259278691137
      ],
      "p": 1.0,
      "mid_p": 0.9693,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -0.44052863436123346,
       "44": 1.1013215859030836
      },
      "p_het": 0.7269273072692731,
      "mdd80": 2.752930999374875,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.75)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 38,
      "a_only": 11,
      "b_only": 27,
      "mean_a": 69.66292134831461,
      "mean_b": 75.65543071161049,
      "rate_a": 69.66292134831461,
      "rate_b": 75.65543071161049,
      "delta": -5.992509363295881,
      "ci95": [
       -10.52631579476699,
       -1.5151515106237052
      ],
      "p": 0.015298470152984701,
      "mid_p": 0.0105,
      "per_seed": {
       "42": -4.49438202247191,
       "43": -6.741573033707865,
       "44": -6.741573033707865
      },
      "p_het": 0.9352064793520648,
      "mdd80": 6.440308305554847,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.2985415744139872,
      "label_source": "nominal_loss",
      "q": 0.2985415744139872,
      "label": "nominal_loss",
      "q_prev": 0.2985415744139872,
      "label_prev": "nominal_loss",
      "q_published": 0.2985415744139872,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0153, q 0.30)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r40_sxs",
      "b": "jqs_f_dense_sxs",
      "n_items": 1491,
      "n_clusters": 500,
      "n_diff_items": 160,
      "a_only": 68,
      "b_only": 92,
      "mean_a": 85.7813547954393,
      "mean_b": 87.39101274312542,
      "rate_a": 85.46666666666665,
      "rate_b": 87.0,
      "delta": -1.6096579476861168,
      "ci95": [
       -3.333333335045781,
       0.1342281896575528
      ],
      "p": 0.0841915808419158,
      "mid_p": 0.07065,
      "per_seed": {
       "42": 1.4112903225806452,
       "43": -2.80561122244489,
       "44": -3.4274193548387095
      },
      "p_het": 0.032296770322967704,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "jqs_f_dense_sxs"
      ],
      "row_arm": "jqs_f_r40",
      "source": "sxs",
      "replaces": [
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "seed_tuple": [
       20261024,
       26,
       0,
       1
      ],
      "label_text": "final rho 0.40 (sxs) vs final dense NVFP4 (sxs)",
      "mdd80": 2.4782774548752426,
      "se": 0.8861680214958311,
      "ci95_bootstrap": [
       -3.2863849765258215,
       0.1342281879194631
      ],
      "mdd80_cell": 2.4782774548752426,
      "q": 0.4727305047273051,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.48)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 32,
      "mean_a": 89.8989898989899,
      "mean_b": 90.57239057239057,
      "delta": -0.6734006734006734,
      "ci95": [
       -3.0303030326608704,
       1.6501650187730472
      ],
      "p": 0.6806319368063194,
      "mid_p": 0.58515,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -1.5151515151515151,
       "44": -1.0101010101010102
      },
      "p_het": 0.6551344865513449,
      "mdd80": 3.345145678741757,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9842071348420713,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.35)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 98.88888888888889,
      "mean_b": 98.68055555555556,
      "delta": 0.20833333333333334,
      "ci95": [
       -0.8578431382026952,
       1.2820512832997766
      ],
      "p": 0.8085191480851914,
      "mid_p": 0.71615,
      "per_seed": {
       "42": 0.625,
       "43": 0.8333333333333334,
       "44": -0.8333333333333334
      },
      "p_het": 0.22577742225777422,
      "mdd80": 1.5293894752383936,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.53)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 137,
      "mean_a": 87.88546255506608,
      "mean_b": 86.63729809104258,
      "delta": 1.2481644640234948,
      "ci95": [
       -0.587371514315082,
       3.0837004423620717
      ],
      "p": 0.2116788321167883,
      "mid_p": 0.18535,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": 0.6607929515418502,
       "44": 2.643171806167401
      },
      "p_het": 0.5086491350864913,
      "mdd80": 2.6237270198792233,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7815885078158851,
      "label_source": "no_detected_loss",
      "q": 0.7563759753056952,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.62)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 38,
      "a_only": 17,
      "b_only": 21,
      "mean_a": 74.15730337078652,
      "mean_b": 75.65543071161049,
      "rate_a": 74.15730337078651,
      "rate_b": 75.65543071161049,
      "delta": -1.4981273408239701,
      "ci95": [
       -5.833333338159433,
       2.8368794367311416
      ],
      "p": 0.6094390560943905,
      "mid_p": 0.50015,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -2.247191011235955,
       "44": 1.1235955056179776
      },
      "p_het": 0.7872212778722127,
      "mdd80": 6.196629157379106,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.20)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r60_sxs",
      "b": "jqs_f_dense_sxs",
      "n_items": 1494,
      "n_clusters": 500,
      "n_diff_items": 162,
      "a_only": 86,
      "b_only": 76,
      "mean_a": 87.88487282463186,
      "mean_b": 87.21552878179384,
      "rate_a": 87.66666666666667,
      "rate_b": 87.0,
      "delta": 0.6693440428380187,
      "ci95": [
       -1.036269431699286,
       2.3684210543001227
      ],
      "p": 0.4904509549045096,
      "mid_p": 0.4448,
      "per_seed": {
       "42": 2.6156941649899395,
       "43": 0.8,
       "44": -1.408450704225352
      },
      "p_het": 0.1444855514448555,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "jqs_f_dense_sxs"
      ],
      "row_arm": "jqs_f_r60",
      "source": "sxs",
      "replaces": [
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "seed_tuple": [
       20261024,
       26,
       0,
       1
      ],
      "label_text": "final rho 0.60 (sxs) vs final dense NVFP4 (sxs)",
      "mdd80": 2.433343319842741,
      "se": 0.872898705992493,
      "ci95_bootstrap": [
       -1.0702341137123745,
       2.403204272363151
      ],
      "mdd80_cell": 2.4782774548752426,
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.9814112928329808,
      "label_prev": "no_detected_loss",
      "q_published": 0.9814112928329808,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.43)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 23,
      "mean_a": 91.07744107744108,
      "mean_b": 90.57239057239057,
      "delta": 0.5050505050505051,
      "ci95": [
       -1.3071895442370725,
       2.2727272747116434
      ],
      "p": 0.7086291370862914,
      "mid_p": 0.58725,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 1.0101010101010102,
       "44": 0.0
      },
      "p_het": 0.9583041695830417,
      "mdd80": 2.558578147647529,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9842071348420713,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.56)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 99.02777777777777,
      "mean_b": 98.68055555555556,
      "delta": 0.3472222222222222,
      "ci95": [
       -0.34722222310215245,
       1.1217948726983347
      ],
      "p": 0.6303369663033697,
      "mid_p": 0.50395,
      "per_seed": {
       "42": 1.0416666666666667,
       "43": 1.25,
       "44": -1.25
      },
      "p_het": 0.020397960203979604,
      "mdd80": 1.0499112772512738,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9965670099656702,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.05)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 145,
      "mean_a": 88.91336270190895,
      "mean_b": 86.63729809104258,
      "delta": 2.276064610866373,
      "ci95": [
       0.587371510795511,
       3.964757710937235
      ],
      "p": 0.0100989901009899,
      "mid_p": 0.008,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": 2.4229074889867843,
       "44": 3.303964757709251
      },
      "p_het": 0.5941405859414058,
      "mdd80": 2.4138288582879865,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.25247475252474755,
      "label_source": "nominal_gain",
      "q": 0.25247475252474755,
      "label": "nominal_gain",
      "q_prev": 0.25247475252474755,
      "label_prev": "nominal_gain",
      "q_published": 0.25247475252474755,
      "label_published": "nominal_gain",
      "changed": false,
      "text": "above, nominal (p 0.0101, q 0.25)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 33,
      "a_only": 13,
      "b_only": 20,
      "mean_a": 73.03370786516854,
      "mean_b": 75.65543071161049,
      "rate_a": 73.03370786516854,
      "rate_b": 75.65543071161049,
      "delta": -2.6217228464419478,
      "ci95": [
       -7.40740741212548,
       2.2222222270112284
      ],
      "p": 0.3575642435756424,
      "mid_p": 0.288,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -4.49438202247191,
       "44": 0.0
      },
      "p_het": 0.7153284671532847,
      "mdd80": 6.882327498287914,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.88)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u32_sxs",
      "b": "jqs_f_dense_sxs",
      "n_items": 1496,
      "n_clusters": 500,
      "n_diff_items": 174,
      "a_only": 88,
      "b_only": 86,
      "mean_a": 87.3663101604278,
      "mean_b": 87.23262032085562,
      "rate_a": 87.33333333333333,
      "rate_b": 87.0,
      "delta": 0.13368983957219252,
      "ci95": [
       -1.7173051537377844,
       1.9815059463439462
      ],
      "p": 0.9425057494250575,
      "mid_p": 0.88795,
      "per_seed": {
       "42": 1.8072289156626506,
       "43": -0.6,
       "44": -0.8032128514056225
      },
      "p_het": 0.37946205379462056,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "jqs_f_dense_sxs"
      ],
      "row_arm": "jqs_f_u32",
      "source": "sxs",
      "replaces": [
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "seed_tuple": [
       20261024,
       26,
       0,
       1
      ],
      "label_text": "final N = 32 (sxs) vs final dense NVFP4 (sxs)",
      "mdd80": 2.643552275531463,
      "se": 0.9437617837481891,
      "ci95_bootstrap": [
       -1.6733601070950468,
       2.0026702269692924
      ],
      "mdd80_cell": 2.4782774548752426,
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.64)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 28,
      "mean_a": 90.9090909090909,
      "mean_b": 90.57239057239057,
      "delta": 0.3367003367003367,
      "ci95": [
       -1.4184397181575927,
       2.105263159732931
      ],
      "p": 0.8521147885211479,
      "mid_p": 0.71485,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 2.0202020202020203,
       "44": -1.5151515151515151
      },
      "p_het": 0.2963703629637036,
      "mdd80": 2.518401861868109,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.52)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 98.26388888888889,
      "mean_b": 98.68055555555556,
      "delta": -0.4166666666666667,
      "ci95": [
       -1.4423076935029648,
       0.5681818195382915
      ],
      "p": 0.5201479852014799,
      "mid_p": 0.4394,
      "per_seed": {
       "42": 0.0,
       "43": 0.625,
       "44": -1.875
      },
      "p_het": 0.059994000599940006,
      "mdd80": 1.4369033679538048,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9814112928329808,
      "label_source": "no_detected_loss",
      "q": 0.9457236094572361,
      "label": "no_detected_loss",
      "q_prev": 0.9814112928329808,
      "label_prev": "no_detected_loss",
      "q_published": 0.9814112928329808,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.44)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 88.54625550660793,
      "mean_b": 86.63729809104258,
      "delta": 1.908957415565345,
      "ci95": [
       -1.891561949847891e-09,
       3.8226299714055796
      ],
      "p": 0.05729427057294271,
      "mid_p": 0.0487,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": 0.6607929515418502,
       "44": 5.286343612334802
      },
      "p_het": 0.0108989101089891,
      "mdd80": 2.7320460253299075,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.419291404192914,
      "label_source": "no_detected_loss",
      "q": 0.419291404192914,
      "label": "no_detected_loss",
      "q_prev": 0.419291404192914,
      "label_prev": "no_detected_loss",
      "q_published": 0.419291404192914,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.73)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 15,
      "b_only": 26,
      "mean_a": 71.53558052434457,
      "mean_b": 75.65543071161049,
      "rate_a": 71.53558052434458,
      "rate_b": 75.65543071161049,
      "delta": -4.119850187265918,
      "ci95": [
       -8.730158735031596,
       0.5952380989878483
      ],
      "p": 0.10728927107289271,
      "mid_p": 0.07865,
      "per_seed": {
       "42": -2.247191011235955,
       "43": -6.741573033707865,
       "44": -3.3707865168539324
      },
      "p_het": 0.7875212478752125,
      "mdd80": 6.664891326908063,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.5646803740678564,
      "label_source": "no_detected_loss",
      "q": 0.5161388623042458,
      "label": "no_detected_loss",
      "q_prev": 0.5646803740678564,
      "label_prev": "no_detected_loss",
      "q_published": 0.6734109197775875,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.66)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u64_sxs",
      "b": "jqs_f_dense_sxs",
      "n_items": 1495,
      "n_clusters": 500,
      "n_diff_items": 171,
      "a_only": 93,
      "b_only": 78,
      "mean_a": 88.22742474916387,
      "mean_b": 87.22408026755853,
      "rate_a": 88.13333333333333,
      "rate_b": 87.0,
      "delta": 1.0033444816053512,
      "ci95": [
       -0.8064516147217657,
       2.820512822253544
      ],
      "p": 0.3150684931506849,
      "mid_p": 0.2818,
      "per_seed": {
       "42": 3.6217303822937628,
       "43": -0.6,
       "44": 0.0
      },
      "p_het": 0.0887911208879112,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "jqs_f_dense_sxs"
      ],
      "row_arm": "jqs_f_u64",
      "source": "sxs",
      "replaces": [
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "seed_tuple": [
       20261024,
       26,
       0,
       1
      ],
      "label_text": "final N = 64 (sxs) vs final dense NVFP4 (sxs)",
      "mdd80": 2.5922032326619515,
      "se": 0.9106062498277652,
      "ci95_bootstrap": [
       -0.7362784471218207,
       2.805658107659168
      ],
      "mdd80_cell": 2.4782774548752426,
      "q": 0.8751902587519026,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.59)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 25,
      "mean_a": 90.74074074074075,
      "mean_b": 90.57239057239057,
      "delta": 0.16835016835016836,
      "ci95": [
       -1.4336917579739947,
       1.7921146970653488
      ],
      "p": 1.0,
      "mid_p": 0.8482,
      "per_seed": {
       "42": 2.0202020202020203,
       "43": 0.0,
       "44": -1.5151515151515151
      },
      "p_het": 0.2556744325567443,
      "mdd80": 2.3054943234205467,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.31)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 98.54166666666667,
      "mean_b": 98.68055555555556,
      "delta": -0.1388888888888889,
      "ci95": [
       -1.1718750009759307,
       0.8928571439719049
      ],
      "p": 0.8874112588741125,
      "mid_p": 0.78835,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": 0.8333333333333334,
       "44": -0.8333333333333334
      },
      "p_het": 0.1690830916908309,
      "mdd80": 1.4756707526965087,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.48)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 144,
      "mean_a": 87.37151248164464,
      "mean_b": 86.63729809104258,
      "delta": 0.7342143906020558,
      "ci95": [
       -1.129943504611075,
       2.5850340153163205
      ],
      "p": 0.47295270472952705,
      "mid_p": 0.428,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": -0.6607929515418502,
       "44": 2.202643171806167
      },
      "p_het": 0.3975602439756024,
      "mdd80": 2.6551064681662964,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.66)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 39,
      "a_only": 18,
      "b_only": 21,
      "mean_a": 74.53183520599251,
      "mean_b": 75.65543071161049,
      "rate_a": 74.53183520599252,
      "rate_b": 75.65543071161049,
      "delta": -1.1235955056179776,
      "ci95": [
       -5.1282051327698674,
       2.8368794363646748
      ],
      "p": 0.7024297570242976,
      "mid_p": 0.57115,
      "per_seed": {
       "42": 2.247191011235955,
       "43": -1.1235955056179776,
       "44": -4.49438202247191
      },
      "p_het": 0.5661433856614339,
      "mdd80": 5.692671744461591,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9842071348420713,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 5.69)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u128_sxs",
      "b": "jqs_f_dense_sxs",
      "n_items": 1496,
      "n_clusters": 500,
      "n_diff_items": 153,
      "a_only": 87,
      "b_only": 66,
      "mean_a": 88.63636363636364,
      "mean_b": 87.23262032085562,
      "rate_a": 88.60000000000001,
      "rate_b": 87.0,
      "delta": 1.4037433155080214,
      "ci95": [
       -0.25220681114194565,
       3.0261348022151315
      ],
      "p": 0.10838916108389161,
      "mid_p": 0.09175,
      "per_seed": {
       "42": 3.0120481927710845,
       "43": 1.6,
       "44": -0.40160642570281124
      },
      "p_het": 0.2395760423957604,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "jqs_f_dense_sxs"
      ],
      "row_arm": "jqs_f_u128",
      "source": "sxs",
      "replaces": [
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "seed_tuple": [
       20261024,
       26,
       0,
       1
      ],
      "label_text": "final N = 128 (sxs) vs final dense NVFP4 (sxs)",
      "mdd80": 2.3430413712579403,
      "se": 0.843041272562316,
      "ci95_bootstrap": [
       -0.20040080160320642,
       3.076974564926372
      ],
      "mdd80_cell": 2.4782774548752426,
      "q": 0.5161388623042458,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.34)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 58,
      "mean_a": 84.51178451178451,
      "mean_b": 83.5016835016835,
      "delta": 1.0101010101010102,
      "ci95": [
       -0.980392158794348,
       2.9629629651072875
      ],
      "p": 0.39386061393860616,
      "mid_p": 0.31355,
      "per_seed": {
       "42": 3.0303030303030303,
       "43": 0.5050505050505051,
       "44": -0.5050505050505051
      },
      "p_het": 0.6097390260973903,
      "mdd80": 2.818328681556211,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.82)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 90.48611111111111,
      "mean_b": 92.15277777777777,
      "delta": -1.6666666666666667,
      "ci95": [
       -3.2051282069157434,
       -0.2314814790761477
      ],
      "p": 0.019098090190980903,
      "mid_p": 0.01165,
      "per_seed": {
       "42": -2.2916666666666665,
       "43": -1.6666666666666667,
       "44": -1.0416666666666667
      },
      "p_het": 0.288971102889711,
      "mdd80": 2.1252749495191448,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.2985415744139872,
      "label_source": "nominal_loss",
      "q": 0.2985415744139872,
      "label": "nominal_loss",
      "q_prev": 0.2985415744139872,
      "label_prev": "nominal_loss",
      "q_published": 0.2985415744139872,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0191, q 0.30)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 198,
      "mean_a": 75.33039647577093,
      "mean_b": 80.1762114537445,
      "delta": -4.845814977973569,
      "ci95": [
       -6.8759342322561325,
       -2.83687943069046
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -7.488986784140969,
       "43": -3.9647577092511015,
       "44": -3.0837004405286343
      },
      "p_het": 0.17318268173182683,
      "mdd80": 2.8867255512019203,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.009999000099990002,
      "label_source": "loss_detected",
      "q": 0.009999000099990002,
      "label": "loss_detected",
      "q_prev": 0.009999000099990002,
      "label_prev": "loss_detected",
      "q_published": 0.009999000099990002,
      "label_published": "loss_detected",
      "changed": false,
      "text": "loss detected (p 0.0001, q 0.0100)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 61,
      "a_only": 28,
      "b_only": 33,
      "mean_a": 38.951310861423224,
      "mean_b": 40.823970037453186,
      "rate_a": 38.951310861423224,
      "rate_b": 40.823970037453186,
      "delta": -1.8726591760299625,
      "ci95": [
       -7.407407412871501,
       3.6036036101856634
      ],
      "p": 0.5960403959604039,
      "mid_p": 0.51325,
      "per_seed": {
       "42": -5.617977528089888,
       "43": 0.0,
       "44": 0.0
      },
      "p_het": 0.7111288871112889,
      "mdd80": 7.869605248362536,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.87)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 188,
      "a_only": 84,
      "b_only": 104,
      "mean_a": 69.2,
      "mean_b": 70.53333333333333,
      "rate_a": 69.2,
      "rate_b": 70.53333333333333,
      "delta": -1.3333333333333333,
      "ci95": [
       -3.3200531228282513,
       0.6587615302913641
      ],
      "p": 0.20857914208579142,
      "mid_p": 0.18825,
      "per_seed": {
       "42": -3.0,
       "43": -0.8,
       "44": -0.2
      },
      "p_het": 0.39476052394760525,
      "mdd80": 2.843671721959489,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7815885078158851,
      "label_source": "no_detected_loss",
      "q": 0.7563759753056952,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.84)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 60,
      "mean_a": 82.82828282828282,
      "mean_b": 83.5016835016835,
      "delta": -0.6734006734006734,
      "ci95": [
       -3.17460317696254,
       1.8115942055631942
      ],
      "p": 0.7017298270172982,
      "mid_p": 0.61085,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": 0.0,
       "44": -3.0303030303030303
      },
      "p_het": 0.43355664433556645,
      "mdd80": 3.5636514220836175,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9842071348420713,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.56)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 91.11111111111111,
      "mean_b": 92.15277777777777,
      "delta": -1.0416666666666667,
      "ci95": [
       -1.9531250008633183,
       -0.13888888797897958
      ],
      "p": 0.040195980401959805,
      "mid_p": 0.02605,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": -2.9166666666666665,
       "44": -0.4166666666666667
      },
      "p_het": 0.11148885111488852,
      "mdd80": 1.2966404270985277,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.38632500386325,
      "label_source": "nominal_loss",
      "q": 0.38632500386325,
      "label": "nominal_loss",
      "q_prev": 0.38632500386325,
      "label_prev": "nominal_loss",
      "q_published": 0.38632500386325,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0402, q 0.39)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 188,
      "mean_a": 79.00146842878121,
      "mean_b": 80.1762114537445,
      "delta": -1.1747430249632893,
      "ci95": [
       -3.056768560812011,
       0.7407407426669018
      ],
      "p": 0.25437456254374563,
      "mid_p": 0.22445,
      "per_seed": {
       "42": -3.0837004405286343,
       "43": -0.8810572687224669,
       "44": 0.44052863436123346
      },
      "p_het": 0.37516248375162486,
      "mdd80": 2.7140922012323787,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8205631049798247,
      "label_source": "no_detected_loss",
      "q": 0.7949205079492051,
      "label": "no_detected_loss",
      "q_prev": 0.8205631049798247,
      "label_prev": "no_detected_loss",
      "q_published": 0.8205631049798247,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.71)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 53,
      "a_only": 29,
      "b_only": 24,
      "mean_a": 42.69662921348315,
      "mean_b": 40.823970037453186,
      "rate_a": 42.696629213483156,
      "rate_b": 40.823970037453186,
      "delta": 1.8726591760299625,
      "ci95": [
       -3.3333333391056614,
       7.017543865676389
      ],
      "p": 0.5691430856914309,
      "mid_p": 0.48025,
      "per_seed": {
       "42": 6.741573033707865,
       "43": -1.1235955056179776,
       "44": 0.0
      },
      "p_het": 0.48775122487751227,
      "mdd80": 7.397805469937006,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.40)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 187,
      "a_only": 81,
      "b_only": 106,
      "mean_a": 68.86666666666666,
      "mean_b": 70.53333333333333,
      "rate_a": 68.86666666666667,
      "rate_b": 70.53333333333333,
      "delta": -1.6666666666666667,
      "ci95": [
       -3.44827586398854,
       0.13440860396328208
      ],
      "p": 0.0795920407959204,
      "mid_p": 0.06865,
      "per_seed": {
       "42": -0.8,
       "43": -2.4,
       "44": -1.8
      },
      "p_het": 0.7837216278372163,
      "mdd80": 2.5605561953558515,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.4974502549745025,
      "label_source": "no_detected_loss",
      "q": 0.4727305047273051,
      "label": "no_detected_loss",
      "q_prev": 0.4974502549745025,
      "label_prev": "no_detected_loss",
      "q_published": 0.4974502549745025,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.56)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 52,
      "mean_a": 82.82828282828282,
      "mean_b": 83.5016835016835,
      "delta": -0.6734006734006734,
      "ci95": [
       -3.125000002525093,
       1.773049647966535
      ],
      "p": 0.6861313868613139,
      "mid_p": 0.59725,
      "per_seed": {
       "42": 0.0,
       "43": -1.0101010101010102,
       "44": -1.0101010101010102
      },
      "p_het": 0.9501049895010499,
      "mdd80": 3.500651952444157,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9842071348420713,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.50)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 13,
      "mean_a": 91.25,
      "mean_b": 92.15277777777777,
      "delta": -0.9027777777777778,
      "ci95": [
       -2.724358976469416,
       0.6944444464491726
      ],
      "p": 0.7402259774022598,
      "mid_p": 0.61685,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": -1.6666666666666667,
       "44": -0.8333333333333334
      },
      "p_het": 0.4998500149985001,
      "mdd80": 2.4434298815777553,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.44)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 209,
      "mean_a": 77.01908957415566,
      "mean_b": 80.1762114537445,
      "delta": -3.15712187958884,
      "ci95": [
       -5.217391306378512,
       -1.1157601096391119
      ],
      "p": 0.0029997000299970002,
      "mid_p": 0.00235,
      "per_seed": {
       "42": -4.6255506607929515,
       "43": -1.1013215859030836,
       "44": -3.7444933920704844
      },
      "p_het": 0.3792620737926207,
      "mdd80": 2.9314491035488914,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.14998500149985,
      "label_source": "nominal_loss",
      "q": 0.14998500149985,
      "label": "nominal_loss",
      "q_prev": 0.14998500149985,
      "label_prev": "nominal_loss",
      "q_published": 0.14998500149985,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00300, q 0.150)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 29,
      "b_only": 22,
      "mean_a": 43.445692883895134,
      "mean_b": 40.823970037453186,
      "rate_a": 43.445692883895134,
      "rate_b": 40.823970037453186,
      "delta": 2.6217228464419478,
      "ci95": [
       -2.898550729956498,
       8.13008130677277
      ],
      "p": 0.43445655434456554,
      "mid_p": 0.365,
      "per_seed": {
       "42": 0.0,
       "43": 1.1235955056179776,
       "44": 6.741573033707865
      },
      "p_het": 0.541045895410459,
      "mdd80": 7.882199043917282,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.88)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 179,
      "a_only": 74,
      "b_only": 105,
      "mean_a": 68.46666666666667,
      "mean_b": 70.53333333333333,
      "rate_a": 68.46666666666667,
      "rate_b": 70.53333333333333,
      "delta": -2.066666666666667,
      "ci95": [
       -3.831417626210224,
       -0.27548209182058014
      ],
      "p": 0.026797320267973202,
      "mid_p": 0.02265,
      "per_seed": {
       "42": -1.2,
       "43": -2.8,
       "44": -2.2
      },
      "p_het": 0.7754224577542246,
      "mdd80": 2.5414386458857603,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.33496650334966505,
      "label_source": "nominal_loss",
      "q": 0.33496650334966505,
      "label": "nominal_loss",
      "q_prev": 0.33496650334966505,
      "label_prev": "nominal_loss",
      "q_published": 0.33496650334966505,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0268, q 0.33)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 53,
      "mean_a": 83.33333333333333,
      "mean_b": 83.5016835016835,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.4922118401488085,
       2.1406727849721108
      ],
      "p": 1.0,
      "mid_p": 0.8891,
      "per_seed": {
       "42": 2.525252525252525,
       "43": 1.5151515151515151,
       "44": -4.545454545454546
      },
      "p_het": 0.04229577042295771,
      "mdd80": 3.3111376498092895,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.31)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 91.25,
      "mean_b": 92.15277777777777,
      "delta": -0.9027777777777778,
      "ci95": [
       -1.7857142866690965,
       9.779506916414974e-10
      ],
      "p": 0.0628937106289371,
      "mid_p": 0.03915,
      "per_seed": {
       "42": -1.25,
       "43": -1.875,
       "44": 0.4166666666666667
      },
      "p_het": 0.1660833916608339,
      "mdd80": 1.2762557862049477,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.419291404192914,
      "label_source": "no_detected_loss",
      "q": 0.419291404192914,
      "label": "no_detected_loss",
      "q_prev": 0.419291404192914,
      "label_prev": "no_detected_loss",
      "q_published": 0.419291404192914,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.28)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 191,
      "mean_a": 78.48751835535977,
      "mean_b": 80.1762114537445,
      "delta": -1.6886930983847284,
      "ci95": [
       -3.5765379131413573,
       0.1579778850766172
      ],
      "p": 0.09159084091590841,
      "mid_p": 0.0793,
      "per_seed": {
       "42": -3.5242290748898677,
       "43": -1.7621145374449338,
       "44": 0.22026431718061673
      },
      "p_het": 0.34806519348065196,
      "mdd80": 2.6690705389548492,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.5088380050883801,
      "label_source": "no_detected_loss",
      "q": 0.48205705745214955,
      "label": "no_detected_loss",
      "q_prev": 0.5088380050883801,
      "label_prev": "no_detected_loss",
      "q_published": 0.5088380050883801,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.67)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 26,
      "b_only": 25,
      "mean_a": 41.19850187265918,
      "mean_b": 40.823970037453186,
      "rate_a": 41.19850187265917,
      "rate_b": 40.823970037453186,
      "delta": 0.37453183520599254,
      "ci95": [
       -5.128205134469576,
       5.925925931419227
      ],
      "p": 1.0,
      "mid_p": 0.8954,
      "per_seed": {
       "42": 0.0,
       "43": 3.3707865168539324,
       "44": -2.247191011235955
      },
      "p_het": 0.7085291470852915,
      "mdd80": 7.900423282661738,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.90)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 155,
      "a_only": 78,
      "b_only": 77,
      "mean_a": 70.6,
      "mean_b": 70.53333333333333,
      "rate_a": 70.6,
      "rate_b": 70.53333333333333,
      "delta": 0.06666666666666667,
      "ci95": [
       -1.5873015888163478,
       1.7195767212135347
      ],
      "p": 1.0,
      "mid_p": 0.93595,
      "per_seed": {
       "42": 0.6,
       "43": -1.4,
       "44": 1.0
      },
      "p_het": 0.46555344465553444,
      "mdd80": 2.363436640814658,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.36)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 51,
      "mean_a": 84.34343434343434,
      "mean_b": 83.5016835016835,
      "delta": 0.8417508417508418,
      "ci95": [
       -1.449275364779968,
       3.1578947392526793
      ],
      "p": 0.5745425457454254,
      "mid_p": 0.4867,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": 2.525252525252525,
       "44": -1.5151515151515151
      },
      "p_het": 0.37436256374362564,
      "mdd80": 3.2927593982852796,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9965670099656702,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.29)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 91.59722222222223,
      "mean_b": 92.15277777777777,
      "delta": -0.5555555555555556,
      "ci95": [
       -1.4583333347001,
       0.2976190485428347
      ],
      "p": 0.39536046395360464,
      "mid_p": 0.2977,
      "per_seed": {
       "42": -1.4583333333333333,
       "43": -1.0416666666666667,
       "44": 0.8333333333333334
      },
      "p_het": 0.045795420457954206,
      "mdd80": 1.254984856713603,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.25)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 173,
      "mean_a": 79.0748898678414,
      "mean_b": 80.1762114537445,
      "delta": -1.1013215859030836,
      "ci95": [
       -2.9411764723421374,
       0.7440476209100293
      ],
      "p": 0.2790720927907209,
      "mid_p": 0.2466,
      "per_seed": {
       "42": -3.7444933920704844,
       "43": 0.22026431718061673,
       "44": 0.22026431718061673
      },
      "p_het": 0.1710828917108289,
      "mdd80": 2.6338415977352487,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8721002899710029,
      "label_source": "no_detected_loss",
      "q": 0.8456730084567301,
      "label": "no_detected_loss",
      "q_prev": 0.8721002899710029,
      "label_prev": "no_detected_loss",
      "q_published": 0.8721002899710029,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.63)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 57,
      "a_only": 30,
      "b_only": 27,
      "mean_a": 41.947565543071164,
      "mean_b": 40.823970037453186,
      "rate_a": 41.947565543071164,
      "rate_b": 40.823970037453186,
      "delta": 1.1235955056179776,
      "ci95": [
       -4.878048786983283,
       7.142857149210913
      ],
      "p": 0.8116188381161884,
      "mid_p": 0.7228,
      "per_seed": {
       "42": 5.617977528089888,
       "43": 0.0,
       "44": -2.247191011235955
      },
      "p_het": 0.505949405059494,
      "mdd80": 8.591380414337369,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 8.59)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 169,
      "a_only": 70,
      "b_only": 99,
      "mean_a": 68.6,
      "mean_b": 70.53333333333333,
      "rate_a": 68.60000000000001,
      "rate_b": 70.53333333333333,
      "delta": -1.9333333333333333,
      "ci95": [
       -3.6290322597725355,
       -0.26246718996150503
      ],
      "p": 0.030996900309969003,
      "mid_p": 0.0254,
      "per_seed": {
       "42": -3.4,
       "43": -1.0,
       "44": -1.4
      },
      "p_het": 0.4914508549145086,
      "mdd80": 2.406094961385575,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.34441000344410005,
      "label_source": "nominal_loss",
      "q": 0.34441000344410005,
      "label": "nominal_loss",
      "q_prev": 0.34441000344410005,
      "label_prev": "nominal_loss",
      "q_published": 0.34441000344410005,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0310, q 0.34)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 87,
      "mean_a": 71.88552188552188,
      "mean_b": 72.39057239057239,
      "delta": -0.5050505050505051,
      "ci95": [
       -3.6231884091436592,
       2.59259259599197
      ],
      "p": 0.8392160783921608,
      "mid_p": 0.7566,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 0.5050505050505051,
       "44": -1.0101010101010102
      },
      "p_het": 0.9374062593740626,
      "mdd80": 4.442438820400548,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.44)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 86.94444444444444,
      "mean_b": 87.91666666666667,
      "delta": -0.9722222222222222,
      "ci95": [
       -2.9166666695942207,
       0.8680555578667704
      ],
      "p": 0.420957904209579,
      "mid_p": 0.3788,
      "per_seed": {
       "42": 1.25,
       "43": -1.4583333333333333,
       "44": -2.7083333333333335
      },
      "p_het": 0.137986201379862,
      "mdd80": 2.7049532365786217,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.70)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 147,
      "mean_a": 67.40088105726872,
      "mean_b": 68.79588839941263,
      "delta": -1.395007342143906,
      "ci95": [
       -3.0744336588070276,
       0.29498525243468315
      ],
      "p": 0.1274872512748725,
      "mid_p": 0.1082,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": -1.5418502202643172,
       "44": -1.7621145374449338
      },
      "p_het": 0.9362063793620637,
      "mdd80": 2.408134611101105,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.6374362563743625,
      "label_source": "no_detected_loss",
      "q": 0.5542923968472718,
      "label": "no_detected_loss",
      "q_prev": 0.6070821489279643,
      "label_prev": "no_detected_loss",
      "q_published": 0.6374362563743625,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.41)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 12,
      "a_only": 5,
      "b_only": 7,
      "mean_a": 3.745318352059925,
      "mean_b": 4.49438202247191,
      "rate_a": 3.7453183520599254,
      "rate_b": 4.49438202247191,
      "delta": -0.7490636704119851,
      "ci95": [
       -3.4722222247462495,
       2.0000000024373628
      ],
      "p": 0.7941205879412059,
      "mid_p": 0.6169,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": -2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 0.6465353464653535,
      "mdd80": 3.911014953038678,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.91)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 267,
      "a_only": 118,
      "b_only": 149,
      "mean_a": 18.533333333333335,
      "mean_b": 20.6,
      "rate_a": 18.53333333333333,
      "rate_b": 20.599999999999998,
      "delta": -2.066666666666667,
      "ci95": [
       -4.1825095077087475,
       2.13509734748228e-09
      ],
      "p": 0.06259374062593741,
      "mid_p": 0.054,
      "per_seed": {
       "42": -4.2,
       "43": -4.2,
       "44": 2.2
      },
      "p_het": 0.0244975502449755,
      "mdd80": 2.989253095930032,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.419291404192914,
      "label_source": "no_detected_loss",
      "q": 0.419291404192914,
      "label": "no_detected_loss",
      "q_prev": 0.419291404192914,
      "label_prev": "no_detected_loss",
      "q_published": 0.419291404192914,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.99)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 80,
      "mean_a": 73.4006734006734,
      "mean_b": 72.39057239057239,
      "delta": 1.0101010101010102,
      "ci95": [
       -2.2988505784691733,
       4.333333336622021
      ],
      "p": 0.6132386761323868,
      "mid_p": 0.54485,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 5.555555555555555,
       "44": -1.0101010101010102
      },
      "p_het": 0.0862913708629137,
      "mdd80": 4.740043329083522,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9965670099656702,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.74)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 38,
      "mean_a": 87.22222222222223,
      "mean_b": 87.91666666666667,
      "delta": -0.6944444444444444,
      "ci95": [
       -2.222222223756958,
       0.7812500027861984
      ],
      "p": 0.43385661433856615,
      "mid_p": 0.3811,
      "per_seed": {
       "42": 2.0833333333333335,
       "43": -2.9166666666666665,
       "44": -1.25
      },
      "p_het": 0.029797020297970205,
      "mdd80": 2.146591330062319,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.15)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 156,
      "mean_a": 67.91483113069016,
      "mean_b": 68.79588839941263,
      "delta": -0.8810572687224669,
      "ci95": [
       -2.7181688143766536,
       0.9762900993879038
      ],
      "p": 0.38336166383361664,
      "mid_p": 0.34535,
      "per_seed": {
       "42": -2.643171806167401,
       "43": 1.5418502202643172,
       "44": -1.5418502202643172
      },
      "p_het": 0.15058494150584942,
      "mdd80": 2.6404417538716665,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.64)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 17,
      "a_only": 9,
      "b_only": 8,
      "mean_a": 4.868913857677903,
      "mean_b": 4.49438202247191,
      "rate_a": 4.868913857677903,
      "rate_b": 4.49438202247191,
      "delta": 0.37453183520599254,
      "ci95": [
       -1.801801804418902,
       2.631578950005956
      ],
      "p": 1.0,
      "mid_p": 0.75405,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 0.0,
       "44": -2.247191011235955
      },
      "p_het": 0.45635436456354367,
      "mdd80": 3.1685515871297834,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.17)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 279,
      "a_only": 147,
      "b_only": 132,
      "mean_a": 21.6,
      "mean_b": 20.6,
      "rate_a": 21.599999999999998,
      "rate_b": 20.599999999999998,
      "delta": 1.0,
      "ci95": [
       -1.2500000023373952,
       3.2388663990277244
      ],
      "p": 0.41025897410258977,
      "mid_p": 0.37975,
      "per_seed": {
       "42": -1.0,
       "43": 0.8,
       "44": 3.2
      },
      "p_het": 0.30356964303569645,
      "mdd80": 3.208207358743809,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.21)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 89,
      "mean_a": 71.88552188552188,
      "mean_b": 72.39057239057239,
      "delta": -0.5050505050505051,
      "ci95": [
       -3.8095238126395046,
       2.8368794361437386
      ],
      "p": 0.8434156584341566,
      "mid_p": 0.7682,
      "per_seed": {
       "42": 0.0,
       "43": -2.0202020202020203,
       "44": 0.5050505050505051
      },
      "p_het": 0.8377162283771623,
      "mdd80": 4.750205932936779,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.75)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 38,
      "mean_a": 86.80555555555556,
      "mean_b": 87.91666666666667,
      "delta": -1.1111111111111112,
      "ci95": [
       -3.8888888916679525,
       1.5625000050256546
      ],
      "p": 0.49445055494450557,
      "mid_p": 0.46555,
      "per_seed": {
       "42": 2.7083333333333335,
       "43": -3.9583333333333335,
       "44": -2.0833333333333335
      },
      "p_het": 0.0047995200479952005,
      "mdd80": 3.8961253042478714,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9695108920480502,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.9695108920480502,
      "label_prev": "no_detected_loss",
      "q_published": 0.9695108920480502,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.90)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 147,
      "mean_a": 68.4287812041116,
      "mean_b": 68.79588839941263,
      "delta": -0.3671071953010279,
      "ci95": [
       -2.1008403377821065,
       1.3698630154934373
      ],
      "p": 0.7428257174282572,
      "mid_p": 0.68495,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": -0.22026431718061673,
       "44": -1.7621145374449338
      },
      "p_het": 0.47895210478952105,
      "mdd80": 2.4805229299337586,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.48)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 9,
      "b_only": 7,
      "mean_a": 5.2434456928838955,
      "mean_b": 4.49438202247191,
      "rate_a": 5.2434456928838955,
      "rate_b": 4.49438202247191,
      "delta": 0.7490636704119851,
      "ci95": [
       -1.709401712204874,
       3.252032523037834
      ],
      "p": 0.7856214378562144,
      "mid_p": 0.58955,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 3.3707865168539324,
       "44": -2.247191011235955
      },
      "p_het": 0.40035996400359963,
      "mdd80": 3.545953120500193,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.55)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 246,
      "a_only": 111,
      "b_only": 135,
      "mean_a": 19.0,
      "mean_b": 20.6,
      "rate_a": 19.0,
      "rate_b": 20.599999999999998,
      "delta": -1.6,
      "ci95": [
       -3.557312254893804,
       0.3921568646955848
      ],
      "p": 0.12458754124587541,
      "mid_p": 0.11015,
      "per_seed": {
       "42": -4.0,
       "43": -2.8,
       "44": 2.0
      },
      "p_het": 0.054394560543945605,
      "mdd80": 2.8226983740805447,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.6374362563743625,
      "label_source": "no_detected_loss",
      "q": 0.5542923968472718,
      "label": "no_detected_loss",
      "q_prev": 0.6070821489279643,
      "label_prev": "no_detected_loss",
      "q_published": 0.6374362563743625,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.82)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 72,
      "mean_a": 72.72727272727273,
      "mean_b": 72.39057239057239,
      "delta": 0.3367003367003367,
      "ci95": [
       -2.6548672592592304,
       3.3333333362999937
      ],
      "p": 0.9153084691530847,
      "mid_p": 0.82945,
      "per_seed": {
       "42": 2.525252525252525,
       "43": -0.5050505050505051,
       "44": -1.0101010101010102
      },
      "p_het": 0.5564443555644436,
      "mdd80": 4.279786364429278,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.28)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 86.94444444444444,
      "mean_b": 87.91666666666667,
      "delta": -0.9722222222222222,
      "ci95": [
       -3.1250000020238797,
       1.0416666683525266
      ],
      "p": 0.4684531546845315,
      "mid_p": 0.4299,
      "per_seed": {
       "42": 1.4583333333333333,
       "43": -2.0833333333333335,
       "44": -2.2916666666666665
      },
      "p_het": 0.14108589141085892,
      "mdd80": 2.9779301672397556,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.98)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 147,
      "mean_a": 68.28193832599119,
      "mean_b": 68.79588839941263,
      "delta": -0.5139500734214391,
      "ci95": [
       -2.2624434407036853,
       1.2461059208681011
      ],
      "p": 0.6262373762623737,
      "mid_p": 0.57095,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": 1.1013215859030836,
       "44": -2.8634361233480177
      },
      "p_het": 0.15908409159084091,
      "mdd80": 2.5075715946652726,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9965670099656702,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.51)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 9,
      "b_only": 7,
      "mean_a": 5.2434456928838955,
      "mean_b": 4.49438202247191,
      "rate_a": 5.2434456928838955,
      "rate_b": 4.49438202247191,
      "delta": 0.7490636704119851,
      "ci95": [
       -1.7094017122031442,
       3.252032523040936
      ],
      "p": 0.7781221877812219,
      "mid_p": 0.5882,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 1.1235955056179776,
       "44": -1.1235955056179776
      },
      "p_het": 0.7716228377162284,
      "mdd80": 3.5459531205011743,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.55)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 250,
      "a_only": 126,
      "b_only": 124,
      "mean_a": 20.733333333333334,
      "mean_b": 20.6,
      "rate_a": 20.733333333333334,
      "rate_b": 20.599999999999998,
      "delta": 0.13333333333333333,
      "ci95": [
       -1.8893387334878495,
       2.171136655840159
      ],
      "p": 0.9513048695130487,
      "mid_p": 0.8985,
      "per_seed": {
       "42": -0.4,
       "43": -1.0,
       "44": 1.8
      },
      "p_het": 0.5372462753724627,
      "mdd80": 2.902034914667682,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.90)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 78,
      "mean_a": 73.06397306397307,
      "mean_b": 72.39057239057239,
      "delta": 0.6734006734006734,
      "ci95": [
       -2.4305555587571464,
       3.787878791373708
      ],
      "p": 0.7472252774722528,
      "mid_p": 0.668,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": 0.5489451054894511,
      "mdd80": 4.4443351746641495,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.44)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 29,
      "mean_a": 87.5,
      "mean_b": 87.91666666666667,
      "delta": -0.4166666666666667,
      "ci95": [
       -1.9230769248251995,
       1.04166666850216
      ],
      "p": 0.6432356764323568,
      "mid_p": 0.58255,
      "per_seed": {
       "42": 1.25,
       "43": -0.4166666666666667,
       "44": -2.0833333333333335
      },
      "p_het": 0.1421857814218578,
      "mdd80": 2.1189118504415347,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9965670099656702,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.12)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 68.94273127753304,
      "mean_b": 68.79588839941263,
      "delta": 0.14684287812041116,
      "ci95": [
       -1.673640169086812,
       1.94319880601318
      ],
      "p": 0.9372062793720628,
      "mid_p": 0.87075,
      "per_seed": {
       "42": 2.643171806167401,
       "43": -1.3215859030837005,
       "44": -0.8810572687224669
      },
      "p_het": 0.12038796120387961,
      "mdd80": 2.584966532258216,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.58)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 13,
      "a_only": 7,
      "b_only": 6,
      "mean_a": 4.868913857677903,
      "mean_b": 4.49438202247191,
      "rate_a": 4.868913857677903,
      "rate_b": 4.49438202247191,
      "delta": 0.37453183520599254,
      "ci95": [
       -1.7094017117815885,
       2.5641025666009396
      ],
      "p": 1.0,
      "mid_p": 0.76215,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": -1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.8584141585841416,
      "mdd80": 3.054287351782292,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.05)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 271,
      "a_only": 140,
      "b_only": 131,
      "mean_a": 21.2,
      "mean_b": 20.6,
      "rate_a": 21.2,
      "rate_b": 20.599999999999998,
      "delta": 0.6,
      "ci95": [
       -1.496598641586947,
       2.672292547889966
      ],
      "p": 0.6100389961003899,
      "mid_p": 0.56845,
      "per_seed": {
       "42": 0.0,
       "43": 0.2,
       "44": 1.6
      },
      "p_het": 0.8351164883511649,
      "mdd80": 2.97952003824722,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.9965670099656702,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.98)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 83,
      "mean_a": 75.58922558922559,
      "mean_b": 77.10437710437711,
      "delta": -1.5151515151515151,
      "ci95": [
       -4.290429045623155,
       1.2944983845716571
      ],
      "p": 0.34536546345365465,
      "mid_p": 0.29225,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": -1.0101010101010102,
       "44": -0.5050505050505051
      },
      "p_het": 0.8416158384161584,
      "mdd80": 3.991565726739424,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.99)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 85.48611111111111,
      "mean_b": 87.15277777777777,
      "delta": -1.6666666666666667,
      "ci95": [
       -3.205128206913648,
       -0.14880952217207216
      ],
      "p": 0.042495750424957505,
      "mid_p": 0.03245,
      "per_seed": {
       "42": -2.2916666666666665,
       "43": -1.875,
       "44": -0.8333333333333334
      },
      "p_het": 0.6477352264773523,
      "mdd80": 2.184360864932895,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.38632500386325,
      "label_source": "nominal_loss",
      "q": 0.38632500386325,
      "label": "nominal_loss",
      "q_prev": 0.38632500386325,
      "label_prev": "nominal_loss",
      "q_published": 0.38632500386325,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0425, q 0.39)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 145,
      "mean_a": 78.41409691629956,
      "mean_b": 80.10279001468429,
      "delta": -1.6886930983847284,
      "ci95": [
       -3.5242290767198323,
       0.14749262720805606
      ],
      "p": 0.08509149085091491,
      "mid_p": 0.07225,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": -2.4229074889867843,
       "44": -1.7621145374449338
      },
      "p_het": 0.7749225077492251,
      "mdd80": 2.6241913963441803,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.5005381814759701,
      "label_source": "no_detected_loss",
      "q": 0.4727305047273051,
      "label": "no_detected_loss",
      "q_prev": 0.5005381814759701,
      "label_prev": "no_detected_loss",
      "q_published": 0.5005381814759701,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.62)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 18,
      "b_only": 22,
      "mean_a": 21.348314606741575,
      "mean_b": 22.846441947565545,
      "rate_a": 21.34831460674157,
      "rate_b": 22.84644194756554,
      "delta": -1.4981273408239701,
      "ci95": [
       -6.41025641445626,
       3.4188034244178787
      ],
      "p": 0.6577342265773423,
      "mid_p": 0.55235,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -3.3707865168539324,
       "44": 2.247191011235955
      },
      "p_het": 0.5686431356864313,
      "mdd80": 7.02486090809463,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.02)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 241,
      "a_only": 121,
      "b_only": 120,
      "mean_a": 48.06666666666667,
      "mean_b": 48.0,
      "rate_a": 48.06666666666667,
      "rate_b": 48.0,
      "delta": 0.06666666666666667,
      "ci95": [
       -1.912568308036758,
       2.0378457081117825
      ],
      "p": 1.0,
      "mid_p": 0.94595,
      "per_seed": {
       "42": 1.0,
       "43": -0.6,
       "44": -0.2
      },
      "p_het": 0.8082191780821918,
      "mdd80": 2.823373694712364,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r40",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.82)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 80,
      "mean_a": 73.06397306397307,
      "mean_b": 77.10437710437711,
      "delta": -4.040404040404041,
      "ci95": [
       -6.90690690946195,
       -1.0989010957002208
      ],
      "p": 0.0084991500849915,
      "mid_p": 0.00585,
      "per_seed": {
       "42": -7.575757575757576,
       "43": -1.0101010101010102,
       "44": -3.5353535353535355
      },
      "p_het": 0.21987801219878012,
      "mdd80": 4.151000570137394,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.25247475252474755,
      "label_source": "nominal_loss",
      "q": 0.25247475252474755,
      "label": "nominal_loss",
      "q_prev": 0.25247475252474755,
      "label_prev": "nominal_loss",
      "q_published": 0.25247475252474755,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.00850, q 0.25)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 87.08333333333333,
      "mean_b": 87.15277777777777,
      "delta": -0.06944444444444445,
      "ci95": [
       -1.339285715655527,
       1.1904761918364672
      ],
      "p": 1.0,
      "mid_p": 0.91275,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": 0.0,
       "44": -1.0416666666666667
      },
      "p_het": 0.6435356464353564,
      "mdd80": 1.8080290304512994,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.81)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 128,
      "mean_a": 78.19383259911895,
      "mean_b": 80.10279001468429,
      "delta": -1.908957415565345,
      "ci95": [
       -3.4722222236987976,
       -0.30721966038366916
      ],
      "p": 0.020897910208979104,
      "mid_p": 0.01675,
      "per_seed": {
       "42": -2.643171806167401,
       "43": -0.6607929515418502,
       "44": -2.4229074889867843
      },
      "p_het": 0.5869413058694131,
      "mdd80": 2.2620375850309693,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.2985415744139872,
      "label_source": "nominal_loss",
      "q": 0.2985415744139872,
      "label": "nominal_loss",
      "q_prev": 0.2985415744139872,
      "label_prev": "nominal_loss",
      "q_published": 0.2985415744139872,
      "label_published": "nominal_loss",
      "changed": false,
      "text": "nominal loss (p 0.0209, q 0.30)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 32,
      "a_only": 14,
      "b_only": 18,
      "mean_a": 21.348314606741575,
      "mean_b": 22.846441947565545,
      "rate_a": 21.34831460674157,
      "rate_b": 22.84644194756554,
      "delta": -1.4981273408239701,
      "ci95": [
       -5.691056915112155,
       2.702702707759066
      ],
      "p": 0.6069393060693931,
      "mid_p": 0.49555,
      "per_seed": {
       "42": -5.617977528089888,
       "43": -1.1235955056179776,
       "44": 2.247191011235955
      },
      "p_het": 0.33656634336566343,
      "mdd80": 5.999047194060552,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.00)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 258,
      "a_only": 138,
      "b_only": 120,
      "mean_a": 49.2,
      "mean_b": 48.0,
      "rate_a": 49.199999999999996,
      "rate_b": 48.0,
      "delta": 1.2,
      "ci95": [
       -0.9523809545733897,
       3.3602150559350337
      ],
      "p": 0.3037696230376962,
      "mid_p": 0.27685,
      "per_seed": {
       "42": 3.8,
       "43": -0.2,
       "44": 0.0
      },
      "p_het": 0.23167683231676833,
      "mdd80": 3.0822263393703833,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r60",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.8934400677579301,
      "label_source": "no_detected_loss",
      "q": 0.8679132086791321,
      "label": "no_detected_loss",
      "q_prev": 0.8934400677579301,
      "label_prev": "no_detected_loss",
      "q_published": 0.8934400677579301,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.08)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 80,
      "mean_a": 75.75757575757575,
      "mean_b": 77.10437710437711,
      "delta": -1.3468013468013469,
      "ci95": [
       -4.166666669565648,
       1.465201468251188
      ],
      "p": 0.4173582641735826,
      "mid_p": 0.3537,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 0.0,
       "44": -2.525252525252525
      },
      "p_het": 0.8121187881211879,
      "mdd80": 4.025114402541364,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.03)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 86.52777777777777,
      "mean_b": 87.15277777777777,
      "delta": -0.625,
      "ci95": [
       -2.0833333350276613,
       0.7812500013239605
      ],
      "p": 0.44825517448255175,
      "mid_p": 0.3973,
      "per_seed": {
       "42": -1.25,
       "43": 0.20833333333333334,
       "44": -0.8333333333333334
      },
      "p_het": 0.7574242575742426,
      "mdd80": 2.0473269903117006,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.05)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 125,
      "mean_a": 78.56093979441997,
      "mean_b": 80.10279001468429,
      "delta": -1.5418502202643172,
      "ci95": [
       -3.1073446342731446,
       1.575595111869843e-09
      ],
      "p": 0.06229377062293771,
      "mid_p": 0.0519,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": -1.5418502202643172,
       "44": -2.643171806167401
      },
      "p_het": 0.5878412158784122,
      "mdd80": 2.2208292774878156,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.419291404192914,
      "label_source": "no_detected_loss",
      "q": 0.419291404192914,
      "label": "no_detected_loss",
      "q_prev": 0.419291404192914,
      "label_prev": "no_detected_loss",
      "q_published": 0.419291404192914,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.22)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 20,
      "b_only": 22,
      "mean_a": 22.09737827715356,
      "mean_b": 22.846441947565545,
      "rate_a": 22.097378277153563,
      "rate_b": 22.84644194756554,
      "delta": -0.7490636704119851,
      "ci95": [
       -5.797101454150344,
       4.347826091890759
      ],
      "p": 0.8878112188781122,
      "mid_p": 0.77535,
      "per_seed": {
       "42": -5.617977528089888,
       "43": 0.0,
       "44": 3.3707865168539324
      },
      "p_het": 0.33486651334866513,
      "mdd80": 7.250612581660681,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 1.0,
      "label": "no_detected_loss",
      "q_prev": 1.0,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.25)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 254,
      "a_only": 117,
      "b_only": 137,
      "mean_a": 46.666666666666664,
      "mean_b": 48.0,
      "rate_a": 46.666666666666664,
      "rate_b": 48.0,
      "delta": -1.3333333333333333,
      "ci95": [
       -3.3707865187534516,
       0.6830601113560235
      ],
      "p": 0.22137786221377861,
      "mid_p": 0.19845,
      "per_seed": {
       "42": 0.6,
       "43": -0.2,
       "44": -4.4
      },
      "p_het": 0.12958704129587043,
      "mdd80": 2.8972973189803226,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u32",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7815885078158851,
      "label_source": "no_detected_loss",
      "q": 0.7563759753056952,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.90)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 77.60942760942761,
      "mean_b": 77.10437710437711,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.2222222252200545,
       3.236245957316653
      ],
      "p": 0.8082191780821918,
      "mid_p": 0.7167,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": 3.0303030303030303,
       "44": 0.5050505050505051
      },
      "p_het": 0.44475552444755523,
      "mdd80": 3.90118489277329,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 1.0,
      "label_source": "no_detected_loss",
      "q": 0.9905107050270583,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 1.0,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 3.90)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 31,
      "mean_a": 86.59722222222223,
      "mean_b": 87.15277777777777,
      "delta": -0.5555555555555556,
      "ci95": [
       -1.90972222392641,
       0.7812500012599715
      ],
      "p": 0.47895210478952105,
      "mid_p": 0.4209,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": -2.7083333333333335,
       "44": 0.20833333333333334
      },
      "p_het": 0.1586841315868413,
      "mdd80": 1.923246566748498,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.92)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 112,
      "mean_a": 79.0748898678414,
      "mean_b": 80.10279001468429,
      "delta": -1.0279001468428781,
      "ci95": [
       -2.608695653731572,
       0.5578800572922671
      ],
      "p": 0.23447655234476553,
      "mid_p": 0.2024,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": -0.8810572687224669,
       "44": -1.7621145374449338
      },
      "p_het": 0.8000199980002,
      "mdd80": 2.2631619187945984,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7815885078158851,
      "label_source": "no_detected_loss",
      "q": 0.7563759753056952,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.26)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 38,
      "a_only": 21,
      "b_only": 17,
      "mean_a": 24.344569288389515,
      "mean_b": 22.846441947565545,
      "rate_a": 24.34456928838951,
      "rate_b": 22.84644194756554,
      "delta": 1.4981273408239701,
      "ci95": [
       -3.401360548659219,
       6.504065046086277
      ],
      "p": 0.6565343465653435,
      "mid_p": 0.5587,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 2.247191011235955,
       "44": 1.1235955056179776
      },
      "p_het": 1.0,
      "mdd80": 7.079439761202847,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.9905107050270583,
      "label_source": "no_detected_loss",
      "q": 0.9816928754885706,
      "label": "no_detected_loss",
      "q_prev": 0.9905107050270583,
      "label_prev": "no_detected_loss",
      "q_published": 0.9965670099656702,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 7.08)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 236,
      "a_only": 124,
      "b_only": 112,
      "mean_a": 48.8,
      "mean_b": 48.0,
      "rate_a": 48.800000000000004,
      "rate_b": 48.0,
      "delta": 0.8,
      "ci95": [
       -1.1204481812823857,
       2.7100271022041316
      ],
      "p": 0.46005399460054,
      "mid_p": 0.42035,
      "per_seed": {
       "42": 3.0,
       "43": 0.0,
       "44": -0.6
      },
      "p_het": 0.3160683931606839,
      "mdd80": 2.737653093937146,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u64",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.74)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 83,
      "mean_a": 75.25252525252525,
      "mean_b": 77.10437710437711,
      "delta": -1.8518518518518519,
      "ci95": [
       -4.629629632174494,
       0.9803921596076981
      ],
      "p": 0.23357664233576642,
      "mid_p": 0.1935,
      "per_seed": {
       "42": -5.555555555555555,
       "43": 1.0101010101010102,
       "44": -1.0101010101010102
      },
      "p_het": 0.23927607239276072,
      "mdd80": 4.009500748259139,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.7815885078158851,
      "label_source": "no_detected_loss",
      "q": 0.7563759753056952,
      "label": "no_detected_loss",
      "q_prev": 0.7815885078158851,
      "label_prev": "no_detected_loss",
      "q_published": 0.7815885078158851,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 4.01)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 87.91666666666667,
      "mean_b": 87.15277777777777,
      "delta": 0.7638888888888888,
      "ci95": [
       -0.5555555568823022,
       2.0833333351466283
      ],
      "p": 0.3738626137386261,
      "mid_p": 0.31735,
      "per_seed": {
       "42": 1.25,
       "43": 0.625,
       "44": 0.4166666666666667
      },
      "p_het": 0.8911108889111089,
      "mdd80": 1.8860224398168466,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.957904209579042,
      "label_source": "no_detected_loss",
      "q": 0.9156491758231584,
      "label": "no_detected_loss",
      "q_prev": 0.957904209579042,
      "label_prev": "no_detected_loss",
      "q_published": 0.957904209579042,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 1.89)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 115,
      "mean_a": 78.8546255506608,
      "mean_b": 80.10279001468429,
      "delta": -1.2481644640234948,
      "ci95": [
       -2.8528528544919824,
       0.310077521018233
      ],
      "p": 0.1548845115488451,
      "mid_p": 0.1311,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": -2.643171806167401,
       "44": -1.5418502202643172
      },
      "p_het": 0.24537546245375463,
      "mdd80": 2.2605565856939434,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.6734109197775875,
      "label_source": "no_detected_loss",
      "q": 0.6195380461953804,
      "label": "no_detected_loss",
      "q_prev": 0.6734109197775875,
      "label_prev": "no_detected_loss",
      "q_published": 0.6734109197775875,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.26)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 37,
      "a_only": 15,
      "b_only": 22,
      "mean_a": 20.224719101123597,
      "mean_b": 22.846441947565545,
      "rate_a": 20.224719101123597,
      "rate_b": 22.84644194756554,
      "delta": -2.6217228464419478,
      "ci95": [
       -6.837606842415951,
       1.5873015917539974
      ],
      "p": 0.29847015298470153,
      "mid_p": 0.2307,
      "per_seed": {
       "42": -7.865168539325842,
       "43": -1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.2662733726627337,
      "mdd80": 6.0213093504023645,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "source_md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "q_source": 0.8934400677579301,
      "label_source": "no_detected_loss",
      "q": 0.8679132086791321,
      "label": "no_detected_loss",
      "q_prev": 0.8934400677579301,
      "label_prev": "no_detected_loss",
      "q_published": 0.8934400677579301,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 6.02)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "jqs_f_dense",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 234,
      "a_only": 128,
      "b_only": 106,
      "mean_a": 49.46666666666667,
      "mean_b": 48.0,
      "rate_a": 49.46666666666667,
      "rate_b": 48.0,
      "delta": 1.4666666666666666,
      "ci95": [
       -0.4255319169008238,
       3.3898305105063145
      ],
      "p": 0.15108489151084892,
      "mid_p": 0.1329,
      "per_seed": {
       "42": 4.0,
       "43": 1.4,
       "44": -1.0
      },
      "p_het": 0.15398460153984603,
      "mdd80": 2.7268518867390985,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u128",
       "jqs_f_dense"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/verdicts_noruler.json",
      "source_md5": "e41a15a47099cab0e07915792d268715",
      "q_source": 0.6734109197775875,
      "label_source": "no_detected_loss",
      "q": 0.6195380461953804,
      "label": "no_detected_loss",
      "q_prev": 0.6734109197775875,
      "label_prev": "no_detected_loss",
      "q_published": 0.6734109197775875,
      "label_published": "no_detected_loss",
      "changed": false,
      "text": "no detected loss (MDD80 2.73)"
     }
    ],
    "counts": {
     "m": 100,
     "by_bench": {
      "gpqa": 20,
      "aime25": 20,
      "lcb": 20,
      "tb": 20,
      "swe": 20
     },
     "n_p05": 11,
     "n_p05_below": 10,
     "n_p05_above": 1,
     "loss_detected": 1,
     "nominal_loss": 9,
     "gain_detected": 0,
     "nominal_gain": 1,
     "no_detected_loss": 89,
     "smallest_q_below": 0.009999000099990002
    },
    "counts_prev": {
     "m": 100,
     "by_bench": {
      "gpqa": 20,
      "aime25": 20,
      "lcb": 20,
      "tb": 20,
      "swe": 20
     },
     "n_p05": 11,
     "n_p05_below": 10,
     "n_p05_above": 1,
     "loss_detected": 1,
     "nominal_loss": 9,
     "gain_detected": 0,
     "nominal_gain": 1,
     "no_detected_loss": 89,
     "smallest_q_below": 0.009999000099990002
    },
    "label_changes": [],
    "sources": [
     {
      "source": "published",
      "file": "log/sparse/dev/stats/verdicts_noruler.json",
      "md5": "e41a15a47099cab0e07915792d268715",
      "members": 75
     },
     {
      "source": "tbp v1",
      "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json",
      "md5": "c753ae5ba8b1e30924086bcd2edfa464",
      "members": 20
     },
     {
      "source": "sxs",
      "file": null,
      "md5": null,
      "members": 5
     }
    ],
    "ruler": {
     "unchanged": true,
     "m": 20,
     "source": "log/sparse/dev/stats/verdicts_noruler.json",
     "why": "no RULER member is replaced: RULER keeps its own BH (prereg family_bh)"
    },
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "members": {
       "jqs_f_r40_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": -1.5907447577729574,
        "ci95": [
         -3.3850493670515682,
         0.15797788500230892
        ],
        "p": 0.10078992100789921,
        "n_items": 1383,
        "mean_a": 85.82791033984093,
        "mean_b": 87.41865509761388,
        "per_seed": {
         "42": 1.0869565217391304,
         "43": -2.8077753779697625,
         "44": -3.0434782608695654
        },
        "p_het": 0.0882911708829117,
        "mdd80": 2.532213054683991,
        "shift_vs_primary": 0.01891318991315938,
        "q_sub": 0.503949605039496,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r60_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.8658008658008658,
        "ci95": [
         -0.8810572704947381,
         2.623456792001788
        ],
        "p": 0.3788621137886211,
        "n_items": 1386,
        "mean_a": 88.0952380952381,
        "mean_b": 87.22943722943722,
        "per_seed": {
         "42": 2.1691973969631237,
         "43": 0.8620689655172413,
         "44": -0.43383947939262474
        },
        "p_het": 0.48925107489251074,
        "mdd80": 2.5046875533438286,
        "shift_vs_primary": 0.19645682296284706,
        "q_sub": 0.903683216584002,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u32_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.1440922190201729,
        "ci95": [
         -1.8018018038298385,
         2.094240839461458
        ],
        "p": 0.9425057494250575,
        "n_items": 1388,
        "mean_a": 87.39193083573487,
        "mean_b": 87.2478386167147,
        "per_seed": {
         "42": 1.2987012987012987,
         "43": -0.43103448275862066,
         "44": -0.4329004329004329
        },
        "p_het": 0.6639336066393361,
        "mdd80": 2.7845142983951634,
        "shift_vs_primary": 0.010402379447980392,
        "q_sub": 1.0,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u64_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.0093727469358327,
        "ci95": [
         -0.8982035947899123,
         2.928870294744275
        ],
        "p": 0.34196580341965804,
        "n_items": 1387,
        "mean_a": 88.2480173035328,
        "mean_b": 87.23864455659697,
        "per_seed": {
         "42": 3.036876355748373,
         "43": -0.646551724137931,
         "44": 0.6493506493506493
        },
        "p_het": 0.20837916208379162,
        "mdd80": 2.7352221066605957,
        "shift_vs_primary": 0.006028265330481508,
        "q_sub": 0.903683216584002,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u128_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.585014409221902,
        "ci95": [
         -0.13386881016220392,
         3.2659409038364684
        ],
        "p": 0.07939206079392061,
        "n_items": 1388,
        "mean_a": 88.8328530259366,
        "mean_b": 87.2478386167147,
        "per_seed": {
         "42": 1.948051948051948,
         "43": 1.9396551724137931,
         "44": 0.8658008658008658
        },
        "p_het": 0.8369163083691631,
        "mdd80": 2.429855016282548,
        "shift_vs_primary": 0.18127109371388062,
        "q_sub": 0.46818847527012003,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "members": {
       "jqs_f_r40_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": -1.6194331983805668,
        "ci95": [
         -3.3512064360296536,
         0.13513513688818873
        ],
        "p": 0.0841915808419158,
        "n_items": 1482,
        "mean_a": 85.69500674763833,
        "mean_b": 87.3144399460189,
        "per_seed": {
         "42": 1.4198782961460445,
         "43": -2.8225806451612905,
         "44": -3.4482758620689653
        },
        "p_het": 0.032296770322967704,
        "mdd80": 2.491699616172141,
        "shift_vs_primary": -0.009775250694449955,
        "q_sub": 0.4727305047273051,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r60_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.6734006734006734,
        "ci95": [
         -1.0403120952803029,
         2.3809523826242214
        ],
        "p": 0.4904509549045096,
        "n_items": 1485,
        "mean_a": 87.8114478114478,
        "mean_b": 87.13804713804714,
        "per_seed": {
         "42": 2.6315789473684212,
         "43": 0.8048289738430584,
         "44": -1.417004048582996
        },
        "p_het": 0.1444855514448555,
        "mdd80": 2.4451888055487943,
        "shift_vs_primary": 0.004056630562654706,
        "q_sub": 0.9156491758231584,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u32_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.20174848688634836,
        "ci95": [
         -1.6551724156934495,
         2.0592020609793327
        ],
        "p": 0.8845115488451155,
        "n_items": 1487,
        "mean_a": 87.35709482178883,
        "mean_b": 87.15534633490249,
        "per_seed": {
         "42": 2.0202020202020203,
         "43": -0.6036217303822937,
         "44": -0.8080808080808081
        },
        "p_het": 0.3247675232476752,
        "mdd80": 2.654675471198665,
        "shift_vs_primary": 0.06805864731415584,
        "q_sub": 1.0,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u64_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.009421265141319,
        "ci95": [
         -0.8119079855922937,
         2.838709679173294
        ],
        "p": 0.3150684931506849,
        "n_items": 1486,
        "mean_a": 88.15612382234185,
        "mean_b": 87.14670255720054,
        "per_seed": {
         "42": 3.6437246963562755,
         "43": -0.6036217303822937,
         "44": 0.0
        },
        "p_het": 0.0887911208879112,
        "mdd80": 2.609108271188324,
        "shift_vs_primary": 0.006076783535967856,
        "q_sub": 0.8751902587519026,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u128_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.4122394082044385,
        "ci95": [
         -0.25348542615282355,
         3.0428769034731173
        ],
        "p": 0.10838916108389161,
        "n_items": 1487,
        "mean_a": 88.56758574310693,
        "mean_b": 87.15534633490249,
        "per_seed": {
         "42": 3.0303030303030303,
         "43": 1.6096579476861168,
         "44": -0.40404040404040403
        },
        "p_het": 0.2395760423957604,
        "mdd80": 2.35592083555343,
        "shift_vs_primary": 0.008496092696417046,
        "q_sub": 0.5161388623042458,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "unavailable",
      "why": "unavailable: the route-(i) scan was not validated before the START marker"
     },
     "drop_probed": {
      "status": "complete",
      "members": {
       "jqs_f_r40_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": -1.6337644656228727,
        "ci95": [
         -3.3333333348740553,
         1.7145788555818302e-09
        ],
        "p": 0.06779322067793221,
        "n_items": 1469,
        "mean_a": 85.84070796460178,
        "mean_b": 87.47447243022464,
        "per_seed": {
         "42": 1.4112903225806452,
         "43": -2.80561122244489,
         "44": -3.586497890295359
        },
        "p_het": 0.026497350264973504,
        "mdd80": 2.382344133997288,
        "shift_vs_primary": -0.02410651793675589,
        "q_sub": 0.42370762923707633,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_r60_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.5438477226376615,
        "ci95": [
         -1.134751774793716,
         2.2191400849241076
        ],
        "p": 0.5874412558744125,
        "n_items": 1471,
        "mean_a": 87.83140720598233,
        "mean_b": 87.28755948334467,
        "per_seed": {
         "42": 2.6156941649899395,
         "43": 0.8,
         "44": -1.8987341772151898
        },
        "p_het": 0.08509149085091491,
        "mdd80": 2.3970373770770808,
        "shift_vs_primary": -0.12549632020035728,
        "q_sub": 0.9816928754885706,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u32_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": -0.13577732518669383,
        "ci95": [
         -2.018842532145227,
         1.74165457384277
        ],
        "p": 0.9416058394160584,
        "n_items": 1473,
        "mean_a": 87.16904276985743,
        "mean_b": 87.30482009504412,
        "per_seed": {
         "42": 1.8072289156626506,
         "43": -0.6,
         "44": -1.6842105263157894
        },
        "p_het": 0.22617738226177383,
        "mdd80": 2.6876394637845626,
        "shift_vs_primary": -0.2694671647588863,
        "q_sub": 1.0,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u64_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.8831521739130435,
        "ci95": [
         -0.9408602168511322,
         2.718168814515088
        ],
        "p": 0.38786121387861217,
        "n_items": 1472,
        "mean_a": 88.17934782608695,
        "mean_b": 87.2961956521739,
        "per_seed": {
         "42": 3.6217303822937628,
         "43": -0.6,
         "44": -0.42105263157894735
        },
        "p_het": 0.0740925907409259,
        "mdd80": 2.6151199021464278,
        "shift_vs_primary": -0.12019230769230771,
        "q_sub": 0.9210617399798481,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       },
       "jqs_f_u128_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.3577732518669383,
        "ci95": [
         -0.27586207061964,
         2.9947916682360374
        ],
        "p": 0.1250874912508749,
        "n_items": 1473,
        "mean_a": 88.66259334691107,
        "mean_b": 87.30482009504412,
        "per_seed": {
         "42": 3.0120481927710845,
         "43": 1.6,
         "44": -0.631578947368421
        },
        "p_het": 0.1872812718728127,
        "mdd80": 2.337546822446911,
        "shift_vs_primary": -0.045970063641083136,
        "q_sub": 0.5542923968472718,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out": [
       [
        44,
        252
       ],
       [
        44,
        253
       ],
       [
        44,
        254
       ],
       [
        44,
        255
       ],
       [
        44,
        256
       ],
       [
        44,
        257
       ],
       [
        44,
        258
       ],
       [
        44,
        259
       ],
       [
        44,
        263
       ],
       [
        44,
        267
       ],
       [
        44,
        271
       ],
       [
        44,
        272
       ],
       [
        44,
        273
       ],
       [
        44,
        274
       ],
       [
        44,
        275
       ],
       [
        44,
        276
       ],
       [
        44,
        281
       ],
       [
        44,
        298
       ],
       [
        44,
        303
       ],
       [
        44,
        308
       ],
       [
        44,
        310
       ],
       [
        44,
        311
       ],
       [
        44,
        312
       ]
      ],
      "applies_to": [
       "jqs_f_r40_sxs|jqs_f_dense_sxs",
       "jqs_f_r60_sxs|jqs_f_dense_sxs",
       "jqs_f_u32_sxs|jqs_f_dense_sxs",
       "jqs_f_u64_sxs|jqs_f_dense_sxs",
       "jqs_f_u128_sxs|jqs_f_dense_sxs"
      ],
      "not_applicable": []
     },
     "by_period_stack": {
      "status": "unavailable",
      "why": "Final registered stack record and split inputs were not completed."
     },
     "zero_as_failure": {
      "status": "complete",
      "members": {
       "jqs_f_r40_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": -1.5333333333333334,
        "ci95": [
         -3.278688526378998,
         0.2583979345509958
        ],
        "p": 0.10338966103389662,
        "n_items": 1500,
        "mean_a": 85.46666666666667,
        "mean_b": 87.0,
        "per_seed": {
         "42": 1.4,
         "43": -2.8,
         "44": -3.2
        },
        "p_het": 0.040195980401959805,
        "mdd80": 2.5279671520225517,
        "shift_vs_primary": 0.07632461435278337,
        "q_sub": 0.5109012908232986,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r40_sxs": 6,
         "jqs_f_dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "pairs_restored": 9
       },
       "jqs_f_r60_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.6666666666666666,
        "ci95": [
         -1.0457516356604115,
         2.36111111287137
        ],
        "p": 0.49475052494750527,
        "n_items": 1500,
        "mean_a": 87.66666666666667,
        "mean_b": 87.0,
        "per_seed": {
         "42": 2.6,
         "43": 0.8,
         "44": -1.4
        },
        "p_het": 0.1588841115888411,
        "mdd80": 2.434895842911675,
        "shift_vs_primary": -0.0026773761713521083,
        "q_sub": 0.9162046758287135,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r60_sxs": 3,
         "jqs_f_dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "pairs_restored": 6
       },
       "jqs_f_u32_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 0.3333333333333333,
        "ci95": [
         -1.5209125492854754,
         2.1947873818811647
        ],
        "p": 0.7837216278372163,
        "n_items": 1500,
        "mean_a": 87.33333333333333,
        "mean_b": 87.0,
        "per_seed": {
         "42": 2.0,
         "43": -0.6,
         "44": -0.4
        },
        "p_het": 0.4012598740125987,
        "mdd80": 2.6556227778192367,
        "shift_vs_primary": 0.1996434937611408,
        "q_sub": 0.9785768411110696,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u32_sxs": 1,
         "jqs_f_dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "pairs_restored": 4
       },
       "jqs_f_u64_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.1333333333333333,
        "ci95": [
         -0.6830601111449551,
         2.9601029618599792
        ],
        "p": 0.25707429257074293,
        "n_items": 1500,
        "mean_a": 88.13333333333334,
        "mean_b": 87.0,
        "per_seed": {
         "42": 3.6,
         "43": -0.6,
         "44": 0.4
        },
        "p_het": 0.11828817118288171,
        "mdd80": 2.6037804503078257,
        "shift_vs_primary": 0.12998885172798214,
        "q_sub": 0.77901300779013,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u64_sxs": 1,
         "jqs_f_dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "pairs_restored": 5
       },
       "jqs_f_u128_sxs|jqs_f_dense_sxs": {
        "status": "complete",
        "delta": 1.6,
        "ci95": [
         -1.6951171388646056e-09,
         3.245942573320299
        ],
        "p": 0.06919308069193081,
        "n_items": 1500,
        "mean_a": 88.6,
        "mean_b": 87.0,
        "per_seed": {
         "42": 3.2,
         "43": 1.6,
         "44": 0.0
        },
        "p_het": 0.27787221277872215,
        "mdd80": 2.319885673598431,
        "shift_vs_primary": 0.19625668449197864,
        "q_sub": 0.43245675432456754,
        "label_sub": "no_detected_loss",
        "label_primary": "no_detected_loss",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u128_sxs": 1,
         "jqs_f_dense_sxs": 4
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "jqs_f_dense_sxs": 0
        },
        "pairs_restored": 4
       }
      },
      "other_label_changes": [],
      "rule": "the addendum v2's zero_token_as_failure: every (seed, instance) an item, no pair dropped; a zero-token row (tokens == 0, whatever its resolved field) or a missing row scores 0 on its side; same test and seed tuple as the contrast; the label its p gets substituted into the family's BH; never decides",
      "items_total": 1500
     }
    }
   },
   "H10": {
    "title": "H10 head to head: Jet-QSparse final arm minus Loki / SparQ",
    "seed_tuple": [
     20261024,
     27,
     0,
     1
    ],
    "specs": [
     [
      "jqs_f_dense_sxs",
      "loki_k25_d25_s1_sxs"
     ],
     [
      "jqs_f_dense_sxs",
      "sparq_c8_s1_sxs"
     ],
     [
      "jqs_f_r40_sxs",
      "loki_k25_d25_s1_sxs"
     ],
     [
      "jqs_f_r40_sxs",
      "sparq_c8_s1_sxs"
     ],
     [
      "jqs_f_r60_sxs",
      "loki_k25_d25_s1_sxs"
     ],
     [
      "jqs_f_r60_sxs",
      "sparq_c8_s1_sxs"
     ],
     [
      "jqs_f_u32_sxs",
      "loki_k25_d25_s1_sxs"
     ],
     [
      "jqs_f_u32_sxs",
      "sparq_c8_s1_sxs"
     ],
     [
      "jqs_f_u64_sxs",
      "loki_k25_d25_s1_sxs"
     ],
     [
      "jqs_f_u64_sxs",
      "sparq_c8_s1_sxs"
     ],
     [
      "jqs_f_u128_sxs",
      "loki_k25_d25_s1_sxs"
     ],
     [
      "jqs_f_u128_sxs",
      "sparq_c8_s1_sxs"
     ]
    ],
    "replaces": [
     [
      "jqs_f_dense",
      "loki_k25_d25_s1"
     ],
     [
      "jqs_f_dense",
      "sparq_c8_s1"
     ],
     [
      "jqs_f_r40",
      "loki_k25_d25_s1"
     ],
     [
      "jqs_f_r40",
      "sparq_c8_s1"
     ],
     [
      "jqs_f_r60",
      "loki_k25_d25_s1"
     ],
     [
      "jqs_f_r60",
      "sparq_c8_s1"
     ],
     [
      "jqs_f_u32",
      "loki_k25_d25_s1"
     ],
     [
      "jqs_f_u32",
      "sparq_c8_s1"
     ],
     [
      "jqs_f_u64",
      "loki_k25_d25_s1"
     ],
     [
      "jqs_f_u64",
      "sparq_c8_s1"
     ],
     [
      "jqs_f_u128",
      "loki_k25_d25_s1"
     ],
     [
      "jqs_f_u128",
      "sparq_c8_s1"
     ]
    ],
    "family_m_registered": 240,
    "m": 240,
    "status": "ARCHIVAL ONLY; integrity gate failed; not used in main comparison",
    "removed": [],
    "members": [
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 35,
      "mean_a": 90.57239057239057,
      "mean_b": 90.4040404040404,
      "delta": 0.16835016835016836,
      "ci95": [
       -1.7361111130714457,
       2.0833333353078394
      ],
      "p": 1.0,
      "mid_p": 0.86575,
      "per_seed": {
       "42": 0.0,
       "43": 0.0,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 2.7297693203516036,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.73)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 20,
      "mean_a": 98.68055555555556,
      "mean_b": 98.125,
      "delta": 0.5555555555555556,
      "ci95": [
       -0.625000001783969,
       1.8055555568164805
      ],
      "p": 0.5851414858514149,
      "mid_p": 0.51015,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -0.20833333333333334,
       "44": 2.2916666666666665
      },
      "p_het": null,
      "mdd80": 1.7371259315194247,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.74)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 132,
      "mean_a": 86.63729809104258,
      "mean_b": 86.78414096916299,
      "delta": -0.14684287812041116,
      "ci95": [
       -1.8264840200053487,
       1.527777779357057
      ],
      "p": 0.9344065593440656,
      "mid_p": 0.8682,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": 0.8810572687224669,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.3973017741394833,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 39,
      "a_only": 24,
      "b_only": 15,
      "mean_a": 75.65543071161049,
      "mean_b": 72.28464419475655,
      "rate_a": 75.65543071161049,
      "rate_b": 72.28464419475655,
      "delta": 3.3707865168539324,
      "ci95": [
       -1.5151515200841406,
       8.148148152865202
      ],
      "p": 0.22607739226077392,
      "mid_p": 0.17555,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 6.741573033707865,
       "44": 1.1235955056179776
      },
      "p_het": 0.6657334266573343,
      "mdd80": 6.90639158052792,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.7143181785717533,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7889877678898777,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.91)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_dense_sxs",
      "b": "loki_k25_d25_s1_sxs",
      "n_items": 1494,
      "n_clusters": 500,
      "n_diff_items": 168,
      "a_only": 77,
      "b_only": 91,
      "mean_a": 87.21552878179384,
      "mean_b": 88.15261044176707,
      "rate_a": 87.0,
      "rate_b": 87.93333333333334,
      "delta": -0.9370816599732262,
      "ci95": [
       -2.777777779686044,
       0.9150326815462209
      ],
      "p": 0.3608639136086391,
      "mid_p": 0.32515,
      "per_seed": {
       "42": -2.4193548387096775,
       "43": 0.0,
       "44": -0.40160642570281124
      },
      "p_het": 0.4403559644035596,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "row_arm": "jqs_f_dense",
      "source": "sxs",
      "replaces": [
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final dense NVFP4 (sxs) vs Loki k25 d25 (sxs)",
      "mdd80": 2.639263599506673,
      "se": 0.9448212875464829,
      "ci95_bootstrap": [
       -2.807486631016043,
       0.9370816599732262
      ],
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.64)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 26,
      "mean_a": 89.05723905723906,
      "mean_b": 90.4040404040404,
      "delta": -1.3468013468013469,
      "ci95": [
       -3.333333335293308,
       0.6666666686591476
      ],
      "p": 0.24497550244975502,
      "mid_p": 0.1889,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": -2.525252525252525,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.8588129608296895,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.86)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 19,
      "mean_a": 98.88888888888889,
      "mean_b": 98.125,
      "delta": 0.7638888888888888,
      "ci95": [
       -0.18939394070715038,
       1.7628205139850017
      ],
      "p": 0.20037996200379962,
      "mid_p": 0.15035,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": 1.0416666666666667,
       "44": 1.4583333333333333
      },
      "p_het": null,
      "mdd80": 1.3952539949695775,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7177789683718195,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7177789683718195,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.40)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 150,
      "mean_a": 86.63729809104258,
      "mean_b": 86.78414096916299,
      "delta": -0.14684287812041116,
      "ci95": [
       -1.9607843157375422,
       1.6666666685303504
      ],
      "p": 0.9351064893510649,
      "mid_p": 0.8733,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": 0.44052863436123346,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 2.5925509695881312,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.59)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 22,
      "b_only": 29,
      "mean_a": 69.66292134831461,
      "mean_b": 72.28464419475655,
      "rate_a": 69.66292134831461,
      "rate_b": 72.28464419475655,
      "delta": -2.6217228464419478,
      "ci95": [
       -8.000000004769852,
       2.7777777827864423
      ],
      "p": 0.410958904109589,
      "mid_p": 0.3404,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 0.0,
       "44": -5.617977528089888
      },
      "p_het": 0.7071292870712929,
      "mdd80": 7.702912699390714,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9001281690012817,
      "label_source": "none",
      "q": 0.8920189062174864,
      "label": "none",
      "q_prev": 0.9001281690012817,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.70)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r40_sxs",
      "b": "loki_k25_d25_s1_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 151,
      "a_only": 59,
      "b_only": 92,
      "mean_a": 85.85790884718499,
      "mean_b": 88.06970509383378,
      "rate_a": 85.46666666666665,
      "rate_b": 87.93333333333334,
      "delta": -2.2117962466487935,
      "ci95": [
       -3.7921348331114793,
       -0.651041665156904
      ],
      "p": 0.006199380061993801,
      "mid_p": 0.0049,
      "per_seed": {
       "42": -0.6060606060606061,
       "43": -2.6052104208416833,
       "44": -3.4136546184738954
      },
      "p_het": 0.3665633436656334,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "row_arm": "jqs_f_r40",
      "source": "sxs",
      "replaces": [
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final rho 0.40 (sxs) vs Loki k25 d25 (sxs)",
      "mdd80": 2.244949462712267,
      "se": 0.8046141912079894,
      "ci95_bootstrap": [
       -3.8127728304522437,
       -0.6036217303822937
      ],
      "q": 0.11445009345219324,
      "label": "below_nominal",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": true,
      "text": "below, nominal (p 0.00620, q 0.114)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 27,
      "mean_a": 89.8989898989899,
      "mean_b": 90.4040404040404,
      "delta": -0.5050505050505051,
      "ci95": [
       -2.4561403529031347,
       1.4184397183308373
      ],
      "p": 0.7516248375162484,
      "mid_p": 0.6357,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -1.5151515151515151,
       "44": -0.5050505050505051
      },
      "p_het": null,
      "mdd80": 2.7691749286177654,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.77)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 98.88888888888889,
      "mean_b": 98.125,
      "delta": 0.7638888888888888,
      "ci95": [
       -0.29761904876775314,
       1.8939393954952308
      ],
      "p": 0.23767623237676233,
      "mid_p": 0.19005,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": 0.625,
       "44": 1.4583333333333333
      },
      "p_het": null,
      "mdd80": 1.5663139196709959,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.57)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 87.88546255506608,
      "mean_b": 86.78414096916299,
      "delta": 1.1013215859030836,
      "ci95": [
       -0.4629629646064706,
       2.6905829612590537
      ],
      "p": 0.20937906209379062,
      "mid_p": 0.1782,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": 1.5418502202643172,
       "44": 1.5418502202643172
      },
      "p_het": null,
      "mdd80": 2.2538494891319463,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7178710700358535,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7178710700358535,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.25)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 24,
      "b_only": 19,
      "mean_a": 74.15730337078652,
      "mean_b": 72.28464419475655,
      "rate_a": 74.15730337078651,
      "rate_b": 72.28464419475655,
      "delta": 1.8726591760299625,
      "ci95": [
       -3.787878793593305,
       7.619047626339925
      ],
      "p": 0.6061393860613938,
      "mid_p": 0.51885,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 4.49438202247191,
       "44": 2.247191011235955
      },
      "p_het": 0.6140385961403859,
      "mdd80": 8.152567265078268,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.15)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r60_sxs",
      "b": "loki_k25_d25_s1_sxs",
      "n_items": 1495,
      "n_clusters": 500,
      "n_diff_items": 165,
      "a_only": 81,
      "b_only": 84,
      "mean_a": 87.89297658862876,
      "mean_b": 88.09364548494983,
      "rate_a": 87.66666666666667,
      "rate_b": 87.93333333333334,
      "delta": -0.20066889632107024,
      "ci95": [
       -1.8617021293089184,
       1.4473684226684664
      ],
      "p": 0.8717128287171283,
      "mid_p": 0.8111,
      "per_seed": {
       "42": 0.4032258064516129,
       "43": 0.8,
       "44": -1.8036072144288577
      },
      "p_het": 0.44565543445655437,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "row_arm": "jqs_f_r60",
      "source": "sxs",
      "replaces": [
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final rho 0.60 (sxs) vs Loki k25 d25 (sxs)",
      "mdd80": 2.3650034432363083,
      "se": 0.8388298841040898,
      "ci95_bootstrap": [
       -1.8691588785046729,
       1.4696058784235138
      ],
      "q": 1.0,
      "label": "none",
      "q_prev": 0.9335264820625375,
      "label_prev": "none",
      "q_published": 0.9335264820625375,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.37)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 28,
      "mean_a": 91.07744107744108,
      "mean_b": 90.4040404040404,
      "delta": 0.6734006734006734,
      "ci95": [
       -1.0638297890600246,
       2.4305555573638156
      ],
      "p": 0.5836416358364164,
      "mid_p": 0.4671,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 1.0101010101010102,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 2.4974485271546913,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 19,
      "mean_a": 99.02777777777777,
      "mean_b": 98.125,
      "delta": 0.9027777777777778,
      "ci95": [
       -0.2777777789663399,
       2.083333334953736
      ],
      "p": 0.18598140185981402,
      "mid_p": 0.1483,
      "per_seed": {
       "42": 0.625,
       "43": 1.0416666666666667,
       "44": 1.0416666666666667
      },
      "p_het": null,
      "mdd80": 1.6874937619409986,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6867005607131595,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.69)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 149,
      "mean_a": 88.91336270190895,
      "mean_b": 86.78414096916299,
      "delta": 2.129221732745962,
      "ci95": [
       0.42194092663498944,
       3.8580246931712643
      ],
      "p": 0.019198080191980802,
      "mid_p": 0.0159,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": 3.303964757709251,
       "44": 2.202643171806167
      },
      "p_het": null,
      "mdd80": 2.4557801991410098,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.271031720357376,
      "label_source": "above_nominal",
      "q": 0.255974402559744,
      "label": "above_nominal",
      "q_prev": 0.271031720357376,
      "label_prev": "above_nominal",
      "q_published": 0.271031720357376,
      "label_published": "above_nominal",
      "changed": false,
      "text": "above, nominal (p 0.0192, q 0.26)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 23,
      "b_only": 21,
      "mean_a": 73.03370786516854,
      "mean_b": 72.28464419475655,
      "rate_a": 73.03370786516854,
      "rate_b": 72.28464419475655,
      "delta": 0.7490636704119851,
      "ci95": [
       -4.761904767737165,
       6.289308180753699
      ],
      "p": 0.8915108489151085,
      "mid_p": 0.78695,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 2.247191011235955,
       "44": 1.1235955056179776
      },
      "p_het": 0.8816118388161184,
      "mdd80": 7.898337694704186,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.90)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u32_sxs",
      "b": "loki_k25_d25_s1_sxs",
      "n_items": 1497,
      "n_clusters": 500,
      "n_diff_items": 163,
      "a_only": 76,
      "b_only": 87,
      "mean_a": 87.374749498998,
      "mean_b": 88.10955243820975,
      "rate_a": 87.33333333333333,
      "rate_b": 87.93333333333334,
      "delta": -0.7348029392117569,
      "ci95": [
       -2.4045261686707056,
       0.9497964738897519
      ],
      "p": 0.4420557944205579,
      "mid_p": 0.39535,
      "per_seed": {
       "42": -0.6036217303822937,
       "43": -0.6,
       "44": -1.0
      },
      "p_het": 0.9809019098090191,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "row_arm": "jqs_f_u32",
      "source": "sxs",
      "replaces": [
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final N = 32 (sxs) vs Loki k25 d25 (sxs)",
      "mdd80": 2.397345258970233,
      "se": 0.8574113988611762,
      "ci95_bootstrap": [
       -2.408026755852843,
       0.9345794392523364
      ],
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 21,
      "mean_a": 90.9090909090909,
      "mean_b": 90.4040404040404,
      "delta": 0.5050505050505051,
      "ci95": [
       -1.111111112888948,
       2.1604938286748427
      ],
      "p": 0.6963303669633036,
      "mid_p": 0.56445,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 2.0202020202020203,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.338226650103822,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.34)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 98.26388888888889,
      "mean_b": 98.125,
      "delta": 0.1388888888888889,
      "ci95": [
       -0.7440476200018075,
       1.0416666675226263
      ],
      "p": 0.8736126387361264,
      "mid_p": 0.75475,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": 0.4166666666666667,
       "44": 0.4166666666666667
      },
      "p_het": null,
      "mdd80": 1.2762557861173156,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.28)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 126,
      "mean_a": 88.54625550660793,
      "mean_b": 86.78414096916299,
      "delta": 1.7621145374449338,
      "ci95": [
       0.1388888873595995,
       3.4428795010092097
      ],
      "p": 0.04839516048395161,
      "mid_p": 0.04115,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": 1.5418502202643172,
       "44": 4.185022026431718
      },
      "p_het": null,
      "mdd80": 2.3613727948569814,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.4989501049895011,
      "label_source": "above_nominal",
      "q": 0.47395260473952605,
      "label": "above_nominal",
      "q_prev": 0.4989501049895011,
      "label_prev": "above_nominal",
      "q_published": 0.4989501049895011,
      "label_published": "above_nominal",
      "changed": false,
      "text": "above, nominal (p 0.0484, q 0.47)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 52,
      "a_only": 25,
      "b_only": 27,
      "mean_a": 71.53558052434457,
      "mean_b": 72.28464419475655,
      "rate_a": 71.53558052434458,
      "rate_b": 72.28464419475655,
      "delta": -0.7490636704119851,
      "ci95": [
       -6.976744192490723,
       5.426356595523317
      ],
      "p": 0.9081091890810918,
      "mid_p": 0.81175,
      "per_seed": {
       "42": 0.0,
       "43": 0.0,
       "44": -2.247191011235955
      },
      "p_het": 0.947005299470053,
      "mdd80": 8.864536313053698,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.86)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u64_sxs",
      "b": "loki_k25_d25_s1_sxs",
      "n_items": 1496,
      "n_clusters": 500,
      "n_diff_items": 153,
      "a_only": 78,
      "b_only": 75,
      "mean_a": 88.30213903743315,
      "mean_b": 88.10160427807487,
      "rate_a": 88.13333333333333,
      "rate_b": 87.93333333333334,
      "delta": 0.20053475935828877,
      "ci95": [
       -1.3836478002278776,
       1.783264747850711
      ],
      "p": 0.8695130486951305,
      "mid_p": 0.8061,
      "per_seed": {
       "42": 1.4112903225806452,
       "43": -0.6,
       "44": -0.2
      },
      "p_het": 0.5645435456454354,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "row_arm": "jqs_f_u64",
      "source": "sxs",
      "replaces": [
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final N = 64 (sxs) vs Loki k25 d25 (sxs)",
      "mdd80": 2.2634026573288124,
      "se": 0.8087187535983196,
      "ci95_bootstrap": [
       -1.3396071748589038,
       1.8024032042723632
      ],
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.26)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 26,
      "mean_a": 90.74074074074075,
      "mean_b": 90.4040404040404,
      "delta": 0.3367003367003367,
      "ci95": [
       -1.360544219398998,
       2.0000000016406414
      ],
      "p": 0.8493150684931506,
      "mid_p": 0.71,
      "per_seed": {
       "42": 2.0202020202020203,
       "43": 0.0,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.401791841264115,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 24,
      "mean_a": 98.54166666666667,
      "mean_b": 98.125,
      "delta": 0.4166666666666667,
      "ci95": [
       -0.6944444458444331,
       1.562500001441553
      ],
      "p": 0.5540445955404459,
      "mid_p": 0.48095,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": 0.625,
       "44": 1.4583333333333333
      },
      "p_het": null,
      "mdd80": 1.613045507849572,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.61)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 87.37151248164464,
      "mean_b": 86.78414096916299,
      "delta": 0.5873715124816447,
      "ci95": [
       -1.174743026720952,
       2.328966522826701
      ],
      "p": 0.5777422257774223,
      "mid_p": 0.5233,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": 0.22026431718061673,
       "44": 1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.5041125653330476,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 50,
      "a_only": 28,
      "b_only": 22,
      "mean_a": 74.53183520599251,
      "mean_b": 72.28464419475655,
      "rate_a": 74.53183520599252,
      "rate_b": 72.28464419475655,
      "delta": 2.247191011235955,
      "ci95": [
       -3.1746031803310597,
       7.692307698512629
      ],
      "p": 0.49855014498550143,
      "mid_p": 0.4189,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 5.617977528089888,
       "44": -3.3707865168539324
      },
      "p_het": 0.35536446355364465,
      "mdd80": 7.766616408480572,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9496193237819075,
      "label_source": "none",
      "q": 0.927535153461398,
      "label": "none",
      "q_prev": 0.9496193237819075,
      "label_prev": "none",
      "q_published": 0.9496193237819075,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.77)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u128_sxs",
      "b": "loki_k25_d25_s1_sxs",
      "n_items": 1497,
      "n_clusters": 500,
      "n_diff_items": 153,
      "a_only": 81,
      "b_only": 72,
      "mean_a": 88.71075484301937,
      "mean_b": 88.10955243820975,
      "rate_a": 88.60000000000001,
      "rate_b": 87.93333333333334,
      "delta": 0.6012024048096193,
      "ci95": [
       -0.9433962279678647,
       2.147651008265455
      ],
      "p": 0.49545045495450457,
      "mid_p": 0.4428,
      "per_seed": {
       "42": 0.8048289738430584,
       "43": 1.6,
       "44": -0.6
      },
      "p_het": 0.5640435956404359,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "row_arm": "jqs_f_u128",
      "source": "sxs",
      "replaces": [
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final N = 128 (sxs) vs Loki k25 d25 (sxs)",
      "mdd80": 2.2091814731872286,
      "se": 0.7712183777034499,
      "ci95_bootstrap": [
       -0.9345794392523364,
       2.1361815754339117
      ],
      "q": 0.927535153461398,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.21)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 28,
      "mean_a": 90.57239057239057,
      "mean_b": 89.22558922558923,
      "delta": 1.3468013468013469,
      "ci95": [
       -0.3472222239687236,
       3.030303031986951
      ],
      "p": 0.17128287171282872,
      "mid_p": 0.12495,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": 0.5050505050505051,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 2.4139282419286885,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6851314868513149,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.41)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 11,
      "mean_a": 98.68055555555556,
      "mean_b": 98.68055555555556,
      "delta": 0.0,
      "ci95": [
       -1.1718750011038983,
       1.282051283538429
      ],
      "p": 1.0,
      "mid_p": 0.96925,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": -0.625,
       "44": 1.4583333333333333
      },
      "p_het": null,
      "mdd80": 1.7538290651310504,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.75)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 147,
      "mean_a": 86.63729809104258,
      "mean_b": 87.59177679882525,
      "delta": -0.9544787077826725,
      "ci95": [
       -2.801120449936828,
       0.8810572705565267
      ],
      "p": 0.34956504349565043,
      "mid_p": 0.3128,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": 0.22026431718061673,
       "44": -2.4229074889867843
      },
      "p_het": null,
      "mdd80": 2.631664345255797,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.63)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 37,
      "a_only": 23,
      "b_only": 14,
      "mean_a": 75.65543071161049,
      "mean_b": 72.28464419475655,
      "rate_a": 75.65543071161049,
      "rate_b": 72.28464419475655,
      "delta": 3.3707865168539324,
      "ci95": [
       -1.626016265578179,
       8.3333333394528
      ],
      "p": 0.24867513248675133,
      "mid_p": 0.19765,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 7.865168539325842,
       "44": 0.0
      },
      "p_het": 0.33766623337666235,
      "mdd80": 7.11797942604078,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.12)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_dense_sxs",
      "b": "sparq_c8_s1_sxs",
      "n_items": 1491,
      "n_clusters": 499,
      "n_diff_items": 150,
      "a_only": 62,
      "b_only": 88,
      "mean_a": 87.32394366197182,
      "mean_b": 89.06773977196512,
      "rate_a": 87.0,
      "rate_b": 88.66666666666667,
      "delta": -1.743796109993293,
      "ci95": [
       -3.481894152216972,
       1.7567496162953994e-09
      ],
      "p": 0.06009399060093991,
      "mid_p": 0.05055,
      "per_seed": {
       "42": -4.233870967741935,
       "43": -1.002004008016032,
       "44": 0.0
      },
      "p_het": 0.0724927507249275,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "sparq_c8_s1_sxs"
      ],
      "row_arm": "jqs_f_dense",
      "source": "sxs",
      "replaces": [
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final dense NVFP4 (sxs) vs SparQ c8 (sxs)",
      "mdd80": 2.4885210314453583,
      "se": 0.8888652643159346,
      "ci95_bootstrap": [
       -3.4853131298964475,
       0.0
      ],
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.49)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 27,
      "mean_a": 89.05723905723906,
      "mean_b": 89.22558922558923,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.1052631599145233,
       1.754385966910815
      ],
      "p": 1.0,
      "mid_p": 0.8688,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -2.0202020202020203,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.758503734280102,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.76)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 98.88888888888889,
      "mean_b": 98.68055555555556,
      "delta": 0.20833333333333334,
      "ci95": [
       -0.568181819253292,
       1.0416666677186204
      ],
      "p": 0.8117188281171883,
      "mid_p": 0.7102,
      "per_seed": {
       "42": -0.625,
       "43": 0.625,
       "44": 0.625
      },
      "p_het": null,
      "mdd80": 1.1505639287449543,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.15)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 151,
      "mean_a": 86.63729809104258,
      "mean_b": 87.59177679882525,
      "delta": -0.9544787077826725,
      "ci95": [
       -2.6722925473548518,
       0.7473841571850157
      ],
      "p": 0.30626937306269375,
      "mid_p": 0.27145,
      "per_seed": {
       "42": -1.3215859030837005,
       "43": -0.22026431718061673,
       "44": -1.3215859030837005
      },
      "p_het": null,
      "mdd80": 2.44405401878148,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7975976595888798,
      "label_source": "none",
      "q": 0.7891125781038917,
      "label": "none",
      "q_prev": 0.7975976595888798,
      "label_prev": "none",
      "q_published": 0.7975976595888798,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.44)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 22,
      "b_only": 29,
      "mean_a": 69.66292134831461,
      "mean_b": 72.28464419475655,
      "rate_a": 69.66292134831461,
      "rate_b": 72.28464419475655,
      "delta": -2.6217228464419478,
      "ci95": [
       -8.163265311133618,
       2.9761904806244814
      ],
      "p": 0.42885711428857115,
      "mid_p": 0.3587,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 1.1235955056179776,
       "44": -6.741573033707865
      },
      "p_het": 0.48935106489351066,
      "mdd80": 7.961405140650077,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9153956399231872,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.910846968400505,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.96)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r40_sxs",
      "b": "sparq_c8_s1_sxs",
      "n_items": 1490,
      "n_clusters": 499,
      "n_diff_items": 164,
      "a_only": 59,
      "b_only": 105,
      "mean_a": 85.90604026845638,
      "mean_b": 88.99328859060402,
      "rate_a": 85.46666666666665,
      "rate_b": 88.66666666666667,
      "delta": -3.087248322147651,
      "ci95": [
       -4.903417535441911,
       -1.2787723767996138
      ],
      "p": 0.000999900009999,
      "mid_p": 0.00075,
      "per_seed": {
       "42": -2.620967741935484,
       "43": -3.6144578313253013,
       "44": -3.024193548387097
      },
      "p_het": 0.8824117588241176,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "sparq_c8_s1_sxs"
      ],
      "row_arm": "jqs_f_r40",
      "source": "sxs",
      "replaces": [
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final rho 0.40 (sxs) vs SparQ c8 (sxs)",
      "mdd80": 2.590545636924043,
      "se": 0.9245392834501502,
      "ci95_bootstrap": [
       -4.909295771970808,
       -1.277740416946873
      ],
      "q": 0.029997000299970003,
      "label": "below_detected",
      "q_prev": 0.20957904209579042,
      "label_prev": "below_nominal",
      "q_published": 0.20957904209579042,
      "label_published": "below_nominal",
      "changed": true,
      "text": "below, detected (p 0.0010, q 0.0300)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 36,
      "mean_a": 89.8989898989899,
      "mean_b": 89.22558922558923,
      "delta": 0.6734006734006734,
      "ci95": [
       -1.6666666689785772,
       2.9962546842288083
      ],
      "p": 0.6704329567043296,
      "mid_p": 0.576,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": -1.0101010101010102,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 3.3326049966767046,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.33)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 17,
      "mean_a": 98.88888888888889,
      "mean_b": 98.68055555555556,
      "delta": 0.20833333333333334,
      "ci95": [
       -0.8012820524556257,
       1.2820512833011244
      ],
      "p": 0.835916408359164,
      "mid_p": 0.75075,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": 0.20833333333333334,
       "44": 0.625
      },
      "p_het": null,
      "mdd80": 1.4889650840262203,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.49)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 87.88546255506608,
      "mean_b": 87.59177679882525,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.4322916681949591,
       2.0100502532142572
      ],
      "p": 0.8082191780821918,
      "mid_p": 0.747,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": 0.8810572687224669,
       "44": 0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.460252922702001,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.46)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 39,
      "a_only": 22,
      "b_only": 17,
      "mean_a": 74.15730337078652,
      "mean_b": 72.28464419475655,
      "rate_a": 74.15730337078651,
      "rate_b": 72.28464419475655,
      "delta": 1.8726591760299625,
      "ci95": [
       -3.4722222271717547,
       7.189542488287753
      ],
      "p": 0.5933406659334066,
      "mid_p": 0.5046,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 5.617977528089888,
       "44": 1.1235955056179776
      },
      "p_het": 0.47835216478352166,
      "mdd80": 7.619997780938653,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.62)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r60_sxs",
      "b": "sparq_c8_s1_sxs",
      "n_items": 1493,
      "n_clusters": 499,
      "n_diff_items": 157,
      "a_only": 70,
      "b_only": 87,
      "mean_a": 87.87675820495646,
      "mean_b": 89.01540522438044,
      "rate_a": 87.66666666666667,
      "rate_b": 88.66666666666667,
      "delta": -1.1386470194239786,
      "ci95": [
       -2.8277634977610306,
       0.5449591297777763
      ],
      "p": 0.2111788821117888,
      "mid_p": 0.1848,
      "per_seed": {
       "42": -1.6096579476861168,
       "43": -0.20040080160320642,
       "44": -1.6096579476861168
      },
      "p_het": 0.7182281771822818,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "sparq_c8_s1_sxs"
      ],
      "row_arm": "jqs_f_r60",
      "source": "sxs",
      "replaces": [
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final rho 0.60 (sxs) vs SparQ c8 (sxs)",
      "mdd80": 2.410495787841033,
      "se": 0.8571471662941748,
      "ci95_bootstrap": [
       -2.8112449799196786,
       0.5365526492287056
      ],
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.41)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 31,
      "mean_a": 91.07744107744108,
      "mean_b": 89.22558922558923,
      "delta": 1.8518518518518519,
      "ci95": [
       -2.0357777674359163e-09,
       3.8011695923297997
      ],
      "p": 0.0918908109189081,
      "mid_p": 0.067,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": 1.5151515151515151,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 2.7167082229865946,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.72)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 99.02777777777777,
      "mean_b": 98.68055555555556,
      "delta": 0.3472222222222222,
      "ci95": [
       -0.555555556467294,
       1.325757577106979
      ],
      "p": 0.6911308869113089,
      "mid_p": 0.59615,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": 0.625,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.3445805910817135,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.34)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 146,
      "mean_a": 88.91336270190895,
      "mean_b": 87.59177679882525,
      "delta": 1.3215859030837005,
      "ci95": [
       -0.28985507404904226,
       2.9166666681757807
      ],
      "p": 0.12138786121387861,
      "mid_p": 0.1027,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": 2.643171806167401,
       "44": 0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.2917114766991586,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.571236993947664,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.29)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 38,
      "a_only": 20,
      "b_only": 18,
      "mean_a": 73.03370786516854,
      "mean_b": 72.28464419475655,
      "rate_a": 73.03370786516854,
      "rate_b": 72.28464419475655,
      "delta": 0.7490636704119851,
      "ci95": [
       -4.1666666712251335,
       5.673758869905527
      ],
      "p": 0.879012098790121,
      "mid_p": 0.7645,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 3.3707865168539324,
       "44": 0.0
      },
      "p_het": 0.7544245575442455,
      "mdd80": 7.0329840123165726,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.03)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u32_sxs",
      "b": "sparq_c8_s1_sxs",
      "n_items": 1494,
      "n_clusters": 499,
      "n_diff_items": 146,
      "a_only": 61,
      "b_only": 85,
      "mean_a": 87.41633199464525,
      "mean_b": 89.0227576974565,
      "rate_a": 87.33333333333333,
      "rate_b": 88.66666666666667,
      "delta": -1.606425702811245,
      "ci95": [
       -3.2171581785565673,
       1.6202427501200674e-09
      ],
      "p": 0.0608939106089391,
      "mid_p": 0.0501,
      "per_seed": {
       "42": -2.414486921529175,
       "43": -1.6032064128256514,
       "44": -0.8032128514056225
      },
      "p_het": 0.7075292470752925,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "sparq_c8_s1_sxs"
      ],
      "row_arm": "jqs_f_u32",
      "source": "sxs",
      "replaces": [
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final N = 32 (sxs) vs SparQ c8 (sxs)",
      "mdd80": 2.299313373360197,
      "se": 0.810468829267462,
      "ci95_bootstrap": [
       -3.21285140562249,
       -0.06684491978609626
      ],
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7166052625506681,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.30)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 30,
      "mean_a": 90.9090909090909,
      "mean_b": 89.22558922558923,
      "delta": 1.6835016835016836,
      "ci95": [
       -1.86744496972489e-09,
       3.472222224068079
      ],
      "p": 0.10118988101189881,
      "mid_p": 0.0707,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": 2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.4816084731442363,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.48)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 17,
      "mean_a": 98.26388888888889,
      "mean_b": 98.68055555555556,
      "delta": -0.4166666666666667,
      "ci95": [
       -1.1363636373592418,
       0.32051282137481024
      ],
      "p": 0.35236476352364765,
      "mid_p": 0.2721,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": 0.0,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 1.0412343246102842,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.04)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 125,
      "mean_a": 88.54625550660793,
      "mean_b": 87.59177679882525,
      "delta": 0.9544787077826725,
      "ci95": [
       -0.5952380968083526,
       2.510460252519894
      ],
      "p": 0.266973302669733,
      "mid_p": 0.23195,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": 0.8810572687224669,
       "44": 2.8634361233480177
      },
      "p_het": null,
      "mdd80": 2.219652671178472,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.22)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 48,
      "a_only": 23,
      "b_only": 25,
      "mean_a": 71.53558052434457,
      "mean_b": 72.28464419475655,
      "rate_a": 71.53558052434458,
      "rate_b": 72.28464419475655,
      "delta": -0.7490636704119851,
      "ci95": [
       -5.92592593103679,
       4.444444449578706
      ],
      "p": 0.8875112488751125,
      "mid_p": 0.78025,
      "per_seed": {
       "42": 0.0,
       "43": 1.1235955056179776,
       "44": -3.3707865168539324
      },
      "p_het": 0.8246175382461753,
      "mdd80": 7.411737305853335,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.41)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u64_sxs",
      "b": "sparq_c8_s1_sxs",
      "n_items": 1494,
      "n_clusters": 500,
      "n_diff_items": 148,
      "a_only": 69,
      "b_only": 79,
      "mean_a": 88.28647925033466,
      "mean_b": 88.95582329317268,
      "rate_a": 88.13333333333333,
      "rate_b": 88.66666666666667,
      "delta": -0.6693440428380187,
      "ci95": [
       -2.3514851500672,
       1.0204081648740573
      ],
      "p": 0.47625237476252374,
      "mid_p": 0.43075,
      "per_seed": {
       "42": -0.6036217303822937,
       "43": -1.6032064128256514,
       "44": 0.20080321285140562
      },
      "p_het": 0.6539346065393461,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "sparq_c8_s1_sxs"
      ],
      "row_arm": "jqs_f_u64",
      "source": "sxs",
      "replaces": [
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final N = 64 (sxs) vs SparQ c8 (sxs)",
      "mdd80": 2.4099030754410045,
      "se": 0.8439531928840626,
      "ci95_bootstrap": [
       -2.3333722481654435,
       1.0053787874701288
      ],
      "q": 0.9217787898629491,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.996220377962204,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.41)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 31,
      "mean_a": 90.74074074074075,
      "mean_b": 89.22558922558923,
      "delta": 1.5151515151515151,
      "ci95": [
       -1.628435289734566e-09,
       3.092783506760805
      ],
      "p": 0.0974902509749025,
      "mid_p": 0.0649,
      "per_seed": {
       "42": 3.0303030303030303,
       "43": 0.5050505050505051,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.210422392521721,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.21)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 98.54166666666667,
      "mean_b": 98.68055555555556,
      "delta": -0.1388888888888889,
      "ci95": [
       -1.041666667644759,
       0.8333333343125786
      ],
      "p": 0.8957104289571043,
      "mid_p": 0.79485,
      "per_seed": {
       "42": -1.25,
       "43": 0.20833333333333334,
       "44": 0.625
      },
      "p_het": null,
      "mdd80": 1.3400685754636923,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.34)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 153,
      "mean_a": 87.37151248164464,
      "mean_b": 87.59177679882525,
      "delta": -0.22026431718061673,
      "ci95": [
       -2.053712482219473,
       1.6081871363179054
      ],
      "p": 0.8748125187481252,
      "mid_p": 0.8143,
      "per_seed": {
       "42": 0.0,
       "43": -0.44052863436123346,
       "44": -0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.617171520096925,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.62)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 24,
      "b_only": 18,
      "mean_a": 74.53183520599251,
      "mean_b": 72.28464419475655,
      "rate_a": 74.53183520599252,
      "rate_b": 72.28464419475655,
      "delta": 2.247191011235955,
      "ci95": [
       -2.614379089204644,
       7.0175438652388245
      ],
      "p": 0.44285571442855715,
      "mid_p": 0.3638,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 6.741573033707865,
       "44": -4.49438202247191
      },
      "p_het": 0.15878412158784122,
      "mdd80": 6.883966538166853,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9153956399231872,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.88)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u128_sxs",
      "b": "sparq_c8_s1_sxs",
      "n_items": 1494,
      "n_clusters": 499,
      "n_diff_items": 154,
      "a_only": 75,
      "b_only": 79,
      "mean_a": 88.75502008032129,
      "mean_b": 89.0227576974565,
      "rate_a": 88.60000000000001,
      "rate_b": 88.66666666666667,
      "delta": -0.2677376171352075,
      "ci95": [
       -1.9178082208620872,
       1.3812154713147817
      ],
      "p": 0.8124187581241876,
      "mid_p": 0.752,
      "per_seed": {
       "42": -1.2072434607645874,
       "43": 0.40080160320641284,
       "44": 0.0
      },
      "p_het": 0.6970302969703029,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "sparq_c8_s1_sxs"
      ],
      "row_arm": "jqs_f_u128",
      "source": "sxs",
      "replaces": [
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "seed_tuple": [
       20261024,
       27,
       0,
       1
      ],
      "label_text": "final N = 128 (sxs) vs SparQ c8 (sxs)",
      "mdd80": 2.3578229199900647,
      "se": 0.8441689665453791,
      "ci95_bootstrap": [
       -1.9385026737967914,
       1.4056224899598393
      ],
      "q": 1.0,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.36)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 71,
      "mean_a": 83.5016835016835,
      "mean_b": 84.34343434343434,
      "delta": -0.8417508417508418,
      "ci95": [
       -3.9426523330467447,
       2.2471910146605723
      ],
      "p": 0.671032896710329,
      "mid_p": 0.59775,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": -0.5050505050505051,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.423901092611461,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.42)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 92.15277777777777,
      "mean_b": 92.29166666666667,
      "delta": -0.1388888888888889,
      "ci95": [
       -0.9615384624980391,
       0.6250000011618602
      ],
      "p": 0.8745125487451255,
      "mid_p": 0.7492,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": 1.6666666666666667,
       "44": -1.6666666666666667
      },
      "p_het": null,
      "mdd80": 1.1339041795710096,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.13)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 192,
      "mean_a": 80.1762114537445,
      "mean_b": 77.23935389133626,
      "delta": 2.9368575624082234,
      "ci95": [
       0.9222661378514434,
       4.943502826784628
      ],
      "p": 0.004999500049995001,
      "mid_p": 0.00395,
      "per_seed": {
       "42": 4.6255506607929515,
       "43": 1.3215859030837005,
       "44": 2.8634361233480177
      },
      "p_het": null,
      "mdd80": 2.8739908883816834,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.10908000109080002,
      "label_source": "above_nominal",
      "q": 0.09999000099990002,
      "label": "above_detected",
      "q_prev": 0.10908000109080002,
      "label_prev": "above_nominal",
      "q_published": 0.10908000109080002,
      "label_published": "above_nominal",
      "changed": true,
      "text": "above, detected (p 0.00500, q 0.100)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 50,
      "a_only": 27,
      "b_only": 23,
      "mean_a": 40.823970037453186,
      "mean_b": 39.325842696629216,
      "rate_a": 40.823970037453186,
      "rate_b": 39.325842696629216,
      "delta": 1.4981273408239701,
      "ci95": [
       -3.546099295558652,
       6.521739135289828
      ],
      "p": 0.656934306569343,
      "mid_p": 0.5568,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 1.1235955056179776,
       "44": 0.0
      },
      "p_het": 0.9088091190880911,
      "mdd80": 7.195516741302231,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.20)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 177,
      "a_only": 98,
      "b_only": 79,
      "mean_a": 70.53333333333333,
      "mean_b": 69.26666666666667,
      "rate_a": 70.53333333333333,
      "rate_b": 69.26666666666667,
      "delta": 1.2666666666666666,
      "ci95": [
       -0.41841004359767614,
       2.968960865418953
      ],
      "p": 0.17068293170682933,
      "mid_p": 0.14895,
      "per_seed": {
       "42": 3.2,
       "43": -0.8,
       "44": 1.4
      },
      "p_het": 0.1924807519248075,
      "mdd80": 2.420964962066358,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6851314868513149,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.42)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 69,
      "mean_a": 84.51178451178451,
      "mean_b": 84.34343434343434,
      "delta": 0.16835016835016836,
      "ci95": [
       -2.71317829788041,
       3.0927835081335058
      ],
      "p": 1.0,
      "mid_p": 0.91005,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": 0.0,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.149539711178466,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.15)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 19,
      "mean_a": 90.48611111111111,
      "mean_b": 92.29166666666667,
      "delta": -1.8055555555555556,
      "ci95": [
       -3.720238097298502,
       -0.148809522024288
      ],
      "p": 0.035896410358964105,
      "mid_p": 0.0238,
      "per_seed": {
       "42": -2.7083333333333335,
       "43": 0.0,
       "44": -2.7083333333333335
      },
      "p_het": null,
      "mdd80": 2.5525115723956873,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.426502804265028,
      "label_source": "below_nominal",
      "q": 0.40795920407959196,
      "label": "below_nominal",
      "q_prev": 0.426502804265028,
      "label_prev": "below_nominal",
      "q_published": 0.426502804265028,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0359, q 0.41)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 228,
      "mean_a": 75.33039647577093,
      "mean_b": 77.23935389133626,
      "delta": -1.908957415565345,
      "ci95": [
       -4.07569141408272,
       0.28368794537232855
      ],
      "p": 0.09509049095090491,
      "mid_p": 0.0822,
      "per_seed": {
       "42": -2.8634361233480177,
       "43": -2.643171806167401,
       "44": -0.22026431718061673
      },
      "p_het": null,
      "mdd80": 3.1156625504172517,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 49,
      "a_only": 24,
      "b_only": 25,
      "mean_a": 38.951310861423224,
      "mean_b": 39.325842696629216,
      "rate_a": 38.951310861423224,
      "rate_b": 39.325842696629216,
      "delta": -0.37453183520599254,
      "ci95": [
       -5.69105691633734,
       5.000000005974394
      ],
      "p": 1.0,
      "mid_p": 0.89215,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 1.1235955056179776,
       "44": 0.0
      },
      "p_het": 0.8942105789421058,
      "mdd80": 7.640933016068078,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.64)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 209,
      "a_only": 104,
      "b_only": 105,
      "mean_a": 69.2,
      "mean_b": 69.26666666666667,
      "rate_a": 69.2,
      "rate_b": 69.26666666666667,
      "delta": -0.06666666666666667,
      "ci95": [
       -2.0661157045421543,
       1.9455252937804548
      ],
      "p": 1.0,
      "mid_p": 0.94715,
      "per_seed": {
       "42": 0.2,
       "43": -1.6,
       "44": 1.2
      },
      "p_het": 0.4470552944705529,
      "mdd80": 2.8671328172170543,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.87)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 67,
      "mean_a": 82.82828282828282,
      "mean_b": 84.34343434343434,
      "delta": -1.5151515151515151,
      "ci95": [
       -4.301075271778311,
       1.3468013496648301
      ],
      "p": 0.35676432356764326,
      "mid_p": 0.30205,
      "per_seed": {
       "42": -2.525252525252525,
       "43": -0.5050505050505051,
       "44": -1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.036555717648586,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.04)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 91.11111111111111,
      "mean_b": 92.29166666666667,
      "delta": -1.1805555555555556,
      "ci95": [
       -2.5000000019953106,
       1.3690148439065123e-09
      ],
      "p": 0.0805919408059194,
      "mid_p": 0.05615,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": -1.25,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 1.78675810115753,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5526114055261141,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.79)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 212,
      "mean_a": 79.00146842878121,
      "mean_b": 77.23935389133626,
      "delta": 1.7621145374449338,
      "ci95": [
       -0.2949852528042898,
       3.809523811419767
      ],
      "p": 0.10868913108689131,
      "mid_p": 0.09415,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": 0.44052863436123346,
       "44": 3.303964757709251
      },
      "p_het": null,
      "mdd80": 2.933505924763031,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.93)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 30,
      "b_only": 21,
      "mean_a": 42.69662921348315,
      "mean_b": 39.325842696629216,
      "rate_a": 42.696629213483156,
      "rate_b": 39.325842696629216,
      "delta": 3.3707865168539324,
      "ci95": [
       -2.272727278417154,
       8.974358979132163
      ],
      "p": 0.29587041295870414,
      "mid_p": 0.2414,
      "per_seed": {
       "42": 10.112359550561798,
       "43": 0.0,
       "44": 0.0
      },
      "p_het": 0.1967803219678032,
      "mdd80": 8.038328983220085,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.7889877678898777,
      "label_source": "none",
      "q": 0.7803175726383406,
      "label": "none",
      "q_prev": 0.7889877678898777,
      "label_prev": "none",
      "q_published": 0.7889877678898777,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.04)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 178,
      "a_only": 86,
      "b_only": 92,
      "mean_a": 68.86666666666666,
      "mean_b": 69.26666666666667,
      "rate_a": 68.86666666666667,
      "rate_b": 69.26666666666667,
      "delta": -0.4,
      "ci95": [
       -2.099737534477584,
       1.3100436699874975
      ],
      "p": 0.7023297670232976,
      "mid_p": 0.64755,
      "per_seed": {
       "42": 2.4,
       "43": -3.2,
       "44": -0.4
      },
      "p_het": 0.04279572042795721,
      "mdd80": 2.4369816728215463,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.44)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 69,
      "mean_a": 82.82828282828282,
      "mean_b": 84.34343434343434,
      "delta": -1.5151515151515151,
      "ci95": [
       -4.513888891979601,
       1.449275365498481
      ],
      "p": 0.36746325367463256,
      "mid_p": 0.31645,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": -1.5151515151515151,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.261892812497439,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.8479921238645367,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.26)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 13,
      "mean_a": 91.25,
      "mean_b": 92.29166666666667,
      "delta": -1.0416666666666667,
      "ci95": [
       -3.2986111139395584,
       0.6944444466271573
      ],
      "p": 0.8088191180881912,
      "mid_p": 0.73615,
      "per_seed": {
       "42": -0.625,
       "43": 0.0,
       "44": -2.5
      },
      "p_het": null,
      "mdd80": 2.853849744645369,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.85)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 213,
      "mean_a": 77.01908957415566,
      "mean_b": 77.23935389133626,
      "delta": -0.22026431718061673,
      "ci95": [
       -2.4216524237805155,
       1.9696969719569477
      ],
      "p": 0.8946105389461054,
      "mid_p": 0.8441,
      "per_seed": {
       "42": 0.0,
       "43": 0.22026431718061673,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 3.138511638915265,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.14)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 49,
      "a_only": 30,
      "b_only": 19,
      "mean_a": 43.445692883895134,
      "mean_b": 39.325842696629216,
      "rate_a": 43.445692883895134,
      "rate_b": 39.325842696629216,
      "delta": 4.119850187265918,
      "ci95": [
       -0.8333333388403994,
       9.219858160854592
      ],
      "p": 0.14408559144085592,
      "mid_p": 0.1122,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 2.247191011235955,
       "44": 6.741573033707865
      },
      "p_het": 0.8173182681731826,
      "mdd80": 7.185048532158081,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.6650104220347196,
      "label_source": "none",
      "q": 0.6403804064038041,
      "label": "none",
      "q_prev": 0.6650104220347196,
      "label_prev": "none",
      "q_published": 0.6650104220347196,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.19)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 196,
      "a_only": 92,
      "b_only": 104,
      "mean_a": 68.46666666666667,
      "mean_b": 69.26666666666667,
      "rate_a": 68.46666666666667,
      "rate_b": 69.26666666666667,
      "delta": -0.8,
      "ci95": [
       -2.6722925476815185,
       1.066666668526631
      ],
      "p": 0.45265473452654736,
      "mid_p": 0.4128,
      "per_seed": {
       "42": 2.0,
       "43": -3.6,
       "44": -0.8
      },
      "p_het": 0.045495450454954504,
      "mdd80": 2.6722462641868856,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9206536973421303,
      "label_source": "none",
      "q": 0.9053094690530947,
      "label": "none",
      "q_prev": 0.9206536973421303,
      "label_prev": "none",
      "q_published": 0.9206536973421303,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.67)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 68,
      "mean_a": 83.33333333333333,
      "mean_b": 84.34343434343434,
      "delta": -1.0101010101010102,
      "ci95": [
       -3.5598705526115073,
       1.5576324011229228
      ],
      "p": 0.5229477052294771,
      "mid_p": 0.4466,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 1.0101010101010102,
       "44": -3.0303030303030303
      },
      "p_het": null,
      "mdd80": 3.6574959391910298,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9729259632176318,
      "label_source": "none",
      "q": 0.9508140095081402,
      "label": "none",
      "q_prev": 0.9729259632176318,
      "label_prev": "none",
      "q_published": 0.9729259632176318,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.66)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 91.25,
      "mean_b": 92.29166666666667,
      "delta": -1.0416666666666667,
      "ci95": [
       -2.256944445972537,
       1.2110193671598567e-09
      ],
      "p": 0.08089191080891911,
      "mid_p": 0.0485,
      "per_seed": {
       "42": -1.6666666666666667,
       "43": -0.20833333333333334,
       "44": -1.25
      },
      "p_het": null,
      "mdd80": 1.6130455077763648,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5526114055261141,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.61)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 217,
      "mean_a": 78.48751835535977,
      "mean_b": 77.23935389133626,
      "delta": 1.2481644640234948,
      "ci95": [
       -0.761035009693213,
       3.271028039520875
      ],
      "p": 0.26347365263473654,
      "mid_p": 0.2358,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": -0.44052863436123346,
       "44": 3.0837004405286343
      },
      "p_het": null,
      "mdd80": 2.8817285231464527,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.88)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 59,
      "a_only": 32,
      "b_only": 27,
      "mean_a": 41.19850187265918,
      "mean_b": 39.325842696629216,
      "rate_a": 41.19850187265917,
      "rate_b": 39.325842696629216,
      "delta": 1.8726591760299625,
      "ci95": [
       -3.623188411099851,
       7.4074074128626695
      ],
      "p": 0.5916408359164084,
      "mid_p": 0.5075,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 4.49438202247191,
       "44": -2.247191011235955
      },
      "p_het": 0.6119388061193881,
      "mdd80": 7.88360256901458,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.88)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 178,
      "a_only": 99,
      "b_only": 79,
      "mean_a": 70.6,
      "mean_b": 69.26666666666667,
      "rate_a": 70.6,
      "rate_b": 69.26666666666667,
      "delta": 1.3333333333333333,
      "ci95": [
       -0.4938271621851733,
       3.1358885033056763
      ],
      "p": 0.1705829417058294,
      "mid_p": 0.1499,
      "per_seed": {
       "42": 3.8,
       "43": -2.2,
       "44": 2.4
      },
      "p_het": 0.010998900109989001,
      "mdd80": 2.594169544594616,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6851314868513149,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.59)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 62,
      "mean_a": 84.34343434343434,
      "mean_b": 84.34343434343434,
      "delta": 0.0,
      "ci95": [
       -2.962962966219239,
       2.970297032614055
      ],
      "p": 1.0,
      "mid_p": 0.95555,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": 2.0202020202020203,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 4.240520141969126,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.24)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 91.59722222222223,
      "mean_b": 92.29166666666667,
      "delta": -0.6944444444444444,
      "ci95": [
       -2.0833333350784846,
       0.4629629649098219
      ],
      "p": 0.5753424657534246,
      "mid_p": 0.4996,
      "per_seed": {
       "42": -1.875,
       "43": 0.625,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.8198462143315983,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.82)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 203,
      "mean_a": 79.0748898678414,
      "mean_b": 77.23935389133626,
      "delta": 1.8355359765051396,
      "ci95": [
       -0.3016591273803852,
       3.9823008871062577
      ],
      "p": 0.10988901109889011,
      "mid_p": 0.09615,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": 1.5418502202643172,
       "44": 3.0837004405286343
      },
      "p_het": null,
      "mdd80": 3.0617601002472723,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.06)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 53,
      "a_only": 30,
      "b_only": 23,
      "mean_a": 41.947565543071164,
      "mean_b": 39.325842696629216,
      "rate_a": 41.947565543071164,
      "rate_b": 39.325842696629216,
      "delta": 2.6217228464419478,
      "ci95": [
       -3.0303030360091787,
       8.163265311152227
      ],
      "p": 0.43945605439456054,
      "mid_p": 0.3698,
      "per_seed": {
       "42": 8.98876404494382,
       "43": 1.1235955056179776,
       "44": -2.247191011235955
      },
      "p_het": 0.20527947205279473,
      "mdd80": 8.00007955929451,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9153956399231872,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.9153956399231872,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.00)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 178,
      "a_only": 84,
      "b_only": 94,
      "mean_a": 68.6,
      "mean_b": 69.26666666666667,
      "rate_a": 68.60000000000001,
      "rate_b": 69.26666666666667,
      "delta": -0.6666666666666666,
      "ci95": [
       -2.34375000163653,
       1.0256410272616971
      ],
      "p": 0.49695030496950304,
      "mid_p": 0.44965,
      "per_seed": {
       "42": -0.2,
       "43": -1.8,
       "44": 0.0
      },
      "p_het": 0.6892310768923108,
      "mdd80": 2.4081146834998925,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9496193237819075,
      "label_source": "none",
      "q": 0.927535153461398,
      "label": "none",
      "q_prev": 0.9496193237819075,
      "label_prev": "none",
      "q_published": 0.9496193237819075,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.41)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 53,
      "mean_a": 83.5016835016835,
      "mean_b": 82.996632996633,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.10526316061578,
       3.086419755451124
      ],
      "p": 0.8012198780121987,
      "mid_p": 0.7076,
      "per_seed": {
       "42": 0.0,
       "43": -0.5050505050505051,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 3.7105125985761274,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.71)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 17,
      "mean_a": 92.15277777777777,
      "mean_b": 91.11111111111111,
      "delta": 1.0416666666666667,
      "ci95": [
       -0.41666666886904685,
       2.564102565869092
      ],
      "p": 0.22857714228577142,
      "mid_p": 0.19265,
      "per_seed": {
       "42": 0.625,
       "43": 2.0833333333333335,
       "44": 0.4166666666666667
      },
      "p_het": null,
      "mdd80": 2.1303654282729036,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7237171019740132,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7237171019740132,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.13)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 196,
      "mean_a": 80.1762114537445,
      "mean_b": 77.67988252569751,
      "delta": 2.4963289280469896,
      "ci95": [
       0.5649717495573617,
       4.434907011901841
      ],
      "p": 0.0150984901509849,
      "mid_p": 0.0128,
      "per_seed": {
       "42": 4.405286343612334,
       "43": 3.0837004405286343,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 2.765855268657581,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.2264773522647735,
      "label_source": "above_nominal",
      "q": 0.213155155072728,
      "label": "above_nominal",
      "q_prev": 0.2264773522647735,
      "label_prev": "above_nominal",
      "q_published": 0.2264773522647735,
      "label_published": "above_nominal",
      "changed": false,
      "text": "above, nominal (p 0.0151, q 0.21)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 48,
      "a_only": 25,
      "b_only": 23,
      "mean_a": 40.823970037453186,
      "mean_b": 40.0749063670412,
      "rate_a": 40.823970037453186,
      "rate_b": 40.0749063670412,
      "delta": 0.7490636704119851,
      "ci95": [
       -5.0314465457242825,
       6.521739136019491
      ],
      "p": 0.9006099390060994,
      "mid_p": 0.80165,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": -1.1235955056179776,
       "44": 2.247191011235955
      },
      "p_het": 0.8901109889011098,
      "mdd80": 8.25709923330132,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.26)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 174,
      "a_only": 96,
      "b_only": 78,
      "mean_a": 70.53333333333333,
      "mean_b": 69.33333333333333,
      "rate_a": 70.53333333333333,
      "rate_b": 69.33333333333333,
      "delta": 1.2,
      "ci95": [
       -0.6561679808275482,
       3.0418250968038416
      ],
      "p": 0.22877712228777122,
      "mid_p": 0.20325,
      "per_seed": {
       "42": 1.0,
       "43": 1.4,
       "44": 1.2
      },
      "p_het": 0.9953004699530047,
      "mdd80": 2.6429676322362194,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7237171019740132,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7237171019740132,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.64)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 63,
      "mean_a": 84.51178451178451,
      "mean_b": 82.996632996633,
      "delta": 1.5151515151515151,
      "ci95": [
       -0.8032128541643682,
       3.8759689949675513
      ],
      "p": 0.2642735726427357,
      "mid_p": 0.21185,
      "per_seed": {
       "42": 3.0303030303030303,
       "43": 0.0,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 3.3442264257898646,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.34)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 90.48611111111111,
      "mean_b": 91.11111111111111,
      "delta": -0.625,
      "ci95": [
       -1.8939393956814699,
       0.5208333347785407
      ],
      "p": 0.48655134486551344,
      "mid_p": 0.41475,
      "per_seed": {
       "42": -1.6666666666666667,
       "43": 0.4166666666666667,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 1.725845893118962,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9417122803848648,
      "label_source": "none",
      "q": 0.9267644664105018,
      "label": "none",
      "q_prev": 0.9417122803848648,
      "label_prev": "none",
      "q_published": 0.9417122803848648,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.73)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 206,
      "mean_a": 75.33039647577093,
      "mean_b": 77.67988252569751,
      "delta": -2.3494860499265786,
      "ci95": [
       -4.4843049349041735,
       -0.15503875738114067
      ],
      "p": 0.0390960903909609,
      "mid_p": 0.03395,
      "per_seed": {
       "42": -3.0837004405286343,
       "43": -0.8810572687224669,
       "44": -3.0837004405286343
      },
      "p_het": null,
      "mdd80": 3.094140561738751,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.426502804265028,
      "label_source": "below_nominal",
      "q": 0.40795920407959196,
      "label": "below_nominal",
      "q_prev": 0.426502804265028,
      "label_prev": "below_nominal",
      "q_published": 0.426502804265028,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0391, q 0.41)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 24,
      "b_only": 27,
      "mean_a": 38.951310861423224,
      "mean_b": 40.0749063670412,
      "rate_a": 38.951310861423224,
      "rate_b": 40.0749063670412,
      "delta": -1.1235955056179776,
      "ci95": [
       -6.250000004752894,
       4.000000004545958
      ],
      "p": 0.7785221477852214,
      "mid_p": 0.67425,
      "per_seed": {
       "42": -4.49438202247191,
       "43": -1.1235955056179776,
       "44": 2.247191011235955
      },
      "p_het": 0.6233376662333766,
      "mdd80": 7.325708211533366,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.33)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 198,
      "a_only": 98,
      "b_only": 100,
      "mean_a": 69.2,
      "mean_b": 69.33333333333333,
      "rate_a": 69.2,
      "rate_b": 69.33333333333333,
      "delta": -0.13333333333333333,
      "ci95": [
       -2.1008403381986245,
       1.8229166685731042
      ],
      "p": 0.9483051694830517,
      "mid_p": 0.9,
      "per_seed": {
       "42": -2.0,
       "43": 0.6,
       "44": 1.0
      },
      "p_het": 0.33036696330366966,
      "mdd80": 2.8043218437553423,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.80)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 55,
      "mean_a": 82.82828282828282,
      "mean_b": 82.996632996633,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.749140896100453,
       2.4561403536034336
      ],
      "p": 1.0,
      "mid_p": 0.90155,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -0.5050505050505051,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 3.720231371678297,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.72)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 22,
      "mean_a": 91.11111111111111,
      "mean_b": 91.11111111111111,
      "delta": 0.0,
      "ci95": [
       -1.1111111122321273,
       1.1217948730996272
      ],
      "p": 1.0,
      "mid_p": 0.9531,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": -0.8333333333333334,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 1.5958651412182558,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.60)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 206,
      "mean_a": 79.00146842878121,
      "mean_b": 77.67988252569751,
      "delta": 1.3215859030837005,
      "ci95": [
       -0.6172839526531577,
       3.286384978618167
      ],
      "p": 0.2141785821417858,
      "mid_p": 0.1891,
      "per_seed": {
       "42": 1.3215859030837005,
       "43": 2.202643171806167,
       "44": 0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.7899648311198586,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7235943072359431,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7235943072359431,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.79)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 53,
      "a_only": 30,
      "b_only": 23,
      "mean_a": 42.69662921348315,
      "mean_b": 40.0749063670412,
      "rate_a": 42.696629213483156,
      "rate_b": 40.0749063670412,
      "delta": 2.6217228464419478,
      "ci95": [
       -3.1746031807470785,
       8.496732031252286
      ],
      "p": 0.4450554944505549,
      "mid_p": 0.3777,
      "per_seed": {
       "42": 7.865168539325842,
       "43": -2.247191011235955,
       "44": 2.247191011235955
      },
      "p_het": 0.3067693230676932,
      "mdd80": 8.341541085320538,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9153956399231872,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.9153956399231872,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.34)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 183,
      "a_only": 88,
      "b_only": 95,
      "mean_a": 68.86666666666666,
      "mean_b": 69.33333333333333,
      "rate_a": 68.86666666666667,
      "rate_b": 69.33333333333333,
      "delta": -0.4666666666666667,
      "ci95": [
       -2.2757697474601803,
       1.366120220453916
      ],
      "p": 0.6623337666233376,
      "mid_p": 0.61135,
      "per_seed": {
       "42": 0.2,
       "43": -1.0,
       "44": -0.6
      },
      "p_het": 0.8698130186981302,
      "mdd80": 2.602870557975178,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.60)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 61,
      "mean_a": 82.82828282828282,
      "mean_b": 82.996632996633,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.8673835154088376,
       2.50896057632836
      ],
      "p": 1.0,
      "mid_p": 0.9009,
      "per_seed": {
       "42": 0.0,
       "43": -1.5151515151515151,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 3.8424905390377884,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.84)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 14,
      "mean_a": 91.25,
      "mean_b": 91.11111111111111,
      "delta": 0.1388888888888889,
      "ci95": [
       -1.1111111123697872,
       1.3480392167588062
      ],
      "p": 0.9052094790520948,
      "mid_p": 0.8289,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": 0.4166666666666667,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 1.757562706648683,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.76)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 195,
      "mean_a": 77.01908957415566,
      "mean_b": 77.67988252569751,
      "delta": -0.6607929515418502,
      "ci95": [
       -2.714932128799928,
       1.3953488393726086
      ],
      "p": 0.5803419658034197,
      "mid_p": 0.5337,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": 1.9823788546255507,
       "44": -3.7444933920704844
      },
      "p_het": null,
      "mdd80": 2.9376311232131,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.94)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 57,
      "a_only": 33,
      "b_only": 24,
      "mean_a": 43.445692883895134,
      "mean_b": 40.0749063670412,
      "rate_a": 43.445692883895134,
      "rate_b": 40.0749063670412,
      "delta": 3.3707865168539324,
      "ci95": [
       -2.9629629692224926,
       9.722222228092104
      ],
      "p": 0.35176482351764826,
      "mid_p": 0.2977,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 0.0,
       "44": 8.98876404494382
      },
      "p_het": 0.36206379362063795,
      "mdd80": 9.066142954193591,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.845562502573272,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 9.07)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 201,
      "a_only": 94,
      "b_only": 107,
      "mean_a": 68.46666666666667,
      "mean_b": 69.33333333333333,
      "rate_a": 68.46666666666667,
      "rate_b": 69.33333333333333,
      "delta": -0.8666666666666667,
      "ci95": [
       -2.745098041052989,
       1.0256410274578385
      ],
      "p": 0.41255874412558746,
      "mid_p": 0.37375,
      "per_seed": {
       "42": -0.2,
       "43": -1.4,
       "44": -1.0
      },
      "p_het": 0.8749125087491251,
      "mdd80": 2.6949594275784796,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.8920189062174864,
      "label_source": "none",
      "q": 0.8920189062174864,
      "label": "none",
      "q_prev": 0.9001281690012817,
      "label_prev": "none",
      "q_published": 0.8920189062174864,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.69)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 64,
      "mean_a": 83.33333333333333,
      "mean_b": 82.996632996633,
      "delta": 0.3367003367003367,
      "ci95": [
       -2.173913046175784,
       2.8301886815686004
      ],
      "p": 0.8993100689931007,
      "mid_p": 0.7965,
      "per_seed": {
       "42": 2.525252525252525,
       "43": 1.0101010101010102,
       "44": -2.525252525252525
      },
      "p_het": null,
      "mdd80": 3.576447715612535,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.58)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 91.25,
      "mean_b": 91.11111111111111,
      "delta": 0.1388888888888889,
      "ci95": [
       -0.9803921578594451,
       1.2254901970437735
      ],
      "p": 0.9119088091190881,
      "mid_p": 0.8269,
      "per_seed": {
       "42": -0.625,
       "43": 0.20833333333333334,
       "44": 0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.5765512650078977,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.58)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 195,
      "mean_a": 78.48751835535977,
      "mean_b": 77.67988252569751,
      "delta": 0.8076358296622613,
      "ci95": [
       -1.1958146507641012,
       2.816901410585405
      ],
      "p": 0.46915308469153083,
      "mid_p": 0.42835,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": 1.3215859030837005,
       "44": 0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.8679011682450453,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9335264820625375,
      "label_source": "none",
      "q": 0.9217787898629491,
      "label": "none",
      "q_prev": 0.9335264820625375,
      "label_prev": "none",
      "q_published": 0.9335264820625375,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.87)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 27,
      "b_only": 24,
      "mean_a": 41.19850187265918,
      "mean_b": 40.0749063670412,
      "rate_a": 41.19850187265917,
      "rate_b": 40.0749063670412,
      "delta": 1.1235955056179776,
      "ci95": [
       -4.761904767229928,
       6.976744192094854
      ],
      "p": 0.7969203079692031,
      "mid_p": 0.7048,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 2.247191011235955,
       "44": 0.0
      },
      "p_het": 0.9818018198180182,
      "mdd80": 8.389650438596979,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.39)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 175,
      "a_only": 97,
      "b_only": 78,
      "mean_a": 70.6,
      "mean_b": 69.33333333333333,
      "rate_a": 70.6,
      "rate_b": 69.33333333333333,
      "delta": 1.2666666666666666,
      "ci95": [
       -0.582241632291861,
       3.129251702579465
      ],
      "p": 0.19838016198380162,
      "mid_p": 0.1758,
      "per_seed": {
       "42": 1.6,
       "43": 0.0,
       "44": 2.2
      },
      "p_het": 0.5458454154584541,
      "mdd80": 2.6526163098197015,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7177789683718195,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7177789683718195,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.65)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 62,
      "mean_a": 84.34343434343434,
      "mean_b": 82.996632996633,
      "delta": 1.3468013468013469,
      "ci95": [
       -1.360544220421718,
       4.029304032221876
      ],
      "p": 0.400959904009599,
      "mid_p": 0.3387,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": 2.0202020202020203,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 3.852142006584336,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.874821608748216,
      "label_source": "none",
      "q": 0.882847495067007,
      "label": "none",
      "q_prev": 0.8910220089102201,
      "label_prev": "none",
      "q_published": 0.874821608748216,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.85)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 20,
      "mean_a": 91.59722222222223,
      "mean_b": 91.11111111111111,
      "delta": 0.4861111111111111,
      "ci95": [
       -0.7440476203725638,
       1.704545456217751
      ],
      "p": 0.5061493850614939,
      "mid_p": 0.4393,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": 1.0416666666666667,
       "44": 1.25
      },
      "p_het": null,
      "mdd80": 1.7500174040593428,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9520297970202979,
      "label_source": "none",
      "q": 0.93022758792823,
      "label": "none",
      "q_prev": 0.9520297970202979,
      "label_prev": "none",
      "q_published": 0.9520297970202979,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.75)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 191,
      "mean_a": 79.0748898678414,
      "mean_b": 77.67988252569751,
      "delta": 1.395007342143906,
      "ci95": [
       -0.7309941541602227,
       3.531073448373727
      ],
      "p": 0.21707829217078292,
      "mid_p": 0.1944,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": 3.303964757709251,
       "44": 0.22026431718061673
      },
      "p_het": null,
      "mdd80": 3.0461135225041875,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7235943072359431,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7235943072359431,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.05)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 49,
      "a_only": 27,
      "b_only": 22,
      "mean_a": 41.947565543071164,
      "mean_b": 40.0749063670412,
      "rate_a": 41.947565543071164,
      "rate_b": 40.0749063670412,
      "delta": 1.8726591760299625,
      "ci95": [
       -3.9682539744207608,
       7.619047626336822
      ],
      "p": 0.6046395360463953,
      "mid_p": 0.52245,
      "per_seed": {
       "42": 6.741573033707865,
       "43": -1.1235955056179776,
       "44": 0.0
      },
      "p_het": 0.412958704129587,
      "mdd80": 8.28148199113905,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.996220377962204,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.28)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 185,
      "a_only": 87,
      "b_only": 98,
      "mean_a": 68.6,
      "mean_b": 69.33333333333333,
      "rate_a": 68.60000000000001,
      "rate_b": 69.33333333333333,
      "delta": -0.7333333333333333,
      "ci95": [
       -2.5132275149855756,
       1.0582010599773466
      ],
      "p": 0.47065293470652936,
      "mid_p": 0.42855,
      "per_seed": {
       "42": -2.4,
       "43": 0.4,
       "44": -0.2
      },
      "p_het": 0.4266573342665733,
      "mdd80": 2.5525115721732057,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9335264820625375,
      "label_source": "none",
      "q": 0.9217787898629491,
      "label": "none",
      "q_prev": 0.9335264820625375,
      "label_prev": "none",
      "q_published": 0.9335264820625375,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.55)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 86,
      "mean_a": 72.39057239057239,
      "mean_b": 73.4006734006734,
      "delta": -1.0101010101010102,
      "ci95": [
       -4.166666670217215,
       2.1505376377689034
      ],
      "p": 0.5968403159684031,
      "mid_p": 0.52695,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": -3.0303030303030303,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.514926383508706,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.51)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 39,
      "mean_a": 87.91666666666667,
      "mean_b": 88.40277777777777,
      "delta": -0.4861111111111111,
      "ci95": [
       -2.2058823544621156,
       1.2152777799116719
      ],
      "p": 0.6205379462053795,
      "mid_p": 0.567,
      "per_seed": {
       "42": -1.6666666666666667,
       "43": 0.20833333333333334,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 2.4451142308893554,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.996220377962204,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.996220377962204,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.45)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 142,
      "mean_a": 68.79588839941263,
      "mean_b": 68.64904552129222,
      "delta": 0.14684287812041116,
      "ci95": [
       -1.5151515168660104,
       1.8284106907770863
      ],
      "p": 0.9308069193080692,
      "mid_p": 0.86595,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": 1.3215859030837005,
       "44": -0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.389654741276353,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.39)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 12,
      "a_only": 7,
      "b_only": 5,
      "mean_a": 4.49438202247191,
      "mean_b": 3.745318352059925,
      "rate_a": 4.49438202247191,
      "rate_b": 3.745318352059925,
      "delta": 0.7490636704119851,
      "ci95": [
       -1.587301589772086,
       3.100775196234771
      ],
      "p": 0.7597240275972402,
      "mid_p": 0.56145,
      "per_seed": {
       "42": -4.49438202247191,
       "43": 2.247191011235955,
       "44": 4.49438202247191
      },
      "p_het": 0.013998600139986002,
      "mdd80": 3.350583665989541,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.35)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 279,
      "a_only": 140,
      "b_only": 139,
      "mean_a": 20.6,
      "mean_b": 20.533333333333335,
      "rate_a": 20.599999999999998,
      "rate_b": 20.53333333333333,
      "delta": 0.06666666666666667,
      "ci95": [
       -2.159244266758729,
       2.29007633799076
      ],
      "p": 1.0,
      "mid_p": 0.9524,
      "per_seed": {
       "42": 2.8,
       "43": -0.4,
       "44": -2.2
      },
      "p_het": 0.17368263173682633,
      "mdd80": 3.1799438497939616,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.18)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 83,
      "mean_a": 71.88552188552188,
      "mean_b": 73.4006734006734,
      "delta": -1.5151515151515151,
      "ci95": [
       -4.301075271772835,
       1.2698412724618775
      ],
      "p": 0.34236576342365765,
      "mid_p": 0.289,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": -2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 3.981552101155459,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.98)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 86.94444444444444,
      "mean_b": 88.40277777777777,
      "delta": -1.4583333333333333,
      "ci95": [
       -2.916666668134991,
       -0.09920634822823213
      ],
      "p": 0.04989501049895011,
      "mid_p": 0.03835,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -1.25,
       "44": -2.7083333333333335
      },
      "p_het": null,
      "mdd80": 2.0136480178034883,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.4989501049895011,
      "label_source": "below_nominal",
      "q": 0.47395260473952605,
      "label": "below_nominal",
      "q_prev": 0.4989501049895011,
      "label_prev": "below_nominal",
      "q_published": 0.4989501049895011,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0499, q 0.47)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 149,
      "mean_a": 67.40088105726872,
      "mean_b": 68.64904552129222,
      "delta": -1.2481644640234948,
      "ci95": [
       -2.9051987784804183,
       0.4310344843994938
      ],
      "p": 0.15878412158784122,
      "mid_p": 0.136,
      "per_seed": {
       "42": -1.5418502202643172,
       "43": -0.22026431718061673,
       "44": -1.9823788546255507
      },
      "p_het": null,
      "mdd80": 2.3844167207119793,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.705707207057072,
      "label_source": "none",
      "q": 0.6805033782336052,
      "label": "none",
      "q_prev": 0.705707207057072,
      "label_prev": "none",
      "q_published": 0.705707207057072,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.38)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 8,
      "b_only": 8,
      "mean_a": 3.745318352059925,
      "mean_b": 3.745318352059925,
      "rate_a": 3.7453183520599254,
      "rate_b": 3.745318352059925,
      "delta": 0.0,
      "ci95": [
       -2.5000000027818503,
       2.5000000027818503
      ],
      "p": 1.0,
      "mid_p": 0.8878,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 0.0,
       "44": 3.3707865168539324
      },
      "p_het": 0.2460753924607539,
      "mdd80": 3.5735162014824664,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.57)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 288,
      "a_only": 129,
      "b_only": 159,
      "mean_a": 18.533333333333335,
      "mean_b": 20.533333333333335,
      "rate_a": 18.53333333333333,
      "rate_b": 20.53333333333333,
      "delta": -2.0,
      "ci95": [
       -4.30107527113555,
       0.27548209601478113
      ],
      "p": 0.10118988101189881,
      "mid_p": 0.09105,
      "per_seed": {
       "42": -1.4,
       "43": -4.6,
       "44": 0.0
      },
      "p_het": 0.23367663233676633,
      "mdd80": 3.2708803760654903,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.27)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 76,
      "mean_a": 73.4006734006734,
      "mean_b": 73.4006734006734,
      "delta": 0.0,
      "ci95": [
       -2.74509804240636,
       2.7491408962677415
      ],
      "p": 1.0,
      "mid_p": 0.9521,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": 2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 3.9267503680640936,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.93)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 87.22222222222223,
      "mean_b": 88.40277777777777,
      "delta": -1.1805555555555556,
      "ci95": [
       -3.00925926078654,
       0.6944444467948176
      ],
      "p": 0.22917708229177083,
      "mid_p": 0.203,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": -2.7083333333333335,
       "44": -1.25
      },
      "p_het": null,
      "mdd80": 2.6470490379610547,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7237171019740132,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7237171019740132,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.65)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 148,
      "mean_a": 67.91483113069016,
      "mean_b": 68.64904552129222,
      "delta": -0.7342143906020558,
      "ci95": [
       -2.480620156881912,
       1.0279001486054322
      ],
      "p": 0.44625537446255376,
      "mid_p": 0.4014,
      "per_seed": {
       "42": -3.303964757709251,
       "43": 2.8634361233480177,
       "44": -1.7621145374449338
      },
      "p_het": null,
      "mdd80": 2.5075508281875947,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9153956399231872,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.9153956399231872,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.51)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 15,
      "a_only": 9,
      "b_only": 6,
      "mean_a": 4.868913857677903,
      "mean_b": 3.745318352059925,
      "rate_a": 4.868913857677903,
      "rate_b": 3.745318352059925,
      "delta": 1.1235955056179776,
      "ci95": [
       -1.7094017126268168,
       3.968253971270899
      ],
      "p": 0.6160383961603839,
      "mid_p": 0.46775,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 2.247191011235955,
       "44": 2.247191011235955
      },
      "p_het": 0.6991300869913009,
      "mdd80": 4.05783891005418,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.996220377962204,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.06)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 270,
      "a_only": 143,
      "b_only": 127,
      "mean_a": 21.6,
      "mean_b": 20.533333333333335,
      "rate_a": 21.599999999999998,
      "rate_b": 20.53333333333333,
      "delta": 1.0666666666666667,
      "ci95": [
       -1.0709504706829984,
       3.20512820717525
      ],
      "p": 0.35596440355964404,
      "mid_p": 0.32565,
      "per_seed": {
       "42": 1.8,
       "43": 0.4,
       "44": 1.0
      },
      "p_het": 0.873012698730127,
      "mdd80": 3.05612728342736,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.06)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 71.88552188552188,
      "mean_b": 73.4006734006734,
      "delta": -1.5151515151515151,
      "ci95": [
       -4.347826089996755,
       1.3468013496584705
      ],
      "p": 0.35176482351764826,
      "mid_p": 0.29695,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": -5.05050505050505,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 4.069968678874096,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.07)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 86.80555555555556,
      "mean_b": 88.40277777777777,
      "delta": -1.5972222222222223,
      "ci95": [
       -3.5984848512226835,
       0.13888889062821425
      ],
      "p": 0.11438856114388561,
      "mid_p": 0.0871,
      "per_seed": {
       "42": 1.0416666666666667,
       "43": -3.75,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 2.6711131205276115,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.571236993947664,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.67)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 153,
      "mean_a": 68.4287812041116,
      "mean_b": 68.64904552129222,
      "delta": -0.22026431718061673,
      "ci95": [
       -2.0512820528745324,
       1.6081871363208866
      ],
      "p": 0.8787121287871212,
      "mid_p": 0.81685,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": 1.1013215859030836,
       "44": -1.9823788546255507
      },
      "p_het": null,
      "mdd80": 2.615434484372848,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.62)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 10,
      "b_only": 6,
      "mean_a": 5.2434456928838955,
      "mean_b": 3.745318352059925,
      "rate_a": 5.2434456928838955,
      "rate_b": 3.745318352059925,
      "delta": 1.4981273408239701,
      "ci95": [
       -0.8771929852344882,
       4.065040653189012
      ],
      "p": 0.39776022397760225,
      "mid_p": 0.2726,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 5.617977528089888,
       "44": 2.247191011235955
      },
      "p_het": 0.08159184081591841,
      "mdd80": 3.532230391753149,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.8910220089102201,
      "label_source": "none",
      "q": 0.882847495067007,
      "label": "none",
      "q_prev": 0.8910220089102201,
      "label_prev": "none",
      "q_published": 0.874821608748216,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.53)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 263,
      "a_only": 120,
      "b_only": 143,
      "mean_a": 19.0,
      "mean_b": 20.533333333333335,
      "rate_a": 19.0,
      "rate_b": 20.53333333333333,
      "delta": -1.5333333333333334,
      "ci95": [
       -3.703703705853739,
       0.6535947733845008
      ],
      "p": 0.1785821417858214,
      "mid_p": 0.16015,
      "per_seed": {
       "42": -1.2,
       "43": -3.2,
       "44": -0.2
      },
      "p_het": 0.5090490950904909,
      "mdd80": 3.114175338585284,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6867005607131595,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.11)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 76,
      "mean_a": 72.72727272727273,
      "mean_b": 73.4006734006734,
      "delta": -0.6734006734006734,
      "ci95": [
       -4.0650406544995725,
       2.6936026969628246
      ],
      "p": 0.7717228277172283,
      "mid_p": 0.7004,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -3.5353535353535355,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.8304242979235195,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.83)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 86.94444444444444,
      "mean_b": 88.40277777777777,
      "delta": -1.4583333333333333,
      "ci95": [
       -3.2986111134242524,
       0.1602564121285019
      ],
      "p": 0.12398760123987601,
      "mid_p": 0.0956,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": -1.875,
       "44": -2.2916666666666665
      },
      "p_het": null,
      "mdd80": 2.4720638255181027,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5722504672609662,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.47)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 143,
      "mean_a": 68.28193832599119,
      "mean_b": 68.64904552129222,
      "delta": -0.3671071953010279,
      "ci95": [
       -2.0558002953691723,
       1.3274336300146108
      ],
      "p": 0.7351264873512648,
      "mid_p": 0.6703,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": 2.4229074889867843,
       "44": -3.0837004405286343
      },
      "p_het": null,
      "mdd80": 2.4180082464621995,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.42)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 10,
      "b_only": 6,
      "mean_a": 5.2434456928838955,
      "mean_b": 3.745318352059925,
      "rate_a": 5.2434456928838955,
      "rate_b": 3.745318352059925,
      "delta": 1.4981273408239701,
      "ci95": [
       -0.8547008573830355,
       4.065040653195187
      ],
      "p": 0.39986001399860016,
      "mid_p": 0.2729,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 3.3707865168539324,
       "44": 3.3707865168539324
      },
      "p_het": 0.30446955304469553,
      "mdd80": 3.5161551951188525,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.8910220089102201,
      "label_source": "none",
      "q": 0.882847495067007,
      "label": "none",
      "q_prev": 0.8910220089102201,
      "label_prev": "none",
      "q_published": 0.874821608748216,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.52)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 253,
      "a_only": 128,
      "b_only": 125,
      "mean_a": 20.733333333333334,
      "mean_b": 20.533333333333335,
      "rate_a": 20.733333333333334,
      "rate_b": 20.53333333333333,
      "delta": 0.2,
      "ci95": [
       -1.8055555576396602,
       2.1879021898131024
      ],
      "p": 0.8984101589841016,
      "mid_p": 0.85095,
      "per_seed": {
       "42": 2.4,
       "43": -1.4,
       "44": -0.4
      },
      "p_het": 0.34126587341265874,
      "mdd80": 2.8541371889157117,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.85)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 76,
      "mean_a": 73.06397306397307,
      "mean_b": 73.4006734006734,
      "delta": -0.3367003367003367,
      "ci95": [
       -3.267973859052731,
       2.5889967665645206
      ],
      "p": 0.9066093390660934,
      "mid_p": 0.8204,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": -0.5050505050505051,
       "44": 3.0303030303030303
      },
      "p_het": null,
      "mdd80": 4.185995879792103,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.19)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 87.5,
      "mean_b": 88.40277777777777,
      "delta": -0.9027777777777778,
      "ci95": [
       -2.6388888906290164,
       0.7440476208189916
      ],
      "p": 0.35936406359364065,
      "mid_p": 0.3201,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -0.20833333333333334,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 2.4177956837588277,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.845562502573272,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.42)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 144,
      "mean_a": 68.94273127753304,
      "mean_b": 68.64904552129222,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.377410469885388,
       1.977401131560928
      ],
      "p": 0.7967203279672033,
      "mid_p": 0.7309,
      "per_seed": {
       "42": 1.9823788546255507,
       "43": 0.0,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.3976947194699383,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 15,
      "a_only": 9,
      "b_only": 6,
      "mean_a": 4.868913857677903,
      "mean_b": 3.745318352059925,
      "rate_a": 4.868913857677903,
      "rate_b": 3.745318352059925,
      "delta": 1.1235955056179776,
      "ci95": [
       -1.5503875996674594,
       3.787878790565344
      ],
      "p": 0.5877412258774123,
      "mid_p": 0.4338,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 1.1235955056179776,
       "44": 5.617977528089888
      },
      "p_het": 0.050994900509949,
      "mdd80": 3.815276282419838,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.82)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 266,
      "a_only": 138,
      "b_only": 128,
      "mean_a": 21.2,
      "mean_b": 20.533333333333335,
      "rate_a": 21.2,
      "rate_b": 20.53333333333333,
      "delta": 0.6666666666666666,
      "ci95": [
       -1.4608233752909343,
       2.8129395240561434
      ],
      "p": 0.5718428157184282,
      "mid_p": 0.53255,
      "per_seed": {
       "42": 2.8,
       "43": -0.2,
       "44": -0.6
      },
      "p_het": 0.38296170382961703,
      "mdd80": 3.0544721890234587,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.05)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 85,
      "mean_a": 72.39057239057239,
      "mean_b": 71.21212121212122,
      "delta": 1.1784511784511784,
      "ci95": [
       -2.1052631613032027,
       4.487179490326151
      ],
      "p": 0.5429457054294571,
      "mid_p": 0.4803,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 1.5151515151515151,
       "44": 3.0303030303030303
      },
      "p_het": null,
      "mdd80": 4.711640119345474,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.71)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 34,
      "mean_a": 87.91666666666667,
      "mean_b": 87.15277777777777,
      "delta": 0.7638888888888888,
      "ci95": [
       -1.3480392175538334,
       2.9947916687655254
      ],
      "p": 0.6106389361063893,
      "mid_p": 0.57485,
      "per_seed": {
       "42": -1.4583333333333333,
       "43": 1.875,
       "44": 1.875
      },
      "p_het": null,
      "mdd80": 3.1038353030583754,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.996220377962204,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.996220377962204,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.10)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 160,
      "mean_a": 68.79588839941263,
      "mean_b": 68.64904552129222,
      "delta": 0.14684287812041116,
      "ci95": [
       -1.6442451438201255,
       1.9345238113330043
      ],
      "p": 0.9339066093390661,
      "mid_p": 0.8718,
      "per_seed": {
       "42": 0.0,
       "43": -0.22026431718061673,
       "44": 0.6607929515418502
      },
      "p_het": null,
      "mdd80": 2.557757765674318,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.56)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 11,
      "a_only": 8,
      "b_only": 3,
      "mean_a": 4.49438202247191,
      "mean_b": 2.6217228464419478,
      "rate_a": 4.49438202247191,
      "rate_b": 2.6217228464419478,
      "delta": 1.8726591760299625,
      "ci95": [
       -1.8536704823045748e-09,
       3.4722222237069107
      ],
      "p": 0.06319368063193681,
      "mid_p": 0.03155,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 1.1235955056179776,
       "44": 2.247191011235955
      },
      "p_het": 1.0,
      "mdd80": 2.4816084728762635,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5229821845401667,
      "label_source": "none",
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.5229821845401667,
      "label_prev": "none",
      "q_published": 0.5229821845401667,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.48)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 265,
      "a_only": 154,
      "b_only": 111,
      "mean_a": 20.6,
      "mean_b": 17.733333333333334,
      "rate_a": 20.599999999999998,
      "rate_b": 17.733333333333334,
      "delta": 2.8666666666666667,
      "ci95": [
       0.80971659711279,
       4.927536234117292
      ],
      "p": 0.007799220077992201,
      "mid_p": 0.0065,
      "per_seed": {
       "42": 5.0,
       "43": 3.4,
       "44": 0.2
      },
      "p_het": 0.19928007199280073,
      "mdd80": 2.9430190342488314,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.143985601439856,
      "label_source": "above_nominal",
      "q": 0.12478752124787522,
      "label": "above_nominal",
      "q_prev": 0.143985601439856,
      "label_prev": "above_nominal",
      "q_published": 0.143985601439856,
      "label_published": "above_nominal",
      "changed": false,
      "text": "above, nominal (p 0.00780, q 0.125)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 94,
      "mean_a": 71.88552188552188,
      "mean_b": 71.21212121212122,
      "delta": 0.6734006734006734,
      "ci95": [
       -2.6819923409836584,
       4.049844239877466
      ],
      "p": 0.7762223777622238,
      "mid_p": 0.70085,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": 2.0202020202020203,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.811265412134223,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.81)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 86.94444444444444,
      "mean_b": 87.15277777777777,
      "delta": -0.20833333333333334,
      "ci95": [
       -3.1250000031350256,
       2.4038461568631755
      ],
      "p": 0.9528047195280472,
      "mid_p": 0.9255,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": 0.4166666666666667,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 3.951484261254563,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.95)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 161,
      "mean_a": 67.40088105726872,
      "mean_b": 68.64904552129222,
      "delta": -1.2481644640234948,
      "ci95": [
       -3.003003004796762,
       0.46728972144204317
      ],
      "p": 0.19138086191380863,
      "mid_p": 0.1656,
      "per_seed": {
       "42": -0.8810572687224669,
       "43": -1.7621145374449338,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.4802294534603746,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7166052625506681,
      "label_source": "none",
      "q": 0.6959304069593042,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7166052625506681,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.48)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 13,
      "a_only": 8,
      "b_only": 5,
      "mean_a": 3.745318352059925,
      "mean_b": 2.6217228464419478,
      "rate_a": 3.7453183520599254,
      "rate_b": 2.6217228464419478,
      "delta": 1.1235955056179776,
      "ci95": [
       -1.4184397187206779,
       3.5460992930753634
      ],
      "p": 0.5614438556144385,
      "mid_p": 0.3954,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": -1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.48905109489051096,
      "mdd80": 3.548172114360788,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9896228920154344,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.55)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 254,
      "a_only": 133,
      "b_only": 121,
      "mean_a": 18.533333333333335,
      "mean_b": 17.733333333333334,
      "rate_a": 18.53333333333333,
      "rate_b": 17.733333333333334,
      "delta": 0.8,
      "ci95": [
       -1.4048531310982257,
       2.9962546837023365
      ],
      "p": 0.5077492250774922,
      "mid_p": 0.4726,
      "per_seed": {
       "42": 0.8,
       "43": -0.8,
       "44": 2.4
      },
      "p_het": 0.44195580441955806,
      "mdd80": 3.1454860126320723,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9520297970202979,
      "label_source": "none",
      "q": 0.93022758792823,
      "label": "none",
      "q_prev": 0.9520297970202979,
      "label_prev": "none",
      "q_published": 0.9520297970202979,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.15)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 73,
      "mean_a": 73.4006734006734,
      "mean_b": 71.21212121212122,
      "delta": 2.1885521885521886,
      "ci95": [
       -0.7246376842852764,
       5.185185188479839
      ],
      "p": 0.18338166183381663,
      "mid_p": 0.1494,
      "per_seed": {
       "42": -2.525252525252525,
       "43": 7.070707070707071,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.223769552043601,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6867005607131595,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.22)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 87.22222222222223,
      "mean_b": 87.15277777777777,
      "delta": 0.06944444444444445,
      "ci95": [
       -2.0833333356441948,
       2.3809523834322524
      ],
      "p": 1.0,
      "mid_p": 0.9597,
      "per_seed": {
       "42": 0.625,
       "43": -1.0416666666666667,
       "44": 0.625
      },
      "p_het": null,
      "mdd80": 3.190639465482944,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.19)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 164,
      "mean_a": 67.91483113069016,
      "mean_b": 68.64904552129222,
      "delta": -0.7342143906020558,
      "ci95": [
       -2.3809523826175694,
       0.9132420108368788
      ],
      "p": 0.4360563943605639,
      "mid_p": 0.38735,
      "per_seed": {
       "42": -2.643171806167401,
       "43": 1.3215859030837005,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.354371404548632,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9153956399231872,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.9153956399231872,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.35)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 14,
      "a_only": 10,
      "b_only": 4,
      "mean_a": 4.868913857677903,
      "mean_b": 2.6217228464419478,
      "rate_a": 4.868913857677903,
      "rate_b": 2.6217228464419478,
      "delta": 2.247191011235955,
      "ci95": [
       -2.2198892352510244e-09,
       4.255319150840494
      ],
      "p": 0.0660933906609339,
      "mid_p": 0.033,
      "per_seed": {
       "42": 5.617977528089888,
       "43": 1.1235955056179776,
       "44": 0.0
      },
      "p_het": 0.40745925407459255,
      "mdd80": 3.0412903838038194,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5287471252874713,
      "label_source": "none",
      "q": 0.48067920480679205,
      "label": "none",
      "q_prev": 0.5287471252874713,
      "label_prev": "none",
      "q_published": 0.5287471252874713,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.04)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 252,
      "a_only": 155,
      "b_only": 97,
      "mean_a": 21.6,
      "mean_b": 17.733333333333334,
      "rate_a": 21.599999999999998,
      "rate_b": 17.733333333333334,
      "delta": 3.8666666666666667,
      "ci95": [
       1.6806722666191587,
       6.047819974165941
      ],
      "p": 0.0005999400059994001,
      "mid_p": 0.00045,
      "per_seed": {
       "42": 4.0,
       "43": 4.2,
       "44": 3.4
      },
      "p_het": 0.9535046495350465,
      "mdd80": 3.1212146139639874,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.020569371634265143,
      "label_source": "above_detected",
      "q": 0.020569371634265143,
      "label": "above_detected",
      "q_prev": 0.020569371634265143,
      "label_prev": "above_detected",
      "q_published": 0.020569371634265143,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0006, q 0.0206)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 96,
      "mean_a": 71.88552188552188,
      "mean_b": 71.21212121212122,
      "delta": 0.6734006734006734,
      "ci95": [
       -2.6936026969669085,
       4.074074077805183
      ],
      "p": 0.7734226577342266,
      "mid_p": 0.7011,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": -0.5050505050505051,
       "44": 3.5353535353535355
      },
      "p_het": null,
      "mdd80": 4.836880514826744,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.84)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 86.80555555555556,
      "mean_b": 87.15277777777777,
      "delta": -0.3472222222222222,
      "ci95": [
       -3.4090909132792904,
       2.7083333379278662
      ],
      "p": 0.8576142385761424,
      "mid_p": 0.82295,
      "per_seed": {
       "42": 1.25,
       "43": -2.0833333333333335,
       "44": -0.20833333333333334
      },
      "p_het": null,
      "mdd80": 4.372142929741044,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.37)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 155,
      "mean_a": 68.4287812041116,
      "mean_b": 68.64904552129222,
      "delta": -0.22026431718061673,
      "ci95": [
       -2.1021021040241505,
       1.6666666686134919
      ],
      "p": 0.8745125487451255,
      "mid_p": 0.8161,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": -0.44052863436123346,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.6935512507351382,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.69)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 13,
      "a_only": 10,
      "b_only": 3,
      "mean_a": 5.2434456928838955,
      "mean_b": 2.6217228464419478,
      "rate_a": 5.2434456928838955,
      "rate_b": 2.6217228464419478,
      "delta": 2.6217228464419478,
      "ci95": [
       -2.5327647839485136e-09,
       4.964539009310745
      ],
      "p": 0.060193980601939805,
      "mid_p": 0.03365,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 4.49438202247191,
       "44": 0.0
      },
      "p_het": 0.49705029497050296,
      "mdd80": 3.5481721143947142,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5229821845401667,
      "label_source": "none",
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.5229821845401667,
      "label_prev": "none",
      "q_published": 0.5229821845401667,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.55)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 243,
      "a_only": 131,
      "b_only": 112,
      "mean_a": 19.0,
      "mean_b": 17.733333333333334,
      "rate_a": 19.0,
      "rate_b": 17.733333333333334,
      "delta": 1.2666666666666666,
      "ci95": [
       -0.8064516149846166,
       3.3333333354774584
      ],
      "p": 0.2595740425957404,
      "mid_p": 0.23285,
      "per_seed": {
       "42": 1.0,
       "43": 0.6,
       "44": 2.2
      },
      "p_het": 0.806019398060194,
      "mdd80": 2.958717714933619,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.96)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 72.72727272727273,
      "mean_b": 71.21212121212122,
      "delta": 1.5151515151515151,
      "ci95": [
       -1.8115942064786372,
       4.854368935238409
      ],
      "p": 0.4266573342665733,
      "mid_p": 0.37065,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": 1.0101010101010102,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.7641854517808655,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.910846968400505,
      "label_source": "none",
      "q": 0.9000108392522091,
      "label": "none",
      "q_prev": 0.9153956399231872,
      "label_prev": "none",
      "q_published": 0.910846968400505,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.76)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 34,
      "mean_a": 86.94444444444444,
      "mean_b": 87.15277777777777,
      "delta": -0.20833333333333334,
      "ci95": [
       -2.430555558343462,
       1.9531250020296647
      ],
      "p": 0.9131086891310869,
      "mid_p": 0.8667,
      "per_seed": {
       "42": 0.0,
       "43": -0.20833333333333334,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 3.1330306974371718,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.13)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 161,
      "mean_a": 68.28193832599119,
      "mean_b": 68.64904552129222,
      "delta": -0.3671071953010279,
      "ci95": [
       -2.121212123021424,
       1.3888888907293717
      ],
      "p": 0.7495250474952505,
      "mid_p": 0.6874,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": 0.8810572687224669,
       "44": -2.202643171806167
      },
      "p_het": null,
      "mdd80": 2.50868056550419,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.51)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 11,
      "a_only": 9,
      "b_only": 2,
      "mean_a": 5.2434456928838955,
      "mean_b": 2.6217228464419478,
      "rate_a": 5.2434456928838955,
      "rate_b": 2.6217228464419478,
      "delta": 2.6217228464419478,
      "ci95": [
       -2.5375791780224638e-09,
       5.000000002646619
      ],
      "p": 0.0598940105989401,
      "mid_p": 0.03385,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 2.247191011235955,
       "44": 1.1235955056179776
      },
      "p_het": 0.6541345865413458,
      "mdd80": 3.5735162012112345,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5229821845401667,
      "label_source": "none",
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.5229821845401667,
      "label_prev": "none",
      "q_published": 0.5229821845401667,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.57)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 277,
      "a_only": 161,
      "b_only": 116,
      "mean_a": 20.733333333333334,
      "mean_b": 17.733333333333334,
      "rate_a": 20.733333333333334,
      "rate_b": 17.733333333333334,
      "delta": 3.0,
      "ci95": [
       0.7999999978089527,
       5.200000002191046
      ],
      "p": 0.007799220077992201,
      "mid_p": 0.00655,
      "per_seed": {
       "42": 4.6,
       "43": 2.4,
       "44": 2.0
      },
      "p_het": 0.5987401259874012,
      "mdd80": 3.144694256937239,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.143985601439856,
      "label_source": "above_nominal",
      "q": 0.12478752124787522,
      "label": "above_nominal",
      "q_prev": 0.143985601439856,
      "label_prev": "above_nominal",
      "q_published": 0.143985601439856,
      "label_published": "above_nominal",
      "changed": false,
      "text": "above, nominal (p 0.00780, q 0.125)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 73.06397306397307,
      "mean_b": 71.21212121212122,
      "delta": 1.8518518518518519,
      "ci95": [
       -1.0416666696519747,
       4.761904765060246
      ],
      "p": 0.25047495250474955,
      "mid_p": 0.21015,
      "per_seed": {
       "42": -2.525252525252525,
       "43": 4.040404040404041,
       "44": 4.040404040404041
      },
      "p_het": null,
      "mdd80": 4.147831305065534,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.15)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 87.5,
      "mean_b": 87.15277777777777,
      "delta": 0.3472222222222222,
      "ci95": [
       -1.9230769257092237,
       2.564102566668323
      ],
      "p": 0.8021197880211979,
      "mid_p": 0.75685,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": 1.4583333333333333,
       "44": -0.20833333333333334
      },
      "p_het": null,
      "mdd80": 3.207001719425647,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.21)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 164,
      "mean_a": 68.94273127753304,
      "mean_b": 68.64904552129222,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.536098312203563,
       2.130898023213818
      ],
      "p": 0.814018598140186,
      "mid_p": 0.75425,
      "per_seed": {
       "42": 2.643171806167401,
       "43": -1.5418502202643172,
       "44": -0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.6208141601618835,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.62)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 11,
      "b_only": 5,
      "mean_a": 4.868913857677903,
      "mean_b": 2.6217228464419478,
      "rate_a": 4.868913857677903,
      "rate_b": 2.6217228464419478,
      "delta": 2.247191011235955,
      "ci95": [
       -2.176925707644142e-09,
       4.255319150833181
      ],
      "p": 0.06229377062293771,
      "mid_p": 0.0311,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 0.0,
       "44": 3.3707865168539324
      },
      "p_het": 0.7613238676132387,
      "mdd80": 3.041290383767886,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5229821845401667,
      "label_source": "none",
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.5229821845401667,
      "label_prev": "none",
      "q_published": 0.5229821845401667,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.04)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 264,
      "a_only": 158,
      "b_only": 106,
      "mean_a": 21.2,
      "mean_b": 17.733333333333334,
      "rate_a": 21.2,
      "rate_b": 17.733333333333334,
      "delta": 3.466666666666667,
      "ci95": [
       1.3550135479945435,
       5.60109289835665
      ],
      "p": 0.0014998500149985001,
      "mid_p": 0.00115,
      "per_seed": {
       "42": 5.0,
       "43": 3.6,
       "44": 1.8
      },
      "p_het": 0.502049795020498,
      "mdd80": 3.034686666883009,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.044995500449955005,
      "label_source": "above_detected",
      "q": 0.039996000399960006,
      "label": "above_detected",
      "q_prev": 0.044995500449955005,
      "label_prev": "above_detected",
      "q_published": 0.044995500449955005,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.00150, q 0.0400)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 84,
      "mean_a": 77.10437710437711,
      "mean_b": 75.42087542087542,
      "delta": 1.6835016835016836,
      "ci95": [
       -1.0101010127938745,
       4.333333335951933
      ],
      "p": 0.2638736126387361,
      "mid_p": 0.21645,
      "per_seed": {
       "42": 6.565656565656566,
       "43": -3.5353535353535355,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 3.81896983911069,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.82)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 29,
      "mean_a": 87.15277777777777,
      "mean_b": 88.125,
      "delta": -0.9722222222222222,
      "ci95": [
       -2.2916666686567453,
       0.3472222238830548
      ],
      "p": 0.1815818418158184,
      "mid_p": 0.1503,
      "per_seed": {
       "42": -1.0416666666666667,
       "43": -0.625,
       "44": -1.25
      },
      "p_het": null,
      "mdd80": 1.8860224401819667,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6867005607131595,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.89)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 113,
      "mean_a": 80.10279001468429,
      "mean_b": 78.56093979441997,
      "delta": 1.5418502202643172,
      "ci95": [
       -0.14430014595557625,
       3.2110091760496826
      ],
      "p": 0.08289171082891711,
      "mid_p": 0.0693,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": 1.3215859030837005,
       "44": 2.202643171806167
      },
      "p_het": null,
      "mdd80": 2.3980504419657813,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5526114055261141,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 32,
      "a_only": 11,
      "b_only": 21,
      "mean_a": 22.846441947565545,
      "mean_b": 26.591760299625467,
      "rate_a": 22.84644194756554,
      "rate_b": 26.591760299625467,
      "delta": -3.745318352059925,
      "ci95": [
       -7.894736846951794,
       4.903855938726308e-09
      ],
      "p": 0.10938906109389061,
      "mid_p": 0.079,
      "per_seed": {
       "42": -4.49438202247191,
       "43": -2.247191011235955,
       "44": -4.49438202247191
      },
      "p_het": 0.9297070292970703,
      "mdd80": 5.6423940030308515,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 5.64)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 245,
      "a_only": 109,
      "b_only": 136,
      "mean_a": 48.0,
      "mean_b": 49.8,
      "rate_a": 48.0,
      "rate_b": 49.79999999999999,
      "delta": -1.8,
      "ci95": [
       -3.8208168662918576,
       0.25348542653719275
      ],
      "p": 0.09009099090090991,
      "mid_p": 0.07965,
      "per_seed": {
       "42": -5.2,
       "43": -1.6,
       "44": 1.4
      },
      "p_het": 0.044295570442955706,
      "mdd80": 2.911917047392147,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.91)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 79,
      "mean_a": 75.58922558922559,
      "mean_b": 75.42087542087542,
      "delta": 0.16835016835016836,
      "ci95": [
       -3.100775197558181,
       3.436426120173074
      ],
      "p": 1.0,
      "mid_p": 0.91705,
      "per_seed": {
       "42": 3.5353535353535355,
       "43": -4.545454545454546,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.672158959054135,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.67)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 85.48611111111111,
      "mean_b": 88.125,
      "delta": -2.638888888888889,
      "ci95": [
       -4.513888891244688,
       -0.8333333315194631
      ],
      "p": 0.0025997400259974,
      "mid_p": 0.00175,
      "per_seed": {
       "42": -3.3333333333333335,
       "43": -2.5,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 2.6305049816998234,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.069326400693264,
      "label_source": "below_detected",
      "q": 0.0623937606239376,
      "label": "below_detected",
      "q_prev": 0.069326400693264,
      "label_prev": "below_detected",
      "q_published": 0.069326400693264,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.00260, q 0.0624)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 122,
      "mean_a": 78.41409691629956,
      "mean_b": 78.56093979441997,
      "delta": -0.14684287812041116,
      "ci95": [
       -1.7713365557232281,
       1.494768312581413
      ],
      "p": 0.9307069293070693,
      "mid_p": 0.8624,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": -1.1013215859030836,
       "44": 0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.3342957299280136,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.33)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 15,
      "b_only": 29,
      "mean_a": 21.348314606741575,
      "mean_b": 26.591760299625467,
      "rate_a": 21.34831460674157,
      "rate_b": 26.591760299625467,
      "delta": -5.2434456928838955,
      "ci95": [
       -10.884353746621631,
       0.6666666719222413
      ],
      "p": 0.09679032096790322,
      "mid_p": 0.0742,
      "per_seed": {
       "42": -7.865168539325842,
       "43": -5.617977528089888,
       "44": -2.247191011235955
      },
      "p_het": 0.6277372262773723,
      "mdd80": 8.255551712677978,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.26)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 248,
      "a_only": 111,
      "b_only": 137,
      "mean_a": 48.06666666666667,
      "mean_b": 49.8,
      "rate_a": 48.06666666666667,
      "rate_b": 49.79999999999999,
      "delta": -1.7333333333333334,
      "ci95": [
       -3.872752422687555,
       0.41152263594374944
      ],
      "p": 0.12968703129687031,
      "mid_p": 0.1158,
      "per_seed": {
       "42": -4.2,
       "43": -2.2,
       "44": 1.2
      },
      "p_het": 0.09209079092090791,
      "mdd80": 3.0619852633180478,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r40",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.6102919119852721,
      "label_source": "none",
      "q": 0.5872620285141297,
      "label": "none",
      "q_prev": 0.6102919119852721,
      "label_prev": "none",
      "q_published": 0.6102919119852721,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.06)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 64,
      "mean_a": 73.06397306397307,
      "mean_b": 75.42087542087542,
      "delta": -2.356902356902357,
      "ci95": [
       -5.072463771028072,
       0.3401360571454829
      ],
      "p": 0.10748925107489252,
      "mid_p": 0.08545,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": -4.545454545454546,
       "44": -1.5151515151515151
      },
      "p_het": null,
      "mdd80": 3.868402631319356,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.5611353758241198,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.87)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 28,
      "mean_a": 87.08333333333333,
      "mean_b": 88.125,
      "delta": -1.0416666666666667,
      "ci95": [
       -2.3809523823964,
       0.2976190490630669
      ],
      "p": 0.1645835416458354,
      "mid_p": 0.136,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": -0.625,
       "44": -2.2916666666666665
      },
      "p_het": null,
      "mdd80": 1.914383679299486,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6851314868513149,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.91)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 117,
      "mean_a": 78.19383259911895,
      "mean_b": 78.56093979441997,
      "delta": -0.3671071953010279,
      "ci95": [
       -1.9047619061813883,
       1.1851851867478125
      ],
      "p": 0.7036296370362963,
      "mid_p": 0.6362,
      "per_seed": {
       "42": -1.5418502202643172,
       "43": 0.6607929515418502,
       "44": -0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.2083951972038594,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.21)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 13,
      "b_only": 27,
      "mean_a": 21.348314606741575,
      "mean_b": 26.591760299625467,
      "rate_a": 21.34831460674157,
      "rate_b": 26.591760299625467,
      "delta": -5.2434456928838955,
      "ci95": [
       -10.317460322823264,
       5.176364602013517e-09
      ],
      "p": 0.05649435056494351,
      "mid_p": 0.0419,
      "per_seed": {
       "42": -10.112359550561798,
       "43": -3.3707865168539324,
       "44": -2.247191011235955
      },
      "p_het": 0.33126687331266874,
      "mdd80": 7.373922319846595,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5229821845401667,
      "label_source": "none",
      "q": 0.47395260473952605,
      "label": "none",
      "q_prev": 0.5229821845401667,
      "label_prev": "none",
      "q_published": 0.5229821845401667,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.37)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 239,
      "a_only": 115,
      "b_only": 124,
      "mean_a": 49.2,
      "mean_b": 49.8,
      "rate_a": 49.199999999999996,
      "rate_b": 49.79999999999999,
      "delta": -0.6,
      "ci95": [
       -2.7322404393342437,
       1.5220700176388764
      ],
      "p": 0.617038296170383,
      "mid_p": 0.5755,
      "per_seed": {
       "42": -1.4,
       "43": -1.8,
       "44": 1.4
      },
      "p_het": 0.3892610738926107,
      "mdd80": 3.04056946544258,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r60",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.996220377962204,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.996220377962204,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.04)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 82,
      "mean_a": 75.75757575757575,
      "mean_b": 75.42087542087542,
      "delta": 0.3367003367003367,
      "ci95": [
       -2.7272727300291386,
       3.4013605473049093
      ],
      "p": 0.9117088291170883,
      "mid_p": 0.826,
      "per_seed": {
       "42": 5.05050505050505,
       "43": -3.5353535353535355,
       "44": -0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.380154057025588,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.38)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 30,
      "mean_a": 86.52777777777777,
      "mean_b": 88.125,
      "delta": -1.5972222222222223,
      "ci95": [
       -3.125000001648436,
       -0.17361110931844306
      ],
      "p": 0.0321967803219678,
      "mid_p": 0.02325,
      "per_seed": {
       "42": -2.2916666666666665,
       "43": -0.4166666666666667,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 2.1093672023761467,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.4066961724880143,
      "label_source": "below_nominal",
      "q": 0.3863613638636136,
      "label": "below_nominal",
      "q_prev": 0.4066961724880143,
      "label_prev": "below_nominal",
      "q_published": 0.4066961724880143,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0322, q 0.39)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 122,
      "mean_a": 78.56093979441997,
      "mean_b": 78.56093979441997,
      "delta": 0.0,
      "ci95": [
       -1.5649452285802525,
       1.5649452285802525
      ],
      "p": 1.0,
      "mid_p": 0.96345,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": -0.22026431718061673,
       "44": -0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.2369428490165495,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.24)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 46,
      "a_only": 17,
      "b_only": 29,
      "mean_a": 22.09737827715356,
      "mean_b": 26.591760299625467,
      "rate_a": 22.097378277153563,
      "rate_b": 26.591760299625467,
      "delta": -4.49438202247191,
      "ci95": [
       -9.756097566677575,
       0.7751938038925025
      ],
      "p": 0.12098790120987901,
      "mid_p": 0.0935,
      "per_seed": {
       "42": -10.112359550561798,
       "43": -2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 0.3154684531546845,
      "mdd80": 7.526748058677617,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.571236993947664,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.53)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 237,
      "a_only": 95,
      "b_only": 142,
      "mean_a": 46.666666666666664,
      "mean_b": 49.8,
      "rate_a": 46.666666666666664,
      "rate_b": 49.79999999999999,
      "delta": -3.1333333333333333,
      "ci95": [
       -5.1282051303284835,
       -1.1204481771582506
      ],
      "p": 0.0031996800319968005,
      "mid_p": 0.00235,
      "per_seed": {
       "42": -4.6,
       "43": -1.8,
       "44": -3.0
      },
      "p_het": 0.553044695530447,
      "mdd80": 2.864356877564282,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u32",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.07679232076792322,
      "label_source": "below_detected",
      "q": 0.06981120069811202,
      "label": "below_detected",
      "q_prev": 0.07679232076792322,
      "label_prev": "below_detected",
      "q_published": 0.07679232076792322,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.00320, q 0.0698)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 83,
      "mean_a": 77.60942760942761,
      "mean_b": 75.42087542087542,
      "delta": 2.1885521885521886,
      "ci95": [
       -0.6600660093871487,
       4.984423678600278
      ],
      "p": 0.1568843115688431,
      "mid_p": 0.127,
      "per_seed": {
       "42": 4.545454545454546,
       "43": -0.5050505050505051,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 4.0341350653358115,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.705707207057072,
      "label_source": "none",
      "q": 0.6805033782336052,
      "label": "none",
      "q_prev": 0.705707207057072,
      "label_prev": "none",
      "q_published": 0.705707207057072,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.03)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 86.59722222222223,
      "mean_b": 88.125,
      "delta": -1.5277777777777777,
      "ci95": [
       -2.9761904777492303,
       -0.16025640866656587
      ],
      "p": 0.0375962403759624,
      "mid_p": 0.029,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": -3.3333333333333335,
       "44": -1.0416666666666667
      },
      "p_het": null,
      "mdd80": 2.012557201395216,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.426502804265028,
      "label_source": "below_nominal",
      "q": 0.40795920407959196,
      "label": "below_nominal",
      "q_prev": 0.426502804265028,
      "label_prev": "below_nominal",
      "q_published": 0.426502804265028,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0376, q 0.41)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 111,
      "mean_a": 79.0748898678414,
      "mean_b": 78.56093979441997,
      "delta": 0.5139500734214391,
      "ci95": [
       -0.9845288340635905,
       2.0155038775529004
      ],
      "p": 0.5676432356764324,
      "mid_p": 0.5056,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": 0.44052863436123346,
       "44": 0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.144133097601918,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.14)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 17,
      "b_only": 23,
      "mean_a": 24.344569288389515,
      "mean_b": 26.591760299625467,
      "rate_a": 24.34456928838951,
      "rate_b": 26.591760299625467,
      "delta": -2.247191011235955,
      "ci95": [
       -7.246376816429304,
       2.7777777824365177
      ],
      "p": 0.47505249475052497,
      "mid_p": 0.3922,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 0.0,
       "44": -3.3707865168539324
      },
      "p_het": 0.8600139986001399,
      "mdd80": 7.164295765070398,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9345294978698852,
      "label_source": "none",
      "q": 0.9217787898629491,
      "label": "none",
      "q_prev": 0.9345294978698852,
      "label_prev": "none",
      "q_published": 0.9345294978698852,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.16)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 255,
      "a_only": 120,
      "b_only": 135,
      "mean_a": 48.8,
      "mean_b": 49.8,
      "rate_a": 48.800000000000004,
      "rate_b": 49.79999999999999,
      "delta": -1.0,
      "ci95": [
       -3.0178326495347747,
       1.0144927558127144
      ],
      "p": 0.36696330366963303,
      "mid_p": 0.33635,
      "per_seed": {
       "42": -2.2,
       "43": -1.6,
       "44": 0.8
      },
      "p_het": 0.5001499850014999,
      "mdd80": 2.8819160299248976,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u64",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.835614551752372,
      "label_source": "none",
      "q": 0.8399160083991601,
      "label": "none",
      "q_prev": 0.8479921238645367,
      "label_prev": "none",
      "q_published": 0.835614551752372,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.88)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 77,
      "mean_a": 75.25252525252525,
      "mean_b": 75.42087542087542,
      "delta": -0.16835016835016836,
      "ci95": [
       -3.4364261201656143,
       3.0864197560613746
      ],
      "p": 1.0,
      "mid_p": 0.91825,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.661899078506566,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.66)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 31,
      "mean_a": 87.91666666666667,
      "mean_b": 88.125,
      "delta": -0.20833333333333334,
      "ci95": [
       -1.5625000017035862,
       1.1904761919847866
      ],
      "p": 0.8407159284071593,
      "mid_p": 0.7638,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": 0.0,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.9675610038988023,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.97)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 112,
      "mean_a": 78.8546255506608,
      "mean_b": 78.56093979441997,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.1904761919802584,
       1.79372197461776
      ],
      "p": 0.7708229177082292,
      "mid_p": 0.7003,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": -1.3215859030837005,
       "44": 0.6607929515418502
      },
      "p_het": null,
      "mdd80": 2.132816096981188,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.13)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 17,
      "b_only": 34,
      "mean_a": 20.224719101123597,
      "mean_b": 26.591760299625467,
      "rate_a": 20.224719101123597,
      "rate_b": 26.591760299625467,
      "delta": -6.367041198501872,
      "ci95": [
       -11.111111116125599,
       -1.626016255015725
      ],
      "p": 0.010798920107989201,
      "mid_p": 0.00785,
      "per_seed": {
       "42": -12.359550561797754,
       "43": -3.3707865168539324,
       "44": -3.3707865168539324
      },
      "p_het": 0.33686631336866313,
      "mdd80": 6.779028024211547,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.18512434470838632,
      "label_source": "below_nominal",
      "q": 0.16198380161983802,
      "label": "below_nominal",
      "q_prev": 0.18512434470838632,
      "label_prev": "below_nominal",
      "q_published": 0.18512434470838632,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0108, q 0.162)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "loki_k25_d25_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 241,
      "a_only": 118,
      "b_only": 123,
      "mean_a": 49.46666666666667,
      "mean_b": 49.8,
      "rate_a": 49.46666666666667,
      "rate_b": 49.79999999999999,
      "delta": -0.3333333333333333,
      "ci95": [
       -2.294197033017695,
       1.6224188812137357
      ],
      "p": 0.7928207179282072,
      "mid_p": 0.74365,
      "per_seed": {
       "42": -1.2,
       "43": -0.2,
       "44": 0.4
      },
      "p_het": 0.8288171182881712,
      "mdd80": 2.7992180817832133,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u128",
       "loki_k25_d25_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.80)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 94,
      "mean_a": 77.10437710437711,
      "mean_b": 75.08417508417509,
      "delta": 2.0202020202020203,
      "ci95": [
       -0.9345794419809468,
       4.912280704768898
      ],
      "p": 0.207979202079792,
      "mid_p": 0.17315,
      "per_seed": {
       "42": 4.040404040404041,
       "43": 0.5050505050505051,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.17876988779266,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7178710700358535,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7178710700358535,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.18)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 30,
      "mean_a": 87.15277777777777,
      "mean_b": 88.19444444444444,
      "delta": -1.0416666666666667,
      "ci95": [
       -2.724358976312058,
       0.5681818203921436
      ],
      "p": 0.26677332266773324,
      "mid_p": 0.23295,
      "per_seed": {
       "42": -1.6666666666666667,
       "43": -0.8333333333333334,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 2.3531895735944017,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.35)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 121,
      "mean_a": 80.10279001468429,
      "mean_b": 79.00146842878121,
      "delta": 1.1013215859030836,
      "ci95": [
       -0.6289308194610448,
       2.8571428590337797
      ],
      "p": 0.2558744125587441,
      "mid_p": 0.2241,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": 0.8810572687224669,
       "44": 1.3215859030837005
      },
      "p_het": null,
      "mdd80": 2.4915081511601658,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7281090072810901,
      "label_source": "none",
      "q": 0.7119288071192881,
      "label": "none",
      "q_prev": 0.7199280071992801,
      "label_prev": "none",
      "q_published": 0.7281090072810901,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.49)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 34,
      "a_only": 19,
      "b_only": 15,
      "mean_a": 22.846441947565545,
      "mean_b": 21.348314606741575,
      "rate_a": 22.84644194756554,
      "rate_b": 21.34831460674157,
      "delta": 1.4981273408239701,
      "ci95": [
       -1.6260162635432451,
       4.651162793951965
      ],
      "p": 0.4834516548345166,
      "mid_p": 0.36135,
      "per_seed": {
       "42": 7.865168539325842,
       "43": 0.0,
       "44": -3.3707865168539324
      },
      "p_het": 0.1513848615138486,
      "mdd80": 4.486320207321006,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.9417122803848648,
      "label_source": "none",
      "q": 0.9267644664105018,
      "label": "none",
      "q_prev": 0.9417122803848648,
      "label_prev": "none",
      "q_published": 0.9417122803848648,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.49)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 319,
      "a_only": 233,
      "b_only": 86,
      "mean_a": 48.0,
      "mean_b": 38.2,
      "rate_a": 48.0,
      "rate_b": 38.199999999999996,
      "delta": 9.8,
      "ci95": [
       7.228915660077568,
       12.355212357671917
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": 7.2,
       "43": 10.2,
       "44": 12.0
      },
      "p_het": 0.2136786321367863,
      "mdd80": 3.6637808564150576,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_dense",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.003999600039996001,
      "label_source": "above_detected",
      "q": 0.003999600039996001,
      "label": "above_detected",
      "q_prev": 0.003999600039996001,
      "label_prev": "above_detected",
      "q_published": 0.003999600039996001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0001, q 0.00400)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 75,
      "mean_a": 75.58922558922559,
      "mean_b": 75.08417508417509,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.456140353960617,
       3.4364261198192967
      ],
      "p": 0.8245175482451755,
      "mid_p": 0.7393,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -0.5050505050505051,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.211436347786751,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.21)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 43,
      "mean_a": 85.48611111111111,
      "mean_b": 88.19444444444444,
      "delta": -2.7083333333333335,
      "ci95": [
       -5.277777780349007,
       -0.2976190450333859
      ],
      "p": 0.027797220277972202,
      "mid_p": 0.0216,
      "per_seed": {
       "42": -3.9583333333333335,
       "43": -2.7083333333333335,
       "44": -1.4583333333333333
      },
      "p_het": null,
      "mdd80": 3.5593355813603447,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.370629603706296,
      "label_source": "below_nominal",
      "q": 0.35112278245859624,
      "label": "below_nominal",
      "q_prev": 0.370629603706296,
      "label_prev": "below_nominal",
      "q_published": 0.370629603706296,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0278, q 0.35)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 144,
      "mean_a": 78.41409691629956,
      "mean_b": 79.00146842878121,
      "delta": -0.5873715124816447,
      "ci95": [
       -2.308802310488623,
       1.1396011412743845
      ],
      "p": 0.5625437456254374,
      "mid_p": 0.5084,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": -1.5418502202643172,
       "44": -0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.4645851180821907,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.9947338599473385,
      "label_source": "none",
      "q": 0.9733928567927521,
      "label": "none",
      "q_prev": 0.9896228920154344,
      "label_prev": "none",
      "q_published": 0.9947338599473385,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.46)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 22,
      "b_only": 22,
      "mean_a": 21.348314606741575,
      "mean_b": 21.348314606741575,
      "rate_a": 21.34831460674157,
      "rate_b": 21.34831460674157,
      "delta": 0.0,
      "ci95": [
       -5.673758870621668,
       5.673758870621668
      ],
      "p": 1.0,
      "mid_p": 0.94995,
      "per_seed": {
       "42": 4.49438202247191,
       "43": -3.3707865168539324,
       "44": -1.1235955056179776
      },
      "p_het": 0.40045995400459955,
      "mdd80": 8.110107689964115,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.11)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 322,
      "a_only": 235,
      "b_only": 87,
      "mean_a": 48.06666666666667,
      "mean_b": 38.2,
      "rate_a": 48.06666666666667,
      "rate_b": 38.199999999999996,
      "delta": 9.866666666666667,
      "ci95": [
       7.307692305236611,
       12.431693991694328
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": 8.2,
       "43": 9.6,
       "44": 11.8
      },
      "p_het": 0.40945905409459055,
      "mdd80": 3.662140604521015,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r40",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.003999600039996001,
      "label_source": "above_detected",
      "q": 0.003999600039996001,
      "label": "above_detected",
      "q_prev": 0.003999600039996001,
      "label_prev": "above_detected",
      "q_published": 0.003999600039996001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0001, q 0.00400)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 76,
      "mean_a": 73.06397306397307,
      "mean_b": 75.08417508417509,
      "delta": -2.0202020202020203,
      "ci95": [
       -5.038759693391421,
       1.0000000029862905
      ],
      "p": 0.22467753224677534,
      "mid_p": 0.18655,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": -0.5050505050505051,
       "44": -2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.31592111757052,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7237171019740132,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7237171019740132,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.32)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 87.08333333333333,
      "mean_b": 88.19444444444444,
      "delta": -1.1111111111111112,
      "ci95": [
       -2.951388891196933,
       0.5952380970747991
      ],
      "p": 0.30856914308569144,
      "mid_p": 0.26625,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": -0.8333333333333334,
       "44": -1.6666666666666667
      },
      "p_het": null,
      "mdd80": 2.5347857978202417,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7975976595888798,
      "label_source": "none",
      "q": 0.7891125781038917,
      "label": "none",
      "q_prev": 0.7975976595888798,
      "label_prev": "none",
      "q_published": 0.7975976595888798,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.53)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 129,
      "mean_a": 78.19383259911895,
      "mean_b": 79.00146842878121,
      "delta": -0.8076358296622613,
      "ci95": [
       -2.4745269303217796,
       0.8547008563135201
      ],
      "p": 0.39166083391660833,
      "mid_p": 0.3469,
      "per_seed": {
       "42": -1.5418502202643172,
       "43": 0.22026431718061673,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.379409884145706,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.874821608748216,
      "label_source": "none",
      "q": 0.882847495067007,
      "label": "none",
      "q_prev": 0.8910220089102201,
      "label_prev": "none",
      "q_published": 0.874821608748216,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.38)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 20,
      "b_only": 20,
      "mean_a": 21.348314606741575,
      "mean_b": 21.348314606741575,
      "rate_a": 21.34831460674157,
      "rate_b": 21.34831460674157,
      "delta": 0.0,
      "ci95": [
       -4.666666670811516,
       4.651162795499875
      ],
      "p": 1.0,
      "mid_p": 0.9393,
      "per_seed": {
       "42": 2.247191011235955,
       "43": -1.1235955056179776,
       "44": -1.1235955056179776
      },
      "p_het": 0.8661133886611339,
      "mdd80": 6.659482904692622,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.66)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 325,
      "a_only": 245,
      "b_only": 80,
      "mean_a": 49.2,
      "mean_b": 38.2,
      "rate_a": 49.199999999999996,
      "rate_b": 38.199999999999996,
      "delta": 11.0,
      "ci95": [
       8.368794323442438,
       13.617021279375283
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": 11.0,
       "43": 10.0,
       "44": 12.0
      },
      "p_het": 0.7668233176682332,
      "mdd80": 3.7509248070428005,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r60",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.003999600039996001,
      "label_source": "above_detected",
      "q": 0.003999600039996001,
      "label": "above_detected",
      "q_prev": 0.003999600039996001,
      "label_prev": "above_detected",
      "q_published": 0.003999600039996001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0001, q 0.00400)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 74,
      "mean_a": 75.75757575757575,
      "mean_b": 75.08417508417509,
      "delta": 0.6734006734006734,
      "ci95": [
       -2.4054982849204563,
       3.741496601729214
      ],
      "p": 0.7445255474452555,
      "mid_p": 0.66915,
      "per_seed": {
       "42": 2.525252525252525,
       "43": 0.5050505050505051,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.393277158685919,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.39)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 26,
      "mean_a": 86.52777777777777,
      "mean_b": 88.19444444444444,
      "delta": -1.6666666666666667,
      "ci95": [
       -4.017857145384304,
       0.4901960803368194
      ],
      "p": 0.20427957204279573,
      "mid_p": 0.1777,
      "per_seed": {
       "42": -2.9166666666666665,
       "43": -0.625,
       "44": -1.4583333333333333
      },
      "p_het": null,
      "mdd80": 3.2219202442667854,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7178710700358535,
      "label_source": "none",
      "q": 0.6962341740509495,
      "label": "none",
      "q_prev": 0.7143181785717533,
      "label_prev": "none",
      "q_published": 0.7178710700358535,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.22)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 136,
      "mean_a": 78.56093979441997,
      "mean_b": 79.00146842878121,
      "delta": -0.44052863436123346,
      "ci95": [
       -2.201257863517274,
       1.2987013004074948
      ],
      "p": 0.6847315268473153,
      "mid_p": 0.6281,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": -0.6607929515418502,
       "44": -1.3215859030837005
      },
      "p_het": null,
      "mdd80": 2.5014321525789938,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 23,
      "b_only": 21,
      "mean_a": 22.09737827715356,
      "mean_b": 21.348314606741575,
      "rate_a": 22.097378277153563,
      "rate_b": 21.34831460674157,
      "delta": 0.7490636704119851,
      "ci95": [
       -4.545454550803731,
       6.0606060659799255
      ],
      "p": 0.8865113488651135,
      "mid_p": 0.78185,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 0.0,
       "44": 0.0
      },
      "p_het": 0.9448055194480552,
      "mdd80": 7.580185881161526,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.58)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 299,
      "a_only": 213,
      "b_only": 86,
      "mean_a": 46.666666666666664,
      "mean_b": 38.2,
      "rate_a": 46.666666666666664,
      "rate_b": 38.199999999999996,
      "delta": 8.466666666666667,
      "ci95": [
       5.97609561505732,
       10.937500002409404
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": 7.8,
       "43": 10.0,
       "44": 7.6
      },
      "p_het": 0.6059394060593941,
      "mdd80": 3.5459317881160723,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u32",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.003999600039996001,
      "label_source": "above_detected",
      "q": 0.003999600039996001,
      "label": "above_detected",
      "q_prev": 0.003999600039996001,
      "label_prev": "above_detected",
      "q_published": 0.003999600039996001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0001, q 0.00400)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 87,
      "mean_a": 77.60942760942761,
      "mean_b": 75.08417508417509,
      "delta": 2.525252525252525,
      "ci95": [
       -0.3831417657514447,
       5.5555555584964225
      ],
      "p": 0.12108789121087891,
      "mid_p": 0.09905,
      "per_seed": {
       "42": 2.0202020202020203,
       "43": 3.5353535353535355,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.244406216057143,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.5951404859514049,
      "label_source": "none",
      "q": 0.571236993947664,
      "label": "none",
      "q_prev": 0.5951404859514049,
      "label_prev": "none",
      "q_published": 0.5951404859514049,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.24)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 86.59722222222223,
      "mean_b": 88.19444444444444,
      "delta": -1.5972222222222223,
      "ci95": [
       -3.7202380975191893,
       0.39062500186880883
      ],
      "p": 0.17628237176282371,
      "mid_p": 0.15105,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": -3.5416666666666665,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 2.9380471742786045,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.7085005785135773,
      "label_source": "none",
      "q": 0.6867005607131595,
      "label": "none",
      "q_prev": 0.7085005785135773,
      "label_prev": "none",
      "q_published": 0.7085005785135773,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.94)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 125,
      "mean_a": 79.0748898678414,
      "mean_b": 79.00146842878121,
      "delta": 0.07342143906020558,
      "ci95": [
       -1.6152716610106324,
       1.7699115061253519
      ],
      "p": 1.0,
      "mid_p": 0.93195,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": 0.0,
       "44": -0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.4194013758570683,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.42)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 26,
      "b_only": 18,
      "mean_a": 24.344569288389515,
      "mean_b": 21.348314606741575,
      "rate_a": 24.34456928838951,
      "rate_b": 21.34831460674157,
      "delta": 2.9962546816479403,
      "ci95": [
       -2.040816331093388,
       8.00000000443668
      ],
      "p": 0.3090690930906909,
      "mid_p": 0.2487,
      "per_seed": {
       "42": 8.98876404494382,
       "43": 2.247191011235955,
       "44": -2.247191011235955
      },
      "p_het": 0.18048195180481952,
      "mdd80": 7.17620396224005,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 0.7975976595888798,
      "label_source": "none",
      "q": 0.7891125781038917,
      "label": "none",
      "q_prev": 0.7975976595888798,
      "label_prev": "none",
      "q_published": 0.7975976595888798,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.18)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 321,
      "a_only": 240,
      "b_only": 81,
      "mean_a": 48.8,
      "mean_b": 38.2,
      "rate_a": 48.800000000000004,
      "rate_b": 38.199999999999996,
      "delta": 10.6,
      "ci95": [
       8.13008129830338,
       13.090418356096784
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": 10.2,
       "43": 10.2,
       "44": 11.4
      },
      "p_het": 0.8993100689931007,
      "mdd80": 3.545168964222867,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u64",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.003999600039996001,
      "label_source": "above_detected",
      "q": 0.003999600039996001,
      "label": "above_detected",
      "q_prev": 0.003999600039996001,
      "label_prev": "above_detected",
      "q_published": 0.003999600039996001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0001, q 0.00400)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 87,
      "mean_a": 75.25252525252525,
      "mean_b": 75.08417508417509,
      "delta": 0.16835016835016836,
      "ci95": [
       -3.09278350847969,
       3.4090909127294005
      ],
      "p": 1.0,
      "mid_p": 0.92045,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 1.5151515151515151,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.64691071166822,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.65)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 87.91666666666667,
      "mean_b": 88.19444444444444,
      "delta": -0.2777777777777778,
      "ci95": [
       -1.4880952394035976,
       0.9469696986500764
      ],
      "p": 0.7410258974102589,
      "mid_p": 0.6578,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -0.20833333333333334,
       "44": -0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.7403487996227844,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.74)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 128,
      "mean_a": 78.8546255506608,
      "mean_b": 79.00146842878121,
      "delta": -0.14684287812041116,
      "ci95": [
       -1.8604651180815739,
       1.572327045863227
      ],
      "p": 0.9335066493350664,
      "mid_p": 0.86865,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": -1.7621145374449338,
       "44": -0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.4534276801057326,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.45)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 20,
      "b_only": 23,
      "mean_a": 20.224719101123597,
      "mean_b": 21.348314606741575,
      "rate_a": 20.224719101123597,
      "rate_b": 21.34831460674157,
      "delta": -1.1235955056179776,
      "ci95": [
       -5.925925930676227,
       3.703703708465653
      ],
      "p": 0.7589241075892411,
      "mid_p": 0.64685,
      "per_seed": {
       "42": 0.0,
       "43": -1.1235955056179776,
       "44": -2.247191011235955
      },
      "p_het": 0.9813018698130187,
      "mdd80": 6.882327498291611,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "source_md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.88)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "sparq_c8_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 315,
      "a_only": 242,
      "b_only": 73,
      "mean_a": 49.46666666666667,
      "mean_b": 38.2,
      "rate_a": 49.46666666666667,
      "rate_b": 38.199999999999996,
      "delta": 11.266666666666667,
      "ci95": [
       8.713692943417628,
       13.828238721863313
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": 11.2,
       "43": 11.6,
       "44": 11.0
      },
      "p_het": 0.9828017198280172,
      "mdd80": 3.6553824364323906,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u128",
       "sparq_c8_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "source_md5": "792153c7bf7626f2826957459a10b6a4",
      "q_source": 0.003999600039996001,
      "label_source": "above_detected",
      "q": 0.003999600039996001,
      "label": "above_detected",
      "q_prev": 0.003999600039996001,
      "label_prev": "above_detected",
      "q_published": 0.003999600039996001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.0001, q 0.00400)"
     }
    ],
    "counts": {
     "m": 240,
     "by_bench": {
      "gpqa": 48,
      "aime25": 48,
      "lcb": 48,
      "tb": 48,
      "swe": 48
     },
     "n_p05": 25,
     "n_p05_below": 11,
     "n_p05_above": 14,
     "above_detected": 9,
     "above_nominal": 5,
     "below_detected": 3,
     "below_nominal": 8,
     "none": 215,
     "smallest_q_below": 0.029997000299970003
    },
    "counts_prev": {
     "m": 240,
     "by_bench": {
      "gpqa": 48,
      "aime25": 48,
      "lcb": 48,
      "tb": 48,
      "swe": 48
     },
     "n_p05": 25,
     "n_p05_below": 11,
     "n_p05_above": 14,
     "above_detected": 8,
     "above_nominal": 6,
     "below_detected": 2,
     "below_nominal": 8,
     "none": 216,
     "smallest_q_below": 0.069326400693264
    },
    "label_changes": [
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "loki_k25_d25_s1_sxs"
      ],
      "source": "sxs",
      "delta": -2.2117962466487935,
      "p": 0.006199380061993801,
      "q_prev": 0.5951404859514049,
      "q": 0.11445009345219324,
      "label_prev": "none",
      "label": "below_nominal"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "sparq_c8_s1_sxs"
      ],
      "source": "sxs",
      "delta": -3.087248322147651,
      "p": 0.000999900009999,
      "q_prev": 0.20957904209579042,
      "q": 0.029997000299970003,
      "label_prev": "below_nominal",
      "label": "below_detected"
     },
     {
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_dense",
       "loki_k25_d25_s1"
      ],
      "source": "published",
      "delta": 2.9368575624082234,
      "p": 0.004999500049995001,
      "q_prev": 0.10908000109080002,
      "q": 0.09999000099990002,
      "label_prev": "above_nominal",
      "label": "above_detected"
     }
    ],
    "sources": [
     {
      "source": "published",
      "file": "log/sparse/dev/stats/paired_baselines_h2h.json",
      "md5": "792153c7bf7626f2826957459a10b6a4",
      "members": 180
     },
     {
      "source": "tbp v1",
      "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json",
      "md5": "a5ace5cf8d9b77731c7822221fcfcd34",
      "members": 48
     },
     {
      "source": "sxs",
      "file": null,
      "md5": null,
      "members": 12
     }
    ],
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.937950937950938,
        "ci95": [
         -2.874432679786482,
         1.0144927555761438
        ],
        "p": 0.3895610438956104,
        "n_items": 1386,
        "mean_a": 87.22943722943722,
        "mean_b": 88.16738816738817,
        "per_seed": {
         "42": -1.9565217391304348,
         "43": 0.0,
         "44": -0.8658008658008658
        },
        "p_het": 0.641035896410359,
        "mdd80": 2.7794276068323387,
        "shift_vs_primary": -0.0008692779777117465,
        "q_sub": 0.8669403329937276,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_dense_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.9522776572668112,
        "ci95": [
         -3.7735849076385684,
         -0.14347202116685626
        ],
        "p": 0.042695730426957304,
        "n_items": 1383,
        "mean_a": 87.34634851771511,
        "mean_b": 89.29862617498192,
        "per_seed": {
         "42": -4.130434782608695,
         "43": -1.2958963282937366,
         "44": -0.43478260869565216
        },
        "p_het": 0.15478452154784522,
        "mdd80": 2.5944534397164363,
        "shift_vs_primary": -0.2084815472735182,
        "q_sub": 0.40987901209879013,
        "label_sub": "below_nominal",
        "label_primary": "none",
        "label_changed": true
       },
       "jqs_f_r40_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -2.167630057803468,
        "ci95": [
         -3.8243626078530193,
         -0.5457025905607977
        ],
        "p": 0.011998800119988001,
        "n_items": 1384,
        "mean_a": 85.91040462427746,
        "mean_b": 88.07803468208093,
        "per_seed": {
         "42": -0.4357298474945534,
         "43": -2.591792656587473,
         "44": -3.463203463203463
        },
        "p_het": 0.34856514348565143,
        "mdd80": 2.343268935581858,
        "shift_vs_primary": 0.044166188845325305,
        "q_sub": 0.17998200179982002,
        "label_sub": "below_nominal",
        "label_primary": "below_nominal",
        "label_changed": false
       },
       "jqs_f_r40_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -3.256150506512301,
        "ci95": [
         -5.169867062509331,
         -1.3574660613731844
        ],
        "p": 0.000999900009999,
        "n_items": 1382,
        "mean_a": 85.96237337192474,
        "mean_b": 89.21852387843705,
        "per_seed": {
         "42": -2.8260869565217392,
         "43": -3.896103896103896,
         "44": -3.0434782608695654
        },
        "p_het": 0.8828117188281172,
        "mdd80": 2.7247353457896764,
        "shift_vs_primary": -0.16890218436464988,
        "q_sub": 0.029997000299970003,
        "label_sub": "below_detected",
        "label_primary": "below_detected",
        "label_changed": false
       },
       "jqs_f_r60_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.0,
        "ci95": [
         -1.7142857159770768,
         1.7191977094414077
        ],
        "p": 1.0,
        "n_items": 1387,
        "mean_a": 88.10382119682768,
        "mean_b": 88.10382119682768,
        "per_seed": {
         "42": 0.43478260869565216,
         "43": 0.8620689655172413,
         "44": -1.2958963282937366
        },
        "p_het": 0.5993400659934006,
        "mdd80": 2.4539217269203166,
        "shift_vs_primary": 0.20066889632107024,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r60_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.1552346570397112,
        "ci95": [
         -2.9329608955689626,
         0.602409640384161
        ],
        "p": 0.2273772622737726,
        "n_items": 1385,
        "mean_a": 88.08664259927798,
        "mean_b": 89.2418772563177,
        "per_seed": {
         "42": -1.9522776572668112,
         "43": -0.4319654427645788,
         "44": -1.0845986984815619
        },
        "p_het": 0.7672232776722328,
        "mdd80": 2.5267407748828417,
        "shift_vs_primary": -0.016587637615732564,
        "q_sub": 0.6962341740509495,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.7199424046076314,
        "ci95": [
         -2.489019035471154,
         1.0542168693205674
        ],
        "p": 0.47735226477352266,
        "n_items": 1389,
        "mean_a": 87.40100791936645,
        "mean_b": 88.12095032397409,
        "per_seed": {
         "42": -0.6507592190889371,
         "43": -0.43103448275862066,
         "44": -1.0775862068965518
        },
        "p_het": 0.9618038196180382,
        "mdd80": 2.5323621794716593,
        "shift_vs_primary": 0.014860534604125508,
        "q_sub": 0.9165163483651635,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.8037518037518037,
        "ci95": [
         -3.4795764011461157,
         -0.14367815926705416
        ],
        "p": 0.0413958604139586,
        "n_items": 1386,
        "mean_a": 87.44588744588745,
        "mean_b": 89.24963924963924,
        "per_seed": {
         "42": -2.819956616052061,
         "43": -1.7278617710583153,
         "44": -0.8658008658008658
        },
        "p_het": 0.6402359764023597,
        "mdd80": 2.3841772801173704,
        "shift_vs_primary": -0.1973261009405587,
        "q_sub": 0.40987901209879013,
        "label_sub": "below_nominal",
        "label_primary": "none",
        "label_changed": true
       },
       "jqs_f_u64_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.21613832853025935,
        "ci95": [
         -1.4662756615307937,
         1.903367498048092
        ],
        "p": 0.8696130386961304,
        "n_items": 1388,
        "mean_a": 88.32853025936599,
        "mean_b": 88.11239193083574,
        "per_seed": {
         "42": 1.3043478260869565,
         "43": -0.646551724137931,
         "44": 0.0
        },
        "p_het": 0.6232376762323768,
        "mdd80": 2.4082948821141366,
        "shift_vs_primary": 0.015603569171970588,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -0.8658008658008658,
        "ci95": [
         -2.597402599130297,
         0.8720930250039235
        ],
        "p": 0.3625637436256374,
        "n_items": 1386,
        "mean_a": 88.31168831168831,
        "mean_b": 89.17748917748918,
        "per_seed": {
         "42": -1.0845986984815619,
         "43": -1.9438444924406046,
         "44": 0.4329004329004329
        },
        "p_het": 0.49445055494450557,
        "mdd80": 2.479659762004015,
        "shift_vs_primary": -0.19645682296284706,
        "q_sub": 0.8399160083991601,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.7919366450683946,
        "ci95": [
         -0.7776049783619288,
         2.3809523824942107
        ],
        "p": 0.3718628137186281,
        "n_items": 1389,
        "mean_a": 88.91288696904248,
        "mean_b": 88.12095032397409,
        "per_seed": {
         "42": 0.21691973969631237,
         "43": 1.9396551724137931,
         "44": 0.21551724137931033
        },
        "p_het": 0.6545345465453455,
        "mdd80": 2.257431177954289,
        "shift_vs_primary": 0.19073424025877528,
        "q_sub": 0.8419535404950071,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -0.2886002886002886,
        "ci95": [
         -1.9696969714606245,
         1.3812154712072138
        ],
        "p": 0.8028197180281972,
        "n_items": 1386,
        "mean_a": 88.96103896103897,
        "mean_b": 89.24963924963924,
        "per_seed": {
         "42": -2.1691973969631237,
         "43": 0.4319654427645788,
         "44": 0.8658008658008658
        },
        "p_het": 0.2882711728827117,
        "mdd80": 2.394907978059631,
        "shift_vs_primary": -0.020862671465081084,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.9427609427609428,
        "ci95": [
         -2.7972027991242396,
         0.9222661414780813
        ],
        "p": 0.3608639136086391,
        "n_items": 1485,
        "mean_a": 87.13804713804714,
        "mean_b": 88.08080808080808,
        "per_seed": {
         "42": -2.4340770791075053,
         "43": 0.0,
         "44": -0.40404040404040403
        },
        "p_het": 0.4403559644035596,
        "mdd80": 2.6583165010726284,
        "shift_vs_primary": -0.005679282787716566,
        "q_sub": 0.8399160083991601,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_dense_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.7543859649122806,
        "ci95": [
         -3.5014005620369706,
         1.7761912426557014e-09
        ],
        "p": 0.06009399060093991,
        "n_items": 1482,
        "mean_a": 87.24696356275304,
        "mean_b": 89.00134952766531,
        "per_seed": {
         "42": -4.259634888438134,
         "43": -1.0080645161290323,
         "44": 0.0
        },
        "p_het": 0.07239276072392761,
        "mdd80": 2.502462325748645,
        "shift_vs_primary": -0.010589854918987562,
        "q_sub": 0.4892413984408011,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r40_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -2.22521915037087,
        "ci95": [
         -3.819918146221564,
         -0.6561679774810286
        ],
        "p": 0.006199380061993801,
        "n_items": 1483,
        "mean_a": 85.77208361429534,
        "mean_b": 87.99730276466622,
        "per_seed": {
         "42": -0.6097560975609756,
         "43": -2.620967741935484,
         "44": -3.4343434343434343
        },
        "p_het": 0.3665633436656334,
        "mdd80": 2.261142494571374,
        "shift_vs_primary": -0.013422903722076551,
        "q_sub": 0.11445009345219324,
        "label_sub": "below_nominal",
        "label_primary": "below_nominal",
        "label_changed": false
       },
       "jqs_f_r40_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -3.1060094530722484,
        "ci95": [
         -4.941482446494518,
         -1.285714283791991
        ],
        "p": 0.000999900009999,
        "n_items": 1481,
        "mean_a": 85.82039162727887,
        "mean_b": 88.92640108035111,
        "per_seed": {
         "42": -2.636916835699797,
         "43": -3.6363636363636362,
         "44": -3.0425963488843815
        },
        "p_het": 0.8824117588241176,
        "mdd80": 2.6127893487488985,
        "shift_vs_primary": -0.018761130924597413,
        "q_sub": 0.029997000299970003,
        "label_sub": "below_detected",
        "label_primary": "below_detected",
        "label_changed": false
       },
       "jqs_f_r60_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.2018842530282638,
        "ci95": [
         -1.8705035989031142,
         1.4569536440125535
        ],
        "p": 0.8717128287171283,
        "n_items": 1486,
        "mean_a": 87.81965006729475,
        "mean_b": 88.02153432032301,
        "per_seed": {
         "42": 0.4056795131845842,
         "43": 0.8048289738430584,
         "44": -1.814516129032258
        },
        "p_het": 0.44565543445655437,
        "mdd80": 2.3781444708136066,
        "shift_vs_primary": -0.0012153567071935545,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r60_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.1455525606469004,
        "ci95": [
         -2.8449502151627044,
         0.5494505511710942
        ],
        "p": 0.2111788821117888,
        "n_items": 1484,
        "mean_a": 87.8032345013477,
        "mean_b": 88.94878706199461,
        "per_seed": {
         "42": -1.6194331983805668,
         "43": -0.20161290322580644,
         "44": -1.6194331983805668
        },
        "p_het": 0.7182281771822818,
        "mdd80": 2.4259892238641703,
        "shift_vs_primary": -0.006905541222921752,
        "q_sub": 0.6962341740509495,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.6720430107526881,
        "ci95": [
         -2.346805738259599,
         1.0174418622882007
        ],
        "p": 0.48985101489851013,
        "n_items": 1488,
        "mean_a": 87.36559139784946,
        "mean_b": 88.03763440860214,
        "per_seed": {
         "42": -0.4048582995951417,
         "43": -0.6036217303822937,
         "44": -1.0060362173038229
        },
        "p_het": 0.9709029097090291,
        "mdd80": 2.4044386585956996,
        "shift_vs_primary": 0.06275992845906875,
        "q_sub": 0.927535153461398,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.5488215488215489,
        "ci95": [
         -3.166226914510715,
         1.6393369405994105e-09
        ],
        "p": 0.07339266073392661,
        "n_items": 1485,
        "mean_a": 87.4074074074074,
        "mean_b": 88.95622895622895,
        "per_seed": {
         "42": -2.2267206477732793,
         "43": -1.6129032258064515,
         "44": -0.8080808080808081
        },
        "p_het": 0.7601239876012399,
        "mdd80": 2.262912633968382,
        "shift_vs_primary": 0.057604153989696094,
        "q_sub": 0.5337648053376481,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.20174848688634836,
        "ci95": [
         -1.3908205857881089,
         1.7948717963880594
        ],
        "p": 0.8695130486951305,
        "n_items": 1487,
        "mean_a": 88.23133826496301,
        "mean_b": 88.02958977807667,
        "per_seed": {
         "42": 1.4198782961460445,
         "43": -0.6036217303822937,
         "44": -0.2012072434607646
        },
        "p_het": 0.5645435456454354,
        "mdd80": 2.276824665595648,
        "shift_vs_primary": 0.0012137275280595938,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -0.6734006734006734,
        "ci95": [
         -2.362204726051158,
         1.0248901921828235
        ],
        "p": 0.47625237476252374,
        "n_items": 1485,
        "mean_a": 88.21548821548822,
        "mean_b": 88.88888888888889,
        "per_seed": {
         "42": -0.6072874493927125,
         "43": -1.6129032258064515,
         "44": 0.20202020202020202
        },
        "p_het": 0.6539346065393461,
        "mdd80": 2.420767710559927,
        "shift_vs_primary": -0.004056630562654706,
        "q_sub": 0.927535153461398,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.6048387096774194,
        "ci95": [
         -0.9497964737542978,
         2.158273382957767
        ],
        "p": 0.49545045495450457,
        "n_items": 1488,
        "mean_a": 88.64247311827957,
        "mean_b": 88.03763440860214,
        "per_seed": {
         "42": 0.8097165991902834,
         "43": 1.6096579476861168,
         "44": -0.6036217303822937
        },
        "p_het": 0.5640435956404359,
        "mdd80": 2.221347595188188,
        "shift_vs_primary": 0.0036363048678000887,
        "q_sub": 0.927535153461398,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -0.26936026936026936,
        "ci95": [
         -1.9305019320829713,
         1.390820585857207
        ],
        "p": 0.8124187581241876,
        "n_items": 1485,
        "mean_a": 88.68686868686869,
        "mean_b": 88.95622895622895,
        "per_seed": {
         "42": -1.214574898785425,
         "43": 0.4032258064516129,
         "44": 0.0
        },
        "p_het": 0.6970302969703029,
        "mdd80": 2.3737599630001753,
        "shift_vs_primary": -0.0016226522250618602,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "unavailable",
      "why": "unavailable: the route-(i) scan was not validated before the START marker"
     },
     "drop_probed": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.8837525492861998,
        "ci95": [
         -2.713178296306176,
         0.9472259828751176
        ],
        "p": 0.3892610738926107,
        "n_items": 1471,
        "mean_a": 87.28755948334467,
        "mean_b": 88.17131203263087,
        "per_seed": {
         "42": -2.4193548387096775,
         "43": 0.0,
         "44": -0.21052631578947367
        },
        "p_het": 0.41315868413158685,
        "mdd80": 2.616102796214978,
        "shift_vs_primary": 0.05332911068702639,
        "q_sub": 0.882847495067007,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_dense_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.4986376021798364,
        "ci95": [
         -3.24324324496982,
         0.26845637757421215
        ],
        "p": 0.1095890410958904,
        "n_items": 1468,
        "mean_a": 87.39782016348774,
        "mean_b": 88.89645776566758,
        "per_seed": {
         "42": -4.233870967741935,
         "43": -1.002004008016032,
         "44": 0.8456659619450317
        },
        "p_het": 0.029997000299970003,
        "mdd80": 2.5098230963874113,
        "shift_vs_primary": 0.2451585078134566,
        "q_sub": 0.5611353758241198,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out": [
       [
        44,
        252
       ],
       [
        44,
        253
       ],
       [
        44,
        254
       ],
       [
        44,
        255
       ],
       [
        44,
        256
       ],
       [
        44,
        257
       ],
       [
        44,
        258
       ],
       [
        44,
        259
       ],
       [
        44,
        263
       ],
       [
        44,
        267
       ],
       [
        44,
        271
       ],
       [
        44,
        272
       ],
       [
        44,
        273
       ],
       [
        44,
        274
       ],
       [
        44,
        275
       ],
       [
        44,
        276
       ],
       [
        44,
        281
       ],
       [
        44,
        298
       ],
       [
        44,
        303
       ],
       [
        44,
        308
       ],
       [
        44,
        310
       ],
       [
        44,
        311
       ],
       [
        44,
        312
       ]
      ],
      "applies_to": [
       "jqs_f_dense_sxs|loki_k25_d25_s1_sxs",
       "jqs_f_dense_sxs|sparq_c8_s1_sxs"
      ],
      "not_applicable": [
       "jqs_f_r40_sxs|loki_k25_d25_s1_sxs",
       "jqs_f_r40_sxs|sparq_c8_s1_sxs",
       "jqs_f_r60_sxs|loki_k25_d25_s1_sxs",
       "jqs_f_r60_sxs|sparq_c8_s1_sxs",
       "jqs_f_u32_sxs|loki_k25_d25_s1_sxs",
       "jqs_f_u32_sxs|sparq_c8_s1_sxs",
       "jqs_f_u64_sxs|loki_k25_d25_s1_sxs",
       "jqs_f_u64_sxs|sparq_c8_s1_sxs",
       "jqs_f_u128_sxs|loki_k25_d25_s1_sxs",
       "jqs_f_u128_sxs|sparq_c8_s1_sxs"
      ]
     },
     "by_period_stack": {
      "status": "unavailable",
      "why": "Final registered stack record and split inputs were not completed."
     },
     "zero_as_failure": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.9333333333333333,
        "ci95": [
         -2.754820938520446,
         0.8974358991959022
        ],
        "p": 0.3595640435956404,
        "n_items": 1500,
        "mean_a": 87.0,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -2.2,
         "43": 0.0,
         "44": -0.6
        },
        "p_het": 0.5533446655334466,
        "mdd80": 2.6102797934063346,
        "shift_vs_primary": 0.003748326639892885,
        "q_sub": 0.8378191307082883,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_dense_sxs": 4,
         "loki_k25_d25_s1_sxs": 3
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "pairs_restored": 6
       },
       "jqs_f_dense_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.6666666666666667,
        "ci95": [
         -3.4255599490339037,
         0.1312335975645191
        ],
        "p": 0.07689231076892311,
        "n_items": 1500,
        "mean_a": 87.0,
        "mean_b": 88.66666666666667,
        "per_seed": {
         "42": -4.0,
         "43": -1.0,
         "44": 0.0
        },
        "p_het": 0.09969003099690031,
        "mdd80": 2.542051869990906,
        "shift_vs_primary": 0.0771294433266263,
        "q_sub": 0.5684003028268602,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_dense_sxs": 4,
         "sparq_c8_s1_sxs": 5
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "pairs_restored": 9
       },
       "jqs_f_r40_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -2.466666666666667,
        "ci95": [
         -4.06162465153068,
         -0.8739076139914326
        ],
        "p": 0.0028997100289971,
        "n_items": 1500,
        "mean_a": 85.46666666666667,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -0.8,
         "43": -2.8,
         "44": -3.8
        },
        "p_het": 0.33256674332566744,
        "mdd80": 2.2782716933425142,
        "shift_vs_primary": -0.2548704200178733,
        "q_sub": 0.06326640063266399,
        "label_sub": "below_detected",
        "label_primary": "below_nominal",
        "label_changed": true,
        "zero_token_rows": {
         "jqs_f_r40_sxs": 6,
         "loki_k25_d25_s1_sxs": 3
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "pairs_restored": 8
       },
       "jqs_f_r40_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -3.2,
        "ci95": [
         -5.026455028261244,
         -1.3784461135768442
        ],
        "p": 0.0007999200079992001,
        "n_items": 1500,
        "mean_a": 85.46666666666667,
        "mean_b": 88.66666666666667,
        "per_seed": {
         "42": -2.6,
         "43": -3.8,
         "44": -3.2
        },
        "p_het": 0.8446155384461553,
        "mdd80": 2.6072437890542495,
        "shift_vs_primary": -0.11275167785234919,
        "q_sub": 0.023997600239976005,
        "label_sub": "below_detected",
        "label_primary": "below_detected",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r40_sxs": 6,
         "sparq_c8_s1_sxs": 5
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "pairs_restored": 10
       },
       "jqs_f_r60_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.26666666666666666,
        "ci95": [
         -1.9283746573577405,
         1.3888888904560241
        ],
        "p": 0.8122187781221878,
        "n_items": 1500,
        "mean_a": 87.66666666666667,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": 0.4,
         "43": 0.8,
         "44": -2.0
        },
        "p_het": 0.3768623137686231,
        "mdd80": 2.370859003901789,
        "shift_vs_primary": -0.06599777034559642,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r60_sxs": 3,
         "loki_k25_d25_s1_sxs": 3
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "pairs_restored": 5
       },
       "jqs_f_r60_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.0,
        "ci95": [
         -2.7131782962312276,
         0.7032348822414742
        ],
        "p": 0.28217178282171784,
        "n_items": 1500,
        "mean_a": 87.66666666666667,
        "mean_b": 88.66666666666667,
        "per_seed": {
         "42": -1.4,
         "43": -0.2,
         "44": -1.4
        },
        "p_het": 0.81991800819918,
        "mdd80": 2.4417215661290803,
        "shift_vs_primary": 0.1386470194239786,
        "q_sub": 0.752458087524581,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r60_sxs": 3,
         "sparq_c8_s1_sxs": 5
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "pairs_restored": 7
       },
       "jqs_f_u32_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": -0.6,
        "ci95": [
         -2.240896360264087,
         1.0666666683272694
        ],
        "p": 0.5365463453654634,
        "n_items": 1500,
        "mean_a": 87.33333333333333,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -0.2,
         "43": -0.6,
         "44": -1.0
        },
        "p_het": 0.939006099390061,
        "mdd80": 2.3639260113886897,
        "shift_vs_primary": 0.1348029392117569,
        "q_sub": 0.9733928567927521,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u32_sxs": 1,
         "loki_k25_d25_s1_sxs": 3
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "pairs_restored": 3
       },
       "jqs_f_u32_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -1.3333333333333333,
        "ci95": [
         -2.956989248943497,
         0.27662517455991675
        ],
        "p": 0.1311868813118688,
        "n_items": 1500,
        "mean_a": 87.33333333333333,
        "mean_b": 88.66666666666667,
        "per_seed": {
         "42": -2.0,
         "43": -1.6,
         "44": -0.4
        },
        "p_het": 0.6988301169883012,
        "mdd80": 2.3110747037757413,
        "shift_vs_primary": 0.2730923694779117,
        "q_sub": 0.5940538021669531,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u32_sxs": 1,
         "sparq_c8_s1_sxs": 5
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "pairs_restored": 6
       },
       "jqs_f_u64_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.2,
        "ci95": [
         -1.3888888903932093,
         1.7879948929601395
        ],
        "p": 0.8711128887111289,
        "n_items": 1500,
        "mean_a": 88.13333333333334,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": 1.4,
         "43": -0.6,
         "44": -0.2
        },
        "p_het": 0.5993400659934006,
        "mdd80": 2.270529131481512,
        "shift_vs_primary": -0.0005347593582887555,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u64_sxs": 1,
         "loki_k25_d25_s1_sxs": 3
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "pairs_restored": 4
       },
       "jqs_f_u64_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -0.5333333333333333,
        "ci95": [
         -2.2222222237790987,
         1.1627906993173558
        ],
        "p": 0.5835416458354165,
        "n_items": 1500,
        "mean_a": 88.13333333333334,
        "mean_b": 88.66666666666667,
        "per_seed": {
         "42": -0.4,
         "43": -1.6,
         "44": 0.4
        },
        "p_het": 0.5946405359464053,
        "mdd80": 2.4192797018905106,
        "shift_vs_primary": 0.1360107095046854,
        "q_sub": 0.9733928567927521,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u64_sxs": 1,
         "sparq_c8_s1_sxs": 5
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "pairs_restored": 6
       },
       "jqs_f_u128_sxs|loki_k25_d25_s1_sxs": {
        "status": "complete",
        "delta": 0.6666666666666666,
        "ci95": [
         -0.8674101625132884,
         2.2049286655666225
        ],
        "p": 0.44325567443255676,
        "n_items": 1500,
        "mean_a": 88.6,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": 1.0,
         "43": 1.6,
         "44": -0.6
        },
        "p_het": 0.5615438456154385,
        "mdd80": 2.1958105132740764,
        "shift_vs_primary": 0.06546426185704735,
        "q_sub": 0.9000108392522091,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u128_sxs": 1,
         "loki_k25_d25_s1_sxs": 3
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "loki_k25_d25_s1_sxs": 0
        },
        "pairs_restored": 3
       },
       "jqs_f_u128_sxs|sparq_c8_s1_sxs": {
        "status": "complete",
        "delta": -0.06666666666666667,
        "ci95": [
         -1.7333333349972513,
         1.600000001663918
        ],
        "p": 1.0,
        "n_items": 1500,
        "mean_a": 88.6,
        "mean_b": 88.66666666666667,
        "per_seed": {
         "42": -0.8,
         "43": 0.6,
         "44": 0.0
        },
        "p_het": 0.8003199680031997,
        "mdd80": 2.3823441340491294,
        "shift_vs_primary": 0.20107095046854084,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u128_sxs": 1,
         "sparq_c8_s1_sxs": 5
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "sparq_c8_s1_sxs": 0
        },
        "pairs_restored": 6
       }
      },
      "other_label_changes": [],
      "rule": "the addendum v2's zero_token_as_failure: every (seed, instance) an item, no pair dropped; a zero-token row (tokens == 0, whatever its resolved field) or a missing row scores 0 on its side; same test and seed tuple as the contrast; the label its p gets substituted into the family's BH; never decides",
      "items_total": 1500
     }
    }
   },
   "H12": {
    "title": "H12 head to head: Jet-QSparse final arm minus FP8 KV / BLASST t50 (descriptive)",
    "seed_tuple": [
     20261024,
     28,
     0,
     1
    ],
    "specs": [
     [
      "jqs_f_dense_sxs",
      "fp8kv_s1_sxs"
     ],
     [
      "jqs_f_dense_sxs",
      "blasst_t50_s1_sxs"
     ],
     [
      "jqs_f_r40_sxs",
      "fp8kv_s1_sxs"
     ],
     [
      "jqs_f_r40_sxs",
      "blasst_t50_s1_sxs"
     ],
     [
      "jqs_f_r60_sxs",
      "fp8kv_s1_sxs"
     ],
     [
      "jqs_f_r60_sxs",
      "blasst_t50_s1_sxs"
     ],
     [
      "jqs_f_u32_sxs",
      "fp8kv_s1_sxs"
     ],
     [
      "jqs_f_u32_sxs",
      "blasst_t50_s1_sxs"
     ],
     [
      "jqs_f_u64_sxs",
      "fp8kv_s1_sxs"
     ],
     [
      "jqs_f_u64_sxs",
      "blasst_t50_s1_sxs"
     ],
     [
      "jqs_f_u128_sxs",
      "fp8kv_s1_sxs"
     ],
     [
      "jqs_f_u128_sxs",
      "blasst_t50_s1_sxs"
     ]
    ],
    "replaces": [
     [
      "jqs_f_dense",
      "fp8kv_s1"
     ],
     [
      "jqs_f_dense",
      "blasst_t50_s1"
     ],
     [
      "jqs_f_r40",
      "fp8kv_s1"
     ],
     [
      "jqs_f_r40",
      "blasst_t50_s1"
     ],
     [
      "jqs_f_r60",
      "fp8kv_s1"
     ],
     [
      "jqs_f_r60",
      "blasst_t50_s1"
     ],
     [
      "jqs_f_u32",
      "fp8kv_s1"
     ],
     [
      "jqs_f_u32",
      "blasst_t50_s1"
     ],
     [
      "jqs_f_u64",
      "fp8kv_s1"
     ],
     [
      "jqs_f_u64",
      "blasst_t50_s1"
     ],
     [
      "jqs_f_u128",
      "fp8kv_s1"
     ],
     [
      "jqs_f_u128",
      "blasst_t50_s1"
     ]
    ],
    "family_m_registered": 240,
    "m": 240,
    "status": "ARCHIVAL ONLY; integrity gate failed; not used in main comparison",
    "removed": [],
    "members": [
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 31,
      "mean_a": 90.57239057239057,
      "mean_b": 90.06734006734007,
      "delta": 0.5050505050505051,
      "ci95": [
       -1.2500000021690236,
       2.247191013172675
      ],
      "p": 0.706029397060294,
      "mid_p": 0.58005,
      "per_seed": {
       "42": -2.0202020202020203,
       "43": 0.0,
       "44": 3.5353535353535355
      },
      "p_het": null,
      "mdd80": 2.4994537478192527,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9159300286187597,
      "label_source": "none",
      "q": 0.9259401928659593,
      "label": "none",
      "q_prev": 0.9110056736261857,
      "label_prev": "none",
      "q_published": 0.9159300286187597,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 98.68055555555556,
      "mean_b": 98.61111111111111,
      "delta": 0.06944444444444445,
      "ci95": [
       -1.0416666683450153,
       1.3392857156577689
      ],
      "p": 1.0,
      "mid_p": 0.9516,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -0.4166666666666667,
       "44": 1.0416666666666667
      },
      "p_het": null,
      "mdd80": 1.701674381944929,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.70)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 86.63729809104258,
      "mean_b": 86.34361233480176,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.4306151661936264,
       2.020202021894061
      ],
      "p": 0.8011198880111989,
      "mid_p": 0.74125,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": 0.22026431718061673,
       "44": -0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.466310223252741,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.47)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 24,
      "b_only": 17,
      "mean_a": 75.65543071161049,
      "mean_b": 73.03370786516854,
      "rate_a": 75.65543071161049,
      "rate_b": 73.03370786516854,
      "delta": 2.6217228464419478,
      "ci95": [
       -1.8018018071207735,
       7.142857147636252
      ],
      "p": 0.34106589341065896,
      "mid_p": 0.2684,
      "per_seed": {
       "42": 1.1235955056179776,
       "43": 4.49438202247191,
       "44": 2.247191011235955
      },
      "p_het": 0.8937106289371063,
      "mdd80": 6.392776731198392,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6709492985127717,
      "label_source": "none",
      "q": 0.7117896905961578,
      "label": "none",
      "q_prev": 0.6709492985127717,
      "label_prev": "none",
      "q_published": 0.7355348381245792,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.39)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_dense_sxs",
      "b": "fp8kv_s1_sxs",
      "n_items": 1489,
      "n_clusters": 500,
      "n_diff_items": 142,
      "a_only": 64,
      "b_only": 78,
      "mean_a": 87.30691739422431,
      "mean_b": 88.24714573539288,
      "rate_a": 87.0,
      "rate_b": 87.73333333333333,
      "delta": -0.9402283411685695,
      "ci95": [
       -2.628120895207252,
       0.7643312118031118
      ],
      "p": 0.3174682531746825,
      "mid_p": 0.28175,
      "per_seed": {
       "42": -2.4193548387096775,
       "43": -1.0,
       "44": 0.6085192697768763
      },
      "p_het": 0.27787221277872215,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "fp8kv_s1_sxs"
      ],
      "row_arm": "jqs_f_dense",
      "source": "sxs",
      "replaces": [
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final dense NVFP4 (sxs) vs FP8 KV (sxs)",
      "mdd80": 2.424596510733027,
      "se": 0.859149674528571,
      "ci95_bootstrap": [
       -2.61744966442953,
       0.739756897146286
      ],
      "q": 0.6802891139457482,
      "label": "none",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.42)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 30,
      "mean_a": 89.05723905723906,
      "mean_b": 90.06734006734007,
      "delta": -1.0101010101010102,
      "ci95": [
       -2.8070175457262456,
       0.7246376830256971
      ],
      "p": 0.3668633136686331,
      "mid_p": 0.2828,
      "per_seed": {
       "42": -2.525252525252525,
       "43": -2.525252525252525,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 2.5240854327904154,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6946077045838723,
      "label_source": "none",
      "q": 0.7290510618359651,
      "label": "none",
      "q_prev": 0.6891810818918108,
      "label_prev": "none",
      "q_published": 0.6946077045838723,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.52)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 14,
      "mean_a": 98.88888888888889,
      "mean_b": 98.61111111111111,
      "delta": 0.2777777777777778,
      "ci95": [
       -0.6410256420955488,
       1.2500000009792784
      ],
      "p": 0.6959304069593041,
      "mid_p": 0.6054,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": 0.8333333333333334,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.351522153085446,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9125609178212614,
      "label_source": "none",
      "q": 0.9225890597753411,
      "label": "none",
      "q_prev": 0.9076281561033085,
      "label_prev": "none",
      "q_published": 0.9125609178212614,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.35)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 162,
      "mean_a": 86.63729809104258,
      "mean_b": 86.34361233480176,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.4084507060375482,
       1.996927805159007
      ],
      "p": 0.8017198280171983,
      "mid_p": 0.73805,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": -0.22026431718061673,
       "44": 0.6607929515418502
      },
      "p_het": null,
      "mdd80": 2.43383505368,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.43)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 21,
      "b_only": 30,
      "mean_a": 69.66292134831461,
      "mean_b": 73.03370786516854,
      "rate_a": 69.66292134831461,
      "rate_b": 73.03370786516854,
      "delta": -3.3707865168539324,
      "ci95": [
       -9.30232558751522,
       2.5000000065286776
      ],
      "p": 0.3164683531646835,
      "mid_p": 0.2641,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -2.247191011235955,
       "44": -4.49438202247191
      },
      "p_het": 0.9832016798320168,
      "mdd80": 8.435160335711267,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6382555021808743,
      "label_source": "none",
      "q": 0.6802891139457482,
      "label": "none",
      "q_prev": 0.6382555021808743,
      "label_prev": "none",
      "q_published": 0.5849690260331765,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.44)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r40_sxs",
      "b": "fp8kv_s1_sxs",
      "n_items": 1487,
      "n_clusters": 500,
      "n_diff_items": 142,
      "a_only": 54,
      "b_only": 88,
      "mean_a": 85.94485541358439,
      "mean_b": 88.23133826496301,
      "rate_a": 85.46666666666665,
      "rate_b": 87.73333333333333,
      "delta": -2.2864828513786146,
      "ci95": [
       -3.9011703526668753,
       -0.6702412852553612
      ],
      "p": 0.006199380061993801,
      "mid_p": 0.0043,
      "per_seed": {
       "42": -0.8080808080808081,
       "43": -3.8076152304609217,
       "44": -2.231237322515213
      },
      "p_het": 0.30556944305569445,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "fp8kv_s1_sxs"
      ],
      "row_arm": "jqs_f_r40",
      "source": "sxs",
      "replaces": [
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final rho 0.40 (sxs) vs FP8 KV (sxs)",
      "mdd80": 2.3091554710776463,
      "se": 0.8082458794595728,
      "ci95_bootstrap": [
       -3.9030955585464335,
       -0.7377598926894702
      ],
      "q": 0.12398760123987601,
      "label": "below_nominal",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "below, nominal (p 0.00620, q 0.124)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 29,
      "mean_a": 89.8989898989899,
      "mean_b": 90.06734006734007,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.2875817014010305,
       1.9607843157877007
      ],
      "p": 1.0,
      "mid_p": 0.8767,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": -1.5151515151515151,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 3.0363209550716577,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.04)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 98.88888888888889,
      "mean_b": 98.61111111111111,
      "delta": 0.2777777777777778,
      "ci95": [
       -0.6250000013685741,
       1.2820512832222646
      ],
      "p": 0.7732226777322267,
      "mid_p": 0.68045,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": 0.4166666666666667,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.3629757309920245,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9419971708412915,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9419971708412915,
      "label_prev": "none",
      "q_published": 0.9419971708412915,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.36)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 147,
      "mean_a": 87.88546255506608,
      "mean_b": 86.34361233480176,
      "delta": 1.5418502202643172,
      "ci95": [
       -0.4132231423235401,
       3.4591194989021705
      ],
      "p": 0.134986501349865,
      "mid_p": 0.1181,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": 0.8810572687224669,
       "44": 2.202643171806167
      },
      "p_het": null,
      "mdd80": 2.767575830142704,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.4377940584319946,
      "label_source": "none",
      "q": 0.4984116972918092,
      "label": "none",
      "q_prev": 0.43195680431956796,
      "label_prev": "none",
      "q_published": 0.4377940584319946,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.77)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 45,
      "a_only": 24,
      "b_only": 21,
      "mean_a": 74.15730337078652,
      "mean_b": 73.03370786516854,
      "rate_a": 74.15730337078651,
      "rate_b": 73.03370786516854,
      "delta": 1.1235955056179776,
      "ci95": [
       -4.761904768141509,
       6.976744192084176
      ],
      "p": 0.802019798020198,
      "mid_p": 0.71015,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 2.247191011235955,
       "44": 3.3707865168539324
      },
      "p_het": 0.6594340565943405,
      "mdd80": 8.389650439240858,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.9420507224639855,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.986290511220371,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.39)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r60_sxs",
      "b": "fp8kv_s1_sxs",
      "n_items": 1490,
      "n_clusters": 500,
      "n_diff_items": 150,
      "a_only": 74,
      "b_only": 76,
      "mean_a": 88.05369127516778,
      "mean_b": 88.18791946308725,
      "rate_a": 87.66666666666667,
      "rate_b": 87.73333333333333,
      "delta": -0.1342281879194631,
      "ci95": [
       -1.797175868079991,
       1.5299026442824113
      ],
      "p": 0.9399060093990601,
      "mid_p": 0.8755,
      "per_seed": {
       "42": 0.4032258064516129,
       "43": -0.2,
       "44": -0.6072874493927125
      },
      "p_het": 0.859014098590141,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "fp8kv_s1_sxs"
      ],
      "row_arm": "jqs_f_r60",
      "source": "sxs",
      "replaces": [
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final rho 0.60 (sxs) vs FP8 KV (sxs)",
      "mdd80": 2.37787379086029,
      "se": 0.8484488559084858,
      "ci95_bootstrap": [
       -1.8741633199464525,
       1.5405482510877386
      ],
      "q": 1.0,
      "label": "none",
      "q_prev": 0.005537907747686769,
      "label_prev": "below_detected",
      "q_published": 0.005537907747686769,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.38)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 32,
      "mean_a": 91.07744107744108,
      "mean_b": 90.06734006734007,
      "delta": 1.0101010101010102,
      "ci95": [
       -0.7092198599635171,
       2.77777777939814
      ],
      "p": 0.35356464353564643,
      "mid_p": 0.2729,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 1.0101010101010102,
       "44": 3.5353535353535355
      },
      "p_het": null,
      "mdd80": 2.4921685089848635,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6898822312890662,
      "label_source": "none",
      "q": 0.725260807252608,
      "label": "none",
      "q_prev": 0.6843186649077028,
      "label_prev": "none",
      "q_published": 0.6898822312890662,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.49)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 13,
      "mean_a": 99.02777777777777,
      "mean_b": 98.61111111111111,
      "delta": 0.4166666666666667,
      "ci95": [
       -0.5555555565370287,
       1.458333334911528
      ],
      "p": 0.5822417758224178,
      "mid_p": 0.50175,
      "per_seed": {
       "42": 0.625,
       "43": 0.8333333333333334,
       "44": -0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.4393329147137925,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8468971284689712,
      "label_source": "none",
      "q": 0.8788555106753476,
      "label": "none",
      "q_prev": 0.8520611353498797,
      "label_prev": "none",
      "q_published": 0.8468971284689712,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.44)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 135,
      "mean_a": 88.91336270190895,
      "mean_b": 86.34361233480176,
      "delta": 2.5697503671071953,
      "ci95": [
       0.8888888871991723,
       4.269972453385995
      ],
      "p": 0.0034996500349965005,
      "mid_p": 0.0026,
      "per_seed": {
       "42": 2.202643171806167,
       "43": 2.643171806167401,
       "44": 2.8634361233480177
      },
      "p_het": null,
      "mdd80": 2.41647137777804,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.03817800038178001,
      "label_source": "above_detected",
      "q": 0.08399160083991601,
      "label": "above_detected",
      "q_prev": 0.03817800038178001,
      "label_prev": "above_detected",
      "q_published": 0.03817800038178001,
      "label_published": "above_detected",
      "changed": false,
      "text": "above, detected (p 0.00350, q 0.0840)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 22,
      "b_only": 22,
      "mean_a": 73.03370786516854,
      "mean_b": 73.03370786516854,
      "rate_a": 73.03370786516854,
      "rate_b": 73.03370786516854,
      "delta": 0.0,
      "ci95": [
       -4.87804878576666,
       4.87804878576666
      ],
      "p": 1.0,
      "mid_p": 0.94065,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 0.0,
       "44": 2.247191011235955
      },
      "p_het": 0.791020897910209,
      "mdd80": 6.972714539264794,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.97)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u32_sxs",
      "b": "fp8kv_s1_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 159,
      "a_only": 74,
      "b_only": 85,
      "mean_a": 87.46648793565684,
      "mean_b": 88.20375335120643,
      "rate_a": 87.33333333333333,
      "rate_b": 87.73333333333333,
      "delta": -0.7372654155495979,
      "ci95": [
       -2.4827586224787863,
       1.0012515660769123
      ],
      "p": 0.45915408459154083,
      "mid_p": 0.41365,
      "per_seed": {
       "42": -0.8048289738430584,
       "43": -1.6,
       "44": 0.20202020202020202
      },
      "p_het": 0.6796320367963203,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "fp8kv_s1_sxs"
      ],
      "row_arm": "jqs_f_u32",
      "source": "sxs",
      "replaces": [
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final N = 32 (sxs) vs FP8 KV (sxs)",
      "mdd80": 2.490033368215994,
      "se": 0.8843802158741461,
      "ci95_bootstrap": [
       -2.4882731994920535,
       0.9383535349721203
      ],
      "q": 0.7871212878712128,
      "label": "none",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.49)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 27,
      "mean_a": 90.9090909090909,
      "mean_b": 90.06734006734007,
      "delta": 0.8417508417508418,
      "ci95": [
       -0.9803921586279369,
       2.614379086688201
      ],
      "p": 0.46605339466053397,
      "mid_p": 0.36975,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 2.0202020202020203,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 2.5691946542932578,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.760903501486586,
      "label_source": "none",
      "q": 0.7876958782994941,
      "label": "none",
      "q_prev": 0.7557622616116767,
      "label_prev": "none",
      "q_published": 0.760903501486586,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.57)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 17,
      "mean_a": 98.26388888888889,
      "mean_b": 98.61111111111111,
      "delta": -0.3472222222222222,
      "ci95": [
       -1.1217948726998581,
       0.44642857228935084
      ],
      "p": 0.48875112488751127,
      "mid_p": 0.3945,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": 0.20833333333333334,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.120814376395542,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7906409359064094,
      "label_source": "none",
      "q": 0.8179044164549062,
      "label": "none",
      "q_prev": 0.7854049032182875,
      "label_prev": "none",
      "q_published": 0.7906409359064094,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.12)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 148,
      "mean_a": 88.54625550660793,
      "mean_b": 86.34361233480176,
      "delta": 2.202643171806167,
      "ci95": [
       0.41841004015202005,
       4.025764897327495
      ],
      "p": 0.020597940205979402,
      "mid_p": 0.0172,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": 0.8810572687224669,
       "44": 4.845814977973569
      },
      "p_het": null,
      "mdd80": 2.578188202453752,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.18309280183092802,
      "label_source": "above_nominal",
      "q": 0.28530480285304805,
      "label": "above_nominal",
      "q_prev": 0.18309280183092802,
      "label_prev": "above_nominal",
      "q_published": 0.18309280183092802,
      "label_published": "above_nominal",
      "changed": false,
      "text": "above, nominal (p 0.0206, q 0.29)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 48,
      "a_only": 22,
      "b_only": 26,
      "mean_a": 71.53558052434457,
      "mean_b": 73.03370786516854,
      "rate_a": 71.53558052434458,
      "rate_b": 73.03370786516854,
      "delta": -1.4981273408239701,
      "ci95": [
       -6.666666672412885,
       3.70370371011517
      ],
      "p": 0.677032296770323,
      "mid_p": 0.584,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": -2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 1.0,
      "mdd80": 7.411737307220248,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.9014922683555819,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.41)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u64_sxs",
      "b": "fp8kv_s1_sxs",
      "n_items": 1491,
      "n_clusters": 500,
      "n_diff_items": 146,
      "a_only": 74,
      "b_only": 72,
      "mean_a": 88.32997987927565,
      "mean_b": 88.19584171696847,
      "rate_a": 88.13333333333333,
      "rate_b": 87.73333333333333,
      "delta": 0.1341381623071764,
      "ci95": [
       -1.4531043608732763,
       1.7127799751950903
      ],
      "p": 0.9388061193880612,
      "mid_p": 0.87225,
      "per_seed": {
       "42": 1.4112903225806452,
       "43": -1.6,
       "44": 0.6060606060606061
      },
      "p_het": 0.2836716328367163,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "fp8kv_s1_sxs"
      ],
      "row_arm": "jqs_f_u64",
      "source": "sxs",
      "replaces": [
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final N = 64 (sxs) vs FP8 KV (sxs)",
      "mdd80": 2.2626677908742128,
      "se": 0.8167248745738697,
      "ci95_bootstrap": [
       -1.4755445424223192,
       1.743796109993293
      ],
      "q": 1.0,
      "label": "none",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.26)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 30,
      "mean_a": 90.74074074074075,
      "mean_b": 90.06734006734007,
      "delta": 0.6734006734006734,
      "ci95": [
       -1.0638297890615864,
       2.430555557362807
      ],
      "p": 0.5794420557944205,
      "mid_p": 0.46605,
      "per_seed": {
       "42": 0.0,
       "43": 0.0,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 2.497448527155087,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8468971284689712,
      "label_source": "none",
      "q": 0.8788555106753476,
      "label": "none",
      "q_prev": 0.8520611353498797,
      "label_prev": "none",
      "q_published": 0.8468971284689712,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 98.54166666666667,
      "mean_b": 98.61111111111111,
      "delta": -0.06944444444444445,
      "ci95": [
       -0.946969698179106,
       0.8680555567380064
      ],
      "p": 1.0,
      "mid_p": 0.90185,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": 0.4166666666666667,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.2972044294657774,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.30)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 87.37151248164464,
      "mean_b": 86.34361233480176,
      "delta": 1.0279001468428781,
      "ci95": [
       -0.7309941537920165,
       2.7777777794291225
      ],
      "p": 0.28857114288571145,
      "mid_p": 0.257,
      "per_seed": {
       "42": 1.7621145374449338,
       "43": -0.44052863436123346,
       "44": 1.7621145374449338
      },
      "p_het": null,
      "mdd80": 2.5077306673440862,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6230881336645097,
      "label_source": "none",
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.6230881336645097,
      "label_prev": "none",
      "q_published": 0.6230881336645097,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.51)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 38,
      "a_only": 21,
      "b_only": 17,
      "mean_a": 74.53183520599251,
      "mean_b": 73.03370786516854,
      "rate_a": 74.53183520599252,
      "rate_b": 73.03370786516854,
      "delta": 1.4981273408239701,
      "ci95": [
       -2.500000004433745,
       5.555555559845642
      ],
      "p": 0.593040695930407,
      "mid_p": 0.47925,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": 3.3707865168539324,
       "44": -2.247191011235955
      },
      "p_het": 0.585941405859414,
      "mdd80": 5.757331657772511,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.8543431371148598,
      "label_source": "none",
      "q": 0.8805499818116347,
      "label": "none",
      "q_prev": 0.8543431371148598,
      "label_prev": "none",
      "q_published": 0.8492878522798607,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 5.76)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u128_sxs",
      "b": "fp8kv_s1_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 141,
      "a_only": 75,
      "b_only": 66,
      "mean_a": 88.80697050938338,
      "mean_b": 88.20375335120643,
      "rate_a": 88.60000000000001,
      "rate_b": 87.73333333333333,
      "delta": 0.6032171581769437,
      "ci95": [
       -0.9358288785405651,
       2.153432033855393
      ],
      "p": 0.49935006499350065,
      "mid_p": 0.4463,
      "per_seed": {
       "42": 0.6036217303822937,
       "43": 0.6,
       "44": 0.6060606060606061
      },
      "p_het": 0.9943005699430058,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "fp8kv_s1_sxs"
      ],
      "row_arm": "jqs_f_u128",
      "source": "sxs",
      "replaces": [
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final N = 128 (sxs) vs FP8 KV (sxs)",
      "mdd80": 2.2079047817538684,
      "se": 0.7903027109066882,
      "ci95_bootstrap": [
       -0.938337801608579,
       2.1476510067114094
      ],
      "q": 0.8208494219071243,
      "label": "none",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.21)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 34,
      "mean_a": 90.57239057239057,
      "mean_b": 89.56228956228956,
      "delta": 1.0101010101010102,
      "ci95": [
       -0.9523809542273107,
       2.941176472460234
      ],
      "p": 0.4106589341065893,
      "mid_p": 0.32435,
      "per_seed": {
       "42": 0.0,
       "43": 0.5050505050505051,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 2.7827381060375997,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.78)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 98.68055555555556,
      "mean_b": 99.09722222222223,
      "delta": -0.4166666666666667,
      "ci95": [
       -1.190476191317107,
       0.3472222231886185
      ],
      "p": 0.40455954404559547,
      "mid_p": 0.32645,
      "per_seed": {
       "42": -0.625,
       "43": -0.8333333333333334,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.098998038223123,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.10)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 135,
      "mean_a": 86.63729809104258,
      "mean_b": 87.59177679882525,
      "delta": -0.9544787077826725,
      "ci95": [
       -2.6234567918730383,
       0.7374631285381836
      ],
      "p": 0.298970102989701,
      "mid_p": 0.2633,
      "per_seed": {
       "42": -1.1013215859030836,
       "43": -0.8810572687224669,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.4020603548220634,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6294107431362126,
      "label_source": "none",
      "q": 0.6769134407313985,
      "label": "none",
      "q_prev": 0.6294107431362126,
      "label_prev": "none",
      "q_published": 0.6294107431362126,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 27,
      "b_only": 16,
      "mean_a": 75.65543071161049,
      "mean_b": 71.53558052434457,
      "rate_a": 75.65543071161049,
      "rate_b": 71.53558052434455,
      "delta": 4.119850187265918,
      "ci95": [
       -0.6802721131886165,
       8.730158735045059
      ],
      "p": 0.10898910108989102,
      "mid_p": 0.0813,
      "per_seed": {
       "42": 2.247191011235955,
       "43": 2.247191011235955,
       "44": 7.865168539325842
      },
      "p_het": 0.6196380361963804,
      "mdd80": 6.7256654123347674,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.40870912908709134,
      "label_source": "none",
      "q": 0.4843960048439601,
      "label": "none",
      "q_prev": 0.40870912908709134,
      "label_prev": "none",
      "q_published": 0.45437561507007196,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.73)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_dense_sxs",
      "b": "blasst_t50_s1_sxs",
      "n_items": 1490,
      "n_clusters": 500,
      "n_diff_items": 149,
      "a_only": 67,
      "b_only": 82,
      "mean_a": 87.38255033557047,
      "mean_b": 88.38926174496645,
      "rate_a": 87.0,
      "rate_b": 87.93333333333334,
      "delta": -1.0067114093959733,
      "ci95": [
       -2.6773761730171515,
       0.6657789630412102
      ],
      "p": 0.2766723327667233,
      "mid_p": 0.24525,
      "per_seed": {
       "42": -3.4343434343434343,
       "43": -1.8036072144288577,
       "44": 2.217741935483871
      },
      "p_het": 0.012698730126987301,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "blasst_t50_s1_sxs"
      ],
      "row_arm": "jqs_f_dense",
      "source": "sxs",
      "replaces": [
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final dense NVFP4 (sxs) vs BLASST t50 (sxs)",
      "mdd80": 2.389363805896034,
      "se": 0.8549623352796674,
      "ci95_bootstrap": [
       -2.680965147453083,
       0.6738544474393531
      ],
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.39)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 23,
      "mean_a": 89.05723905723906,
      "mean_b": 89.56228956228956,
      "delta": -0.5050505050505051,
      "ci95": [
       -1.9417475741921266,
       0.9803921583001559
      ],
      "p": 0.6493350664933507,
      "mid_p": 0.50465,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": -2.0202020202020203,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.088462733087446,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8956345744735872,
      "label_source": "none",
      "q": 0.9113474617450537,
      "label": "none",
      "q_prev": 0.8905166626194525,
      "label_prev": "none",
      "q_published": 0.8956345744735872,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.09)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 98.88888888888889,
      "mean_b": 99.09722222222223,
      "delta": -0.20833333333333334,
      "ci95": [
       -0.7440476196332975,
       0.3676470593399369
      ],
      "p": 0.6655334466553344,
      "mid_p": 0.5161,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": 0.4166666666666667,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 0.7945317883984331,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9064728886227398,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 0.79)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 155,
      "mean_a": 86.63729809104258,
      "mean_b": 87.59177679882525,
      "delta": -0.9544787077826725,
      "ci95": [
       -2.8400597926460938,
       0.9174311946047733
      ],
      "p": 0.3611638836116388,
      "mid_p": 0.32395,
      "per_seed": {
       "42": -1.7621145374449338,
       "43": -1.3215859030837005,
       "44": 0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.6854909809848104,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6946077045838723,
      "label_source": "none",
      "q": 0.7290510618359651,
      "label": "none",
      "q_prev": 0.6891810818918108,
      "label_prev": "none",
      "q_published": 0.6946077045838723,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.69)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 23,
      "b_only": 28,
      "mean_a": 69.66292134831461,
      "mean_b": 71.53558052434457,
      "rate_a": 69.66292134831461,
      "rate_b": 71.53558052434455,
      "delta": -1.8726591760299625,
      "ci95": [
       -7.936507942920649,
       4.255319154719791
      ],
      "p": 0.6319368063193681,
      "mid_p": 0.5511,
      "per_seed": {
       "42": -2.247191011235955,
       "43": -4.49438202247191,
       "44": 1.1235955056179776
      },
      "p_het": 0.6765323467653235,
      "mdd80": 8.713538322122309,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.880836771814148,
      "label_source": "none",
      "q": 0.9016849794310509,
      "label": "none",
      "q_prev": 0.880836771814148,
      "label_prev": "none",
      "q_published": 0.8290635904562411,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.71)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r40_sxs",
      "b": "blasst_t50_s1_sxs",
      "n_items": 1489,
      "n_clusters": 500,
      "n_diff_items": 160,
      "a_only": 63,
      "b_only": 97,
      "mean_a": 86.03089321692411,
      "mean_b": 88.31430490261921,
      "rate_a": 85.46666666666665,
      "rate_b": 87.93333333333334,
      "delta": -2.2834116856950972,
      "ci95": [
       -3.879849813751245,
       -0.6821282384877555
      ],
      "p": 0.005499450054994501,
      "mid_p": 0.00415,
      "per_seed": {
       "42": -1.417004048582996,
       "43": -4.417670682730924,
       "44": -1.0060362173038229
      },
      "p_het": 0.21197880211978803,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "blasst_t50_s1_sxs"
      ],
      "row_arm": "jqs_f_r40",
      "source": "sxs",
      "replaces": [
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final rho 0.40 (sxs) vs BLASST t50 (sxs)",
      "mdd80": 2.285421968863742,
      "se": 0.818663833196885,
      "ci95_bootstrap": [
       -3.895231699126931,
       -0.7357859531772575
      ],
      "q": 0.11998800119988001,
      "label": "below_nominal",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "below, nominal (p 0.00550, q 0.120)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 26,
      "mean_a": 89.8989898989899,
      "mean_b": 89.56228956228956,
      "delta": 0.3367003367003367,
      "ci95": [
       -1.4035087737415823,
       2.105263159738345
      ],
      "p": 0.8488151184881512,
      "mid_p": 0.71165,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -1.0101010101010102,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 2.507730667529043,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.954184955336242,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.9497468857765385,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.51)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 98.88888888888889,
      "mean_b": 99.09722222222223,
      "delta": -0.20833333333333334,
      "ci95": [
       -0.8578431378374853,
       0.4166666676195567
      ],
      "p": 0.6826317368263174,
      "mid_p": 0.54065,
      "per_seed": {
       "42": 0.0,
       "43": 0.0,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 0.9108962867362104,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9064728886227398,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 0.91)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 138,
      "mean_a": 87.88546255506608,
      "mean_b": 87.59177679882525,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.587301588990578,
       2.1739130453332396
      ],
      "p": 0.8125187481251874,
      "mid_p": 0.75285,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -0.22026431718061673,
       "44": 1.7621145374449338
      },
      "p_het": null,
      "mdd80": 2.688152283610607,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.69)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 43,
      "a_only": 25,
      "b_only": 18,
      "mean_a": 74.15730337078652,
      "mean_b": 71.53558052434457,
      "rate_a": 74.15730337078651,
      "rate_b": 71.53558052434455,
      "delta": 2.6217228464419478,
      "ci95": [
       -2.857142864092385,
       8.130081306788803
      ],
      "p": 0.42455754424557546,
      "mid_p": 0.3582,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 0.0,
       "44": 8.98876404494382
      },
      "p_het": 0.15658434156584342,
      "mdd80": 7.8526047080548285,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.722651139141405,
      "label_source": "none",
      "q": 0.7604015717831202,
      "label": "none",
      "q_prev": 0.722651139141405,
      "label_prev": "none",
      "q_published": 0.7987772651306297,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.85)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_r60_sxs",
      "b": "blasst_t50_s1_sxs",
      "n_items": 1491,
      "n_clusters": 500,
      "n_diff_items": 148,
      "a_only": 71,
      "b_only": 77,
      "mean_a": 87.92756539235413,
      "mean_b": 88.32997987927565,
      "rate_a": 87.66666666666667,
      "rate_b": 87.93333333333334,
      "delta": -0.4024144869215292,
      "ci95": [
       -1.9736842120637688,
       1.173402869846177
      ],
      "p": 0.6826317368263174,
      "mid_p": 0.62135,
      "per_seed": {
       "42": -0.6060606060606061,
       "43": -1.002004008016032,
       "44": 0.4024144869215292
      },
      "p_het": 0.7832216778322167,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "blasst_t50_s1_sxs"
      ],
      "row_arm": "jqs_f_r60",
      "source": "sxs",
      "replaces": [
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final rho 0.60 (sxs) vs BLASST t50 (sxs)",
      "mdd80": 2.2492333324334615,
      "se": 0.8023122781989563,
      "ci95_bootstrap": [
       -2.0053475935828877,
       1.2024048096192386
      ],
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.010498950104989501,
      "label_prev": "below_detected",
      "q_published": 0.010498950104989501,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.25)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 33,
      "mean_a": 91.07744107744108,
      "mean_b": 89.56228956228956,
      "delta": 1.5151515151515151,
      "ci95": [
       -0.3236245972374917,
       3.2967032986376905
      ],
      "p": 0.13358664133586642,
      "mid_p": 0.0959,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 1.5151515151515151,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 2.5874600752386074,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.4377940584319946,
      "label_source": "none",
      "q": 0.4984116972918092,
      "label": "none",
      "q_prev": 0.43195680431956796,
      "label_prev": "none",
      "q_published": 0.4377940584319946,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.59)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 13,
      "mean_a": 99.02777777777777,
      "mean_b": 99.09722222222223,
      "delta": -0.06944444444444445,
      "ci95": [
       -0.6944444452380392,
       0.5555555561907548
      ],
      "p": 1.0,
      "mid_p": 0.8104,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": 0.4166666666666667,
       "44": -1.0416666666666667
      },
      "p_het": null,
      "mdd80": 0.8933790503976815,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 0.89)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 130,
      "mean_a": 88.91336270190895,
      "mean_b": 87.59177679882525,
      "delta": 1.3215859030837005,
      "ci95": [
       -0.2936857578560196,
       2.9051987784054623
      ],
      "p": 0.12988701129887012,
      "mid_p": 0.10945,
      "per_seed": {
       "42": 0.0,
       "43": 1.5418502202643172,
       "44": 2.4229074889867843
      },
      "p_het": null,
      "mdd80": 2.2862531408564206,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.43295670432956707,
      "label_source": "none",
      "q": 0.4948076620909338,
      "label": "none",
      "q_prev": 0.42702579057162776,
      "label_prev": "none",
      "q_published": 0.43295670432956707,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.29)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 22,
      "b_only": 18,
      "mean_a": 73.03370786516854,
      "mean_b": 71.53558052434457,
      "rate_a": 73.03370786516854,
      "rate_b": 71.53558052434455,
      "delta": 1.4981273408239701,
      "ci95": [
       -3.3333333376289955,
       6.34920635433523
      ],
      "p": 0.648035196480352,
      "mid_p": 0.544,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": -2.247191011235955,
       "44": 7.865168539325842
      },
      "p_het": 0.1745825417458254,
      "mdd80": 6.920142484445922,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.8905166626194525,
      "label_source": "none",
      "q": 0.9113474617450537,
      "label": "none",
      "q_prev": 0.8905166626194525,
      "label_prev": "none",
      "q_published": 0.9419971708412915,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.92)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u32_sxs",
      "b": "blasst_t50_s1_sxs",
      "n_items": 1493,
      "n_clusters": 500,
      "n_diff_items": 159,
      "a_only": 72,
      "b_only": 87,
      "mean_a": 87.34092431346282,
      "mean_b": 88.34561286001339,
      "rate_a": 87.33333333333333,
      "rate_b": 87.93333333333334,
      "delta": -1.0046885465505693,
      "ci95": [
       -2.725968437993364,
       0.713266763592325
      ],
      "p": 0.2896710328967103,
      "mid_p": 0.26025,
      "per_seed": {
       "42": -1.814516129032258,
       "43": -2.404809619238477,
       "44": 1.2048192771084338
      },
      "p_het": 0.1501849815018498,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "blasst_t50_s1_sxs"
      ],
      "row_arm": "jqs_f_u32",
      "source": "sxs",
      "replaces": [
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final N = 32 (sxs) vs BLASST t50 (sxs)",
      "mdd80": 2.4580325399799037,
      "se": 0.8716625006445424,
      "ci95_bootstrap": [
       -2.744356528592602,
       0.6753658966672325
      ],
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.46)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 28,
      "mean_a": 90.9090909090909,
      "mean_b": 89.56228956228956,
      "delta": 1.3468013468013469,
      "ci95": [
       -0.3401360561245657,
       3.0030030044740057
      ],
      "p": 0.17678232176782321,
      "mid_p": 0.1251,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.3893523167128454,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5050923479080663,
      "label_source": "none",
      "q": 0.5733480705983456,
      "label": "none",
      "q_prev": 0.5050923479080663,
      "label_prev": "none",
      "q_published": 0.5050923479080663,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.39)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 98.26388888888889,
      "mean_b": 99.09722222222223,
      "delta": -0.8333333333333334,
      "ci95": [
       -1.527777778482818,
       -0.1488095230653292
      ],
      "p": 0.0301969803019698,
      "mid_p": 0.01875,
      "per_seed": {
       "42": -0.625,
       "43": -0.20833333333333334,
       "44": -1.6666666666666667
      },
      "p_het": null,
      "mdd80": 0.985553079316217,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0302, q 0.30)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 88.54625550660793,
      "mean_b": 87.59177679882525,
      "delta": 0.9544787077826725,
      "ci95": [
       -0.8438818582553784,
       2.7417027434531027
      ],
      "p": 0.31326867313268675,
      "mid_p": 0.2763,
      "per_seed": {
       "42": -1.3215859030837005,
       "43": -0.22026431718061673,
       "44": 4.405286343612334
      },
      "p_het": null,
      "mdd80": 2.5626289303467225,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6318023659818893,
      "label_source": "none",
      "q": 0.6802891139457482,
      "label": "none",
      "q_prev": 0.6371566233207189,
      "label_prev": "none",
      "q_published": 0.6318023659818893,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.56)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 46,
      "a_only": 23,
      "b_only": 23,
      "mean_a": 71.53558052434457,
      "mean_b": 71.53558052434457,
      "rate_a": 71.53558052434458,
      "rate_b": 71.53558052434455,
      "delta": 0.0,
      "ci95": [
       -5.263157900901409,
       5.263157900901409
      ],
      "p": 1.0,
      "mid_p": 0.9396,
      "per_seed": {
       "42": 0.0,
       "43": -4.49438202247191,
       "44": 4.49438202247191
      },
      "p_het": 0.3655634436556344,
      "mdd80": 7.523192003561296,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.52)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u64_sxs",
      "b": "blasst_t50_s1_sxs",
      "n_items": 1492,
      "n_clusters": 500,
      "n_diff_items": 148,
      "a_only": 74,
      "b_only": 74,
      "mean_a": 88.33780160857908,
      "mean_b": 88.33780160857908,
      "rate_a": 88.13333333333333,
      "rate_b": 87.93333333333334,
      "delta": 0.0,
      "ci95": [
       -1.7333333350572622,
       1.7356475317617626
      ],
      "p": 1.0,
      "mid_p": 0.96955,
      "per_seed": {
       "42": 0.20202020202020202,
       "43": -2.404809619238477,
       "44": 2.208835341365462
      },
      "p_het": 0.0565943405659434,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "blasst_t50_s1_sxs"
      ],
      "row_arm": "jqs_f_u64",
      "source": "sxs",
      "replaces": [
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final N = 64 (sxs) vs BLASST t50 (sxs)",
      "mdd80": 2.4792918632832874,
      "se": 0.8639901069255157,
      "ci95_bootstrap": [
       -1.6778523489932886,
       1.7356765154697462
      ],
      "q": 1.0,
      "label": "none",
      "q_prev": 0.003999600039996001,
      "label_prev": "below_detected",
      "q_published": 0.003999600039996001,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.48)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 29,
      "mean_a": 90.74074074074075,
      "mean_b": 89.56228956228956,
      "delta": 1.1784511784511784,
      "ci95": [
       -0.33333333482902405,
       2.6217228480444215
      ],
      "p": 0.17278272172782722,
      "mid_p": 0.1198,
      "per_seed": {
       "42": 2.0202020202020203,
       "43": 0.5050505050505051,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 2.1119882268077443,
      "key": [
       "qwen3.8-27b",
       "gpqa",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.4996126893334763,
      "label_source": "none",
      "q": 0.5680527837627196,
      "label": "none",
      "q_prev": 0.4996126893334763,
      "label_prev": "none",
      "q_published": 0.4996126893334763,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.11)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 98.54166666666667,
      "mean_b": 99.09722222222223,
      "delta": -0.5555555555555556,
      "ci95": [
       -1.0416666674105075,
       5.6464347099578e-10
      ],
      "p": 0.059194080591940805,
      "mid_p": 0.0323,
      "per_seed": {
       "42": -1.0416666666666667,
       "43": 0.0,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 0.7444825420822762,
      "key": [
       "qwen3.8-27b",
       "aime25",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.3088386813492564,
      "label_source": "none",
      "q": 0.39462720394627204,
      "label": "none",
      "q_prev": 0.3088386813492564,
      "label_prev": "none",
      "q_published": 0.3088386813492564,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 0.74)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 137,
      "mean_a": 87.37151248164464,
      "mean_b": 87.59177679882525,
      "delta": -0.22026431718061673,
      "ci95": [
       -1.9607843153834497,
       1.515151516775016
      ],
      "p": 0.8752124787521248,
      "mid_p": 0.81205,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": -1.5418502202643172,
       "44": 1.3215859030837005
      },
      "p_het": null,
      "mdd80": 2.4842625995420042,
      "key": [
       "qwen3.8-27b",
       "lcb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9762357097623572,
      "label_source": "none",
      "q": 0.9853594079844353,
      "label": "none",
      "q_prev": 0.9717369276897196,
      "label_prev": "none",
      "q_published": 0.9762357097623572,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.48)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 25,
      "b_only": 17,
      "mean_a": 74.53183520599251,
      "mean_b": 71.53558052434457,
      "rate_a": 74.53183520599252,
      "rate_b": 71.53558052434455,
      "delta": 2.9962546816479403,
      "ci95": [
       -1.7543859704728377,
       7.843137259120084
      ],
      "p": 0.29087091290870914,
      "mid_p": 0.23005,
      "per_seed": {
       "42": 4.49438202247191,
       "43": 1.1235955056179776,
       "44": 3.3707865168539324
      },
      "p_het": 0.8879112088791121,
      "mdd80": 6.859380943378217,
      "key": [
       "qwen3.8-27b",
       "tb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6230881336645097,
      "label_source": "none",
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.6230881336645097,
      "label_prev": "none",
      "q_published": 0.6318023659818893,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.86)"
     },
     {
      "model": "qwen3.8-27b",
      "bench": "swe",
      "a": "jqs_f_u128_sxs",
      "b": "blasst_t50_s1_sxs",
      "n_items": 1493,
      "n_clusters": 500,
      "n_diff_items": 149,
      "a_only": 78,
      "b_only": 71,
      "mean_a": 88.81446751507033,
      "mean_b": 88.34561286001339,
      "rate_a": 88.60000000000001,
      "rate_b": 87.93333333333334,
      "delta": 0.46885465505693236,
      "ci95": [
       -1.2113055198581768,
       2.1447721196339886
      ],
      "p": 0.6335366463353664,
      "mid_p": 0.5787,
      "per_seed": {
       "42": -0.20161290322580644,
       "43": -0.20040080160320642,
       "44": 1.8072289156626506
      },
      "p_het": 0.4988501149885011,
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "blasst_t50_s1_sxs"
      ],
      "row_arm": "jqs_f_u128",
      "source": "sxs",
      "replaces": [
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "seed_tuple": [
       20261024,
       28,
       0,
       1
      ],
      "label_text": "final N = 128 (sxs) vs BLASST t50 (sxs)",
      "mdd80": 2.398599560962639,
      "se": 0.8397203283216931,
      "ci95_bootstrap": [
       -1.1409395973154361,
       2.1448080799362748
      ],
      "q": 0.9016849794310509,
      "label": "none",
      "q_prev": 0.003999600039996001,
      "label_prev": "below_detected",
      "q_published": 0.003999600039996001,
      "label_published": "below_detected",
      "changed": true,
      "text": "no detected difference (MDD80 2.40)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 69,
      "mean_a": 83.5016835016835,
      "mean_b": 82.996632996633,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.287581702058108,
       3.300330035743201
      ],
      "p": 0.8049195080491951,
      "mid_p": 0.71525,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -2.525252525252525,
       "44": 3.0303030303030303
      },
      "p_het": null,
      "mdd80": 3.9936986210534555,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.99)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 11,
      "mean_a": 92.15277777777777,
      "mean_b": 92.01388888888889,
      "delta": 0.1388888888888889,
      "ci95": [
       -0.27777777820406424,
       0.5208333338232378
      ],
      "p": 0.7574242575742426,
      "mid_p": 0.5389,
      "per_seed": {
       "42": -0.20833333333333334,
       "43": 1.25,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 0.5707699488675799,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.939122582587102,
      "label_source": "none",
      "q": 0.948905109489051,
      "label": "none",
      "q_prev": 0.9343065693430657,
      "label_prev": "none",
      "q_published": 0.939122582587102,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 0.57)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 179,
      "mean_a": 80.1762114537445,
      "mean_b": 78.78120411160059,
      "delta": 1.395007342143906,
      "ci95": [
       -0.5772005791365347,
       3.3467202159652207
      ],
      "p": 0.1847815218478152,
      "mid_p": 0.16215,
      "per_seed": {
       "42": 3.303964757709251,
       "43": 2.202643171806167,
       "44": -1.3215859030837005
      },
      "p_het": null,
      "mdd80": 2.804438903805405,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5124820851248209,
      "label_source": "none",
      "q": 0.5765423457654235,
      "label": "none",
      "q_prev": 0.5124820851248209,
      "label_prev": "none",
      "q_published": 0.5124820851248209,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.80)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 12,
      "b_only": 29,
      "mean_a": 40.823970037453186,
      "mean_b": 47.19101123595506,
      "rate_a": 40.823970037453186,
      "rate_b": 47.19101123595507,
      "delta": -6.367041198501872,
      "ci95": [
       -11.7117117181234,
       -0.8547008484077581
      ],
      "p": 0.0282971702829717,
      "mid_p": 0.02075,
      "per_seed": {
       "42": -8.98876404494382,
       "43": -6.741573033707865,
       "44": -3.3707865168539324
      },
      "p_het": 0.6087391260873912,
      "mdd80": 7.759540839885665,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0283, q 0.30)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 200,
      "a_only": 113,
      "b_only": 87,
      "mean_a": 70.53333333333333,
      "mean_b": 68.8,
      "rate_a": 70.53333333333333,
      "rate_b": 68.8,
      "delta": 1.7333333333333334,
      "ci95": [
       -0.13227513412455377,
       3.543307088388927
      ],
      "p": 0.0765923407659234,
      "mid_p": 0.06575,
      "per_seed": {
       "42": 1.8,
       "43": 2.2,
       "44": 1.2
      },
      "p_het": 0.918008199180082,
      "mdd80": 2.6269505214834576,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.37292270772922703,
      "label_source": "none",
      "q": 0.46615338466153383,
      "label": "none",
      "q_prev": 0.37292270772922703,
      "label_prev": "none",
      "q_published": 0.37292270772922703,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.63)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 69,
      "mean_a": 84.51178451178451,
      "mean_b": 82.996632996633,
      "delta": 1.5151515151515151,
      "ci95": [
       -1.063829789941044,
       4.126984129440272
      ],
      "p": 0.3104689531046895,
      "mid_p": 0.25785,
      "per_seed": {
       "42": 4.040404040404041,
       "43": -2.0202020202020203,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 3.7098915238298216,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6318023659818893,
      "label_source": "none",
      "q": 0.6802891139457482,
      "label": "none",
      "q_prev": 0.6368593909839785,
      "label_prev": "none",
      "q_published": 0.6318023659818893,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.71)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 23,
      "mean_a": 90.48611111111111,
      "mean_b": 92.01388888888889,
      "delta": -1.5277777777777777,
      "ci95": [
       -3.030303032360389,
       -0.148809522326099
      ],
      "p": 0.035596440355964404,
      "mid_p": 0.02415,
      "per_seed": {
       "42": -2.5,
       "43": -0.4166666666666667,
       "44": -1.6666666666666667
      },
      "p_het": null,
      "mdd80": 2.059412746223232,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.2248196233008278,
      "label_source": "below_nominal",
      "q": 0.3051123459082663,
      "label": "below_nominal",
      "q_prev": 0.2248196233008278,
      "label_prev": "below_nominal",
      "q_published": 0.2248196233008278,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0356, q 0.31)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 213,
      "mean_a": 75.33039647577093,
      "mean_b": 78.78120411160059,
      "delta": -3.4508076358296624,
      "ci95": [
       -5.580029370703169,
       -1.3274336261944575
      ],
      "p": 0.0020997900209979003,
      "mid_p": 0.0017,
      "per_seed": {
       "42": -4.185022026431718,
       "43": -1.7621145374449338,
       "44": -4.405286343612334
      },
      "p_het": null,
      "mdd80": 3.0393439548894547,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.02652366342313137,
      "label_source": "below_detected",
      "q": 0.069326400693264,
      "label": "below_detected",
      "q_prev": 0.02652366342313137,
      "label_prev": "below_detected",
      "q_published": 0.02652366342313137,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.00210, q 0.0693)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 50,
      "a_only": 14,
      "b_only": 36,
      "mean_a": 38.951310861423224,
      "mean_b": 47.19101123595506,
      "rate_a": 38.951310861423224,
      "rate_b": 47.19101123595507,
      "delta": -8.239700374531836,
      "ci95": [
       -13.953488377990233,
       -2.499999993614554
      ],
      "p": 0.006999300069993001,
      "mid_p": 0.00505,
      "per_seed": {
       "42": -14.606741573033707,
       "43": -6.741573033707865,
       "44": -3.3707865168539324
      },
      "p_het": 0.1663833616638336,
      "mdd80": 8.185845251902826,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.07303617464340523,
      "label_source": "below_detected",
      "q": 0.12921784744602463,
      "label": "below_nominal",
      "q_prev": 0.07303617464340523,
      "label_prev": "below_detected",
      "q_published": 0.07303617464340523,
      "label_published": "below_detected",
      "changed": true,
      "text": "below, nominal (p 0.00700, q 0.129)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 196,
      "a_only": 101,
      "b_only": 95,
      "mean_a": 69.2,
      "mean_b": 68.8,
      "rate_a": 69.2,
      "rate_b": 68.8,
      "delta": 0.4,
      "ci95": [
       -1.4492753641464335,
       2.259887007617853
      ],
      "p": 0.7232276772322768,
      "mid_p": 0.67085,
      "per_seed": {
       "42": -1.2,
       "43": 1.4,
       "44": 1.0
      },
      "p_het": 0.4881511848815118,
      "mdd80": 2.650950362935943,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9270987794837537,
      "label_source": "none",
      "q": 0.9370675835642243,
      "label": "none",
      "q_prev": 0.9221934949362207,
      "label_prev": "none",
      "q_published": 0.9270987794837537,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.65)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 65,
      "mean_a": 82.82828282828282,
      "mean_b": 82.996632996633,
      "delta": -0.16835016835016836,
      "ci95": [
       -3.061224492707585,
       2.7027027052640014
      ],
      "p": 1.0,
      "mid_p": 0.9095,
      "per_seed": {
       "42": 2.0202020202020203,
       "43": -2.525252525252525,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 4.119497440639449,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 22,
      "mean_a": 91.11111111111111,
      "mean_b": 92.01388888888889,
      "delta": -0.9027777777777778,
      "ci95": [
       -1.7045454556537,
       -0.1488095229917917
      ],
      "p": 0.0337966203379662,
      "mid_p": 0.0206,
      "per_seed": {
       "42": 0.0,
       "43": -1.6666666666666667,
       "44": -1.0416666666666667
      },
      "p_het": null,
      "mdd80": 1.111889510881909,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0338, q 0.30)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 199,
      "mean_a": 79.00146842878121,
      "mean_b": 78.78120411160059,
      "delta": 0.22026431718061673,
      "ci95": [
       -1.7777777797865895,
       2.212389382523826
      ],
      "p": 0.8906109389061094,
      "mid_p": 0.8365,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": 1.3215859030837005,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.851785397054621,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9804891070525976,
      "label_source": "none",
      "q": 0.9895677098956772,
      "label": "none",
      "q_prev": 0.9760119878423117,
      "label_prev": "none",
      "q_published": 0.9804891070525976,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.85)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 54,
      "a_only": 21,
      "b_only": 33,
      "mean_a": 42.69662921348315,
      "mean_b": 47.19101123595506,
      "rate_a": 42.696629213483156,
      "rate_b": 47.19101123595507,
      "delta": -4.49438202247191,
      "ci95": [
       -11.111111118647413,
       2.173913049911798
      ],
      "p": 0.22047795220477953,
      "mid_p": 0.18475,
      "per_seed": {
       "42": -2.247191011235955,
       "43": -7.865168539325842,
       "44": -3.3707865168539324
      },
      "p_het": 0.6874312568743126,
      "mdd80": 9.494849810121194,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.5431293605333344,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5431293605333344,
      "label_prev": "none",
      "q_published": 0.5431293605333344,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 9.49)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 191,
      "a_only": 96,
      "b_only": 95,
      "mean_a": 68.86666666666666,
      "mean_b": 68.8,
      "rate_a": 68.86666666666667,
      "rate_b": 68.8,
      "delta": 0.06666666666666667,
      "ci95": [
       -1.7832647481269066,
       1.8970189720467725
      ],
      "p": 1.0,
      "mid_p": 0.9435,
      "per_seed": {
       "42": 1.0,
       "43": -0.2,
       "44": -0.6
      },
      "p_het": 0.7543245675432457,
      "mdd80": 2.630310697091709,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.63)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 63,
      "mean_a": 82.82828282828282,
      "mean_b": 82.996632996633,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.6936026961272663,
       2.35988200811586
      ],
      "p": 1.0,
      "mid_p": 0.8964,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -3.5353535353535355,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 3.611741888892398,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.61)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 16,
      "mean_a": 91.25,
      "mean_b": 92.01388888888889,
      "delta": -0.7638888888888888,
      "ci95": [
       -2.4621212144443954,
       0.6250000020945652
      ],
      "p": 0.7591240875912408,
      "mid_p": 0.68085,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -0.4166666666666667,
       "44": -1.4583333333333333
      },
      "p_het": null,
      "mdd80": 2.2063755341933247,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.939122582587102,
      "label_source": "none",
      "q": 0.948905109489051,
      "label": "none",
      "q_prev": 0.9343065693430657,
      "label_prev": "none",
      "q_published": 0.939122582587102,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.21)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 206,
      "mean_a": 77.01908957415566,
      "mean_b": 78.78120411160059,
      "delta": -1.7621145374449338,
      "ci95": [
       -3.686635946706366,
       0.15015015209835392
      ],
      "p": 0.08409159084091591,
      "mid_p": 0.07185,
      "per_seed": {
       "42": -1.3215859030837005,
       "43": 1.1013215859030836,
       "44": -5.066079295154185
      },
      "p_het": null,
      "mdd80": 2.7421634540889595,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.3957251333690161,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.3957251333690161,
      "label_prev": "none",
      "q_published": 0.3957251333690161,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.74)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 16,
      "b_only": 26,
      "mean_a": 43.445692883895134,
      "mean_b": 47.19101123595506,
      "rate_a": 43.445692883895134,
      "rate_b": 47.19101123595507,
      "delta": -3.745318352059925,
      "ci95": [
       -9.02777778266384,
       1.550387602367312
      ],
      "p": 0.21537846215378462,
      "mid_p": 0.17095,
      "per_seed": {
       "42": -8.98876404494382,
       "43": -5.617977528089888,
       "44": 3.3707865168539324
      },
      "p_het": 0.0791920807919208,
      "mdd80": 7.560249068661374,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.5431293605333344,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5431293605333344,
      "label_prev": "none",
      "q_published": 0.5431293605333344,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.56)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 197,
      "a_only": 96,
      "b_only": 101,
      "mean_a": 68.46666666666667,
      "mean_b": 68.8,
      "rate_a": 68.46666666666667,
      "rate_b": 68.8,
      "delta": -0.3333333333333333,
      "ci95": [
       -2.032520326923482,
       1.3661202203149654
      ],
      "p": 0.7567243275672433,
      "mid_p": 0.7011,
      "per_seed": {
       "42": 0.6,
       "43": -0.6,
       "44": -1.0
      },
      "p_het": 0.7878212178782121,
      "mdd80": 2.429019409011498,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.939122582587102,
      "label_source": "none",
      "q": 0.948905109489051,
      "label": "none",
      "q_prev": 0.9343065693430657,
      "label_prev": "none",
      "q_published": 0.939122582587102,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.43)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 62,
      "mean_a": 83.33333333333333,
      "mean_b": 82.996632996633,
      "delta": 0.3367003367003367,
      "ci95": [
       -2.3809523836943973,
       3.0303030333348704
      ],
      "p": 0.9068093190680931,
      "mid_p": 0.81755,
      "per_seed": {
       "42": 3.5353535353535355,
       "43": -1.0101010101010102,
       "44": -1.5151515151515151
      },
      "p_het": null,
      "mdd80": 3.867441776319312,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.986290511220371,
      "label_source": "none",
      "q": 0.9998633164206514,
      "label": "none",
      "q_prev": 0.986290511220371,
      "label_prev": "none",
      "q_published": 0.986290511220371,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.87)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 17,
      "mean_a": 91.25,
      "mean_b": 92.01388888888889,
      "delta": -0.7638888888888888,
      "ci95": [
       -1.6025641035443627,
       1.0547918841586008e-09
      ],
      "p": 0.10008999100089991,
      "mid_p": 0.0697,
      "per_seed": {
       "42": -1.4583333333333333,
       "43": -0.625,
       "44": -0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.1453577570653786,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.40035996400359963,
      "label_source": "none",
      "q": 0.48043195680431955,
      "label": "none",
      "q_prev": 0.40035996400359963,
      "label_prev": "none",
      "q_published": 0.40035996400359963,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.15)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 204,
      "mean_a": 78.48751835535977,
      "mean_b": 78.78120411160059,
      "delta": -0.2936857562408223,
      "ci95": [
       -2.3041474675363713,
       1.7167381993787114
      ],
      "p": 0.8318168183181682,
      "mid_p": 0.77745,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": 0.44052863436123346,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 2.87374001180821,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.954184955336242,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.949716349119805,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.87)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 60,
      "a_only": 22,
      "b_only": 38,
      "mean_a": 41.19850187265918,
      "mean_b": 47.19101123595506,
      "rate_a": 41.19850187265917,
      "rate_b": 47.19101123595507,
      "delta": -5.992509363295881,
      "ci95": [
       -12.698412705500324,
       0.7575757643965536
      ],
      "p": 0.10278972102789721,
      "mid_p": 0.0819,
      "per_seed": {
       "42": -8.98876404494382,
       "43": -3.3707865168539324,
       "44": -5.617977528089888
      },
      "p_het": 0.7045295470452955,
      "mdd80": 9.617038550126287,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.40441857453598906,
      "label_source": "none",
      "q": 0.48371633424892807,
      "label": "none",
      "q_prev": 0.40441857453598906,
      "label_prev": "none",
      "q_published": 0.40441857453598906,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 9.62)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 195,
      "a_only": 111,
      "b_only": 84,
      "mean_a": 70.6,
      "mean_b": 68.8,
      "rate_a": 70.6,
      "rate_b": 68.8,
      "delta": 1.8,
      "ci95": [
       -1.9293828946709186e-09,
       3.6723163861605403
      ],
      "p": 0.06979302069793021,
      "mid_p": 0.0589,
      "per_seed": {
       "42": 2.4,
       "43": 0.8,
       "44": 2.2
      },
      "p_het": 0.7687231276872313,
      "mdd80": 2.6246164190412666,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.34896510348965104,
      "label_source": "none",
      "q": 0.44079802546061186,
      "label": "none",
      "q_prev": 0.34896510348965104,
      "label_prev": "none",
      "q_published": 0.34896510348965104,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.62)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 66,
      "mean_a": 84.34343434343434,
      "mean_b": 82.996632996633,
      "delta": 1.3468013468013469,
      "ci95": [
       -1.3201320158149907,
       4.0000000026265
      ],
      "p": 0.37436256374362564,
      "mid_p": 0.31435,
      "per_seed": {
       "42": 2.525252525252525,
       "43": 0.0,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 3.8023155881542676,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7019298070192981,
      "label_source": "none",
      "q": 0.7364509450694275,
      "label": "none",
      "q_prev": 0.6964884906858152,
      "label_prev": "none",
      "q_published": 0.7019298070192981,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.80)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 14,
      "mean_a": 91.59722222222223,
      "mean_b": 92.01388888888889,
      "delta": -0.4166666666666667,
      "ci95": [
       -1.215277778788149,
       0.297619048393703
      ],
      "p": 0.4941505849415059,
      "mid_p": 0.37775,
      "per_seed": {
       "42": -1.6666666666666667,
       "43": 0.20833333333333334,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.0812722634179783,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7906409359064094,
      "label_source": "none",
      "q": 0.8179044164549062,
      "label": "none",
      "q_prev": 0.7854049032182875,
      "label_prev": "none",
      "q_published": 0.7906409359064094,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.08)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 186,
      "mean_a": 79.0748898678414,
      "mean_b": 78.78120411160059,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.8348623875298533,
       2.4425287377293374
      ],
      "p": 0.8441155884411559,
      "mid_p": 0.79095,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": 2.4229074889867843,
       "44": -1.1013215859030836
      },
      "p_het": null,
      "mdd80": 3.057065293836488,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.954184955336242,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.9497468857765385,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.06)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 54,
      "a_only": 20,
      "b_only": 34,
      "mean_a": 41.947565543071164,
      "mean_b": 47.19101123595506,
      "rate_a": 41.947565543071164,
      "rate_b": 47.19101123595507,
      "delta": -5.2434456928838955,
      "ci95": [
       -11.111111117788319,
       0.7575757636219769
      ],
      "p": 0.10898910108989102,
      "mid_p": 0.0849,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -6.741573033707865,
       "44": -5.617977528089888
      },
      "p_het": 0.908009199080092,
      "mdd80": 8.482588962769503,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.40870912908709134,
      "label_source": "none",
      "q": 0.4843960048439601,
      "label": "none",
      "q_prev": 0.40870912908709134,
      "label_prev": "none",
      "q_published": 0.41519657558053724,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.48)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 177,
      "a_only": 87,
      "b_only": 90,
      "mean_a": 68.6,
      "mean_b": 68.8,
      "rate_a": 68.60000000000001,
      "rate_b": 68.8,
      "delta": -0.2,
      "ci95": [
       -1.9444444462553594,
       1.5564202351651415
      ],
      "p": 0.8786121387861214,
      "mid_p": 0.82235,
      "per_seed": {
       "42": -1.6,
       "43": 1.2,
       "44": -0.2
      },
      "p_het": 0.44795520447955206,
      "mdd80": 2.5020793288666185,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9762357097623572,
      "label_source": "none",
      "q": 0.9853594079844353,
      "label": "none",
      "q_prev": 0.9717369276897196,
      "label_prev": "none",
      "q_published": 0.9762357097623572,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 47,
      "mean_a": 83.5016835016835,
      "mean_b": 84.006734006734,
      "delta": -0.5050505050505051,
      "ci95": [
       -3.030303032818626,
       2.0202020227176156
      ],
      "p": 0.795920407959204,
      "mid_p": 0.70215,
      "per_seed": {
       "42": 0.0,
       "43": -1.5151515151515151,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 3.609612324309012,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.61)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 12,
      "mean_a": 92.15277777777777,
      "mean_b": 92.08333333333333,
      "delta": 0.06944444444444445,
      "ci95": [
       -0.4807692314163907,
       0.5787037041366674
      ],
      "p": 1.0,
      "mid_p": 0.84475,
      "per_seed": {
       "42": 0.20833333333333334,
       "43": 0.4166666666666667,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 0.7572087392036319,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 0.76)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 198,
      "mean_a": 80.1762114537445,
      "mean_b": 78.70778267254038,
      "delta": 1.4684287812041117,
      "ci95": [
       -0.4385964931207275,
       3.362573101295693
      ],
      "p": 0.15098490150984903,
      "mid_p": 0.1309,
      "per_seed": {
       "42": 4.405286343612334,
       "43": 0.8810572687224669,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.7167082230229322,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.46142221220915886,
      "label_source": "none",
      "q": 0.5282949965872978,
      "label": "none",
      "q_prev": 0.46142221220915886,
      "label_prev": "none",
      "q_published": 0.46142221220915886,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.72)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 15,
      "b_only": 27,
      "mean_a": 40.823970037453186,
      "mean_b": 45.3183520599251,
      "rate_a": 40.823970037453186,
      "rate_b": 45.3183520599251,
      "delta": -4.49438202247191,
      "ci95": [
       -10.000000006106472,
       0.8547008607840507
      ],
      "p": 0.14388561143885611,
      "mid_p": 0.1124,
      "per_seed": {
       "42": -6.741573033707865,
       "43": -7.865168539325842,
       "44": 1.1235955056179776
      },
      "p_het": 0.24087591240875914,
      "mdd80": 7.757889873383296,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.45437561507007196,
      "label_source": "none",
      "q": 0.523220405232204,
      "label": "none",
      "q_prev": 0.45437561507007196,
      "label_prev": "none",
      "q_published": 0.45437561507007196,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.76)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 160,
      "a_only": 84,
      "b_only": 76,
      "mean_a": 70.53333333333333,
      "mean_b": 70.0,
      "rate_a": 70.53333333333333,
      "rate_b": 70.0,
      "delta": 0.5333333333333333,
      "ci95": [
       -1.1627906993144272,
       2.213541668305278
      ],
      "p": 0.6021397860213978,
      "mid_p": 0.5521,
      "per_seed": {
       "42": 1.0,
       "43": 1.2,
       "44": -0.6
      },
      "p_het": 0.6395360463953604,
      "mdd80": 2.413075680770608,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8500796979125615,
      "label_source": "none",
      "q": 0.8811801746654602,
      "label": "none",
      "q_prev": 0.8551097552966596,
      "label_prev": "none",
      "q_published": 0.8500796979125615,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.41)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 65,
      "mean_a": 84.51178451178451,
      "mean_b": 84.006734006734,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.173913046357864,
       3.1578947395965242
      ],
      "p": 0.8075192480751925,
      "mid_p": 0.71595,
      "per_seed": {
       "42": 3.0303030303030303,
       "43": -1.0101010101010102,
       "44": -0.5050505050505051
      },
      "p_het": null,
      "mdd80": 3.8106602970193983,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.81)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 20,
      "mean_a": 90.48611111111111,
      "mean_b": 92.08333333333333,
      "delta": -1.5972222222222223,
      "ci95": [
       -3.12500000192093,
       -0.16025640858965495
      ],
      "p": 0.0334966503349665,
      "mid_p": 0.0227,
      "per_seed": {
       "42": -2.0833333333333335,
       "43": -1.25,
       "44": -1.4583333333333333
      },
      "p_het": null,
      "mdd80": 2.118911850444333,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0335, q 0.30)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 224,
      "mean_a": 75.33039647577093,
      "mean_b": 78.70778267254038,
      "delta": -3.3773861967694567,
      "ci95": [
       -5.578800559968461,
       -1.174743022759988
      ],
      "p": 0.0023997600239976003,
      "mid_p": 0.0019,
      "per_seed": {
       "42": -3.0837004405286343,
       "43": -3.0837004405286343,
       "44": -3.9647577092511015
      },
      "p_het": null,
      "mdd80": 3.1475941887926355,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.0287971202879712,
      "label_source": "below_detected",
      "q": 0.069326400693264,
      "label": "below_detected",
      "q_prev": 0.0287971202879712,
      "label_prev": "below_detected",
      "q_published": 0.0287971202879712,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.00240, q 0.0693)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 57,
      "a_only": 20,
      "b_only": 37,
      "mean_a": 38.951310861423224,
      "mean_b": 45.3183520599251,
      "rate_a": 38.951310861423224,
      "rate_b": 45.3183520599251,
      "delta": -6.367041198501872,
      "ci95": [
       -11.711711718122714,
       -0.8333333271830162
      ],
      "p": 0.028697130286971302,
      "mid_p": 0.0209,
      "per_seed": {
       "42": -12.359550561797754,
       "43": -7.865168539325842,
       "44": 1.1235955056179776
      },
      "p_het": 0.1506849315068493,
      "mdd80": 7.774812276524609,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0287, q 0.30)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 180,
      "a_only": 84,
      "b_only": 96,
      "mean_a": 69.2,
      "mean_b": 70.0,
      "rate_a": 69.2,
      "rate_b": 70.0,
      "delta": -0.8,
      "ci95": [
       -2.564102565886349,
       0.9641873296425743
      ],
      "p": 0.4082591740825917,
      "mid_p": 0.3668,
      "per_seed": {
       "42": -2.0,
       "43": 0.4,
       "44": -0.8
      },
      "p_het": 0.561943805619438,
      "mdd80": 2.5216802182339224,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.52)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 65,
      "mean_a": 82.82828282828282,
      "mean_b": 84.006734006734,
      "delta": -1.1784511784511784,
      "ci95": [
       -3.741496601225487,
       1.4035087746113764
      ],
      "p": 0.44575542445755423,
      "mid_p": 0.37485,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -1.5151515151515151,
       "44": -3.0303030303030303
      },
      "p_het": null,
      "mdd80": 3.6771520093617687,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.742925707429257,
      "label_source": "none",
      "q": 0.7752268251435726,
      "label": "none",
      "q_prev": 0.7378020818607793,
      "label_prev": "none",
      "q_published": 0.742925707429257,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.68)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 21,
      "mean_a": 91.11111111111111,
      "mean_b": 92.08333333333333,
      "delta": -0.9722222222222222,
      "ci95": [
       -1.8750000013689287,
       -0.12254901885104916
      ],
      "p": 0.04659534046595341,
      "mid_p": 0.02945,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": -2.5,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.2524823942726144,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.26006701655415854,
      "label_source": "below_nominal",
      "q": 0.33887520338875204,
      "label": "below_nominal",
      "q_prev": 0.26006701655415854,
      "label_prev": "below_nominal",
      "q_published": 0.26006701655415854,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0466, q 0.34)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 218,
      "mean_a": 79.00146842878121,
      "mean_b": 78.70778267254038,
      "delta": 0.2936857562408223,
      "ci95": [
       -1.798063625753541,
       2.369668248673217
      ],
      "p": 0.837916208379162,
      "mid_p": 0.78655,
      "per_seed": {
       "42": 1.3215859030837005,
       "43": 0.0,
       "44": -0.44052863436123346
      },
      "p_het": null,
      "mdd80": 2.978691472025272,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.954184955336242,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.949716349119805,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.98)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 57,
      "a_only": 25,
      "b_only": 32,
      "mean_a": 42.69662921348315,
      "mean_b": 45.3183520599251,
      "rate_a": 42.696629213483156,
      "rate_b": 45.3183520599251,
      "delta": -2.6217228464419478,
      "ci95": [
       -8.730158736632562,
       3.4188034256891573
      ],
      "p": 0.46295370462953706,
      "mid_p": 0.3948,
      "per_seed": {
       "42": 0.0,
       "43": -8.98876404494382,
       "44": 1.1235955056179776
      },
      "p_het": 0.2686731326867313,
      "mdd80": 8.68290261398901,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.7557622616116767,
      "label_source": "none",
      "q": 0.7876958782994941,
      "label": "none",
      "q_prev": 0.7557622616116767,
      "label_prev": "none",
      "q_published": 0.760903501486586,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.68)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 191,
      "a_only": 87,
      "b_only": 104,
      "mean_a": 68.86666666666666,
      "mean_b": 70.0,
      "rate_a": 68.86666666666667,
      "rate_b": 70.0,
      "delta": -1.1333333333333333,
      "ci95": [
       -2.916666668524228,
       0.6666666684636935
      ],
      "p": 0.23577642235776422,
      "mid_p": 0.209,
      "per_seed": {
       "42": 0.2,
       "43": -1.2,
       "44": -2.4
      },
      "p_het": 0.5256474352564744,
      "mdd80": 2.561019944157964,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5652006227948633,
      "label_source": "none",
      "q": 0.6246954251943226,
      "label": "none",
      "q_prev": 0.5652006227948633,
      "label_prev": "none",
      "q_published": 0.5652006227948633,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.56)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 59,
      "mean_a": 82.82828282828282,
      "mean_b": 84.006734006734,
      "delta": -1.1784511784511784,
      "ci95": [
       -3.669724772898083,
       1.346801349323957
      ],
      "p": 0.43615638436156384,
      "mid_p": 0.36475,
      "per_seed": {
       "42": 0.0,
       "43": -2.525252525252525,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 3.585327470594556,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7355348381245792,
      "label_source": "none",
      "q": 0.7677480427139768,
      "label": "none",
      "q_prev": 0.7304269573042697,
      "label_prev": "none",
      "q_published": 0.7355348381245792,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.59)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 15,
      "mean_a": 91.25,
      "mean_b": 92.08333333333333,
      "delta": -0.8333333333333334,
      "ci95": [
       -2.604166668887684,
       0.5681818201009077
      ],
      "p": 0.5961403859614038,
      "mid_p": 0.54975,
      "per_seed": {
       "42": 0.0,
       "43": -1.25,
       "44": -1.25
      },
      "p_het": null,
      "mdd80": 2.267287741906929,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8492878522798607,
      "label_source": "none",
      "q": 0.8805499818116347,
      "label": "none",
      "q_prev": 0.8543431371148598,
      "label_prev": "none",
      "q_published": 0.8492878522798607,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.27)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 219,
      "mean_a": 77.01908957415566,
      "mean_b": 78.70778267254038,
      "delta": -1.6886930983847284,
      "ci95": [
       -3.770739066991885,
       0.42918455141728495
      ],
      "p": 0.1287871212878712,
      "mid_p": 0.11465,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": -0.22026431718061673,
       "44": -4.6255506607929515
      },
      "p_het": null,
      "mdd80": 3.0016990157346957,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.43295670432956707,
      "label_source": "none",
      "q": 0.4948076620909338,
      "label": "none",
      "q_prev": 0.42702579057162776,
      "label_prev": "none",
      "q_published": 0.43295670432956707,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.00)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 55,
      "a_only": 25,
      "b_only": 30,
      "mean_a": 43.445692883895134,
      "mean_b": 45.3183520599251,
      "rate_a": 43.445692883895134,
      "rate_b": 45.3183520599251,
      "delta": -1.8726591760299625,
      "ci95": [
       -7.317073176634992,
       3.508771936116042
      ],
      "p": 0.5782421757824218,
      "mid_p": 0.4937,
      "per_seed": {
       "42": -6.741573033707865,
       "43": -6.741573033707865,
       "44": 7.865168539325842
      },
      "p_het": 0.05419458054194581,
      "mdd80": 7.737266572421551,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.8520611353498797,
      "label_source": "none",
      "q": 0.8788555106753476,
      "label": "none",
      "q_prev": 0.8520611353498797,
      "label_prev": "none",
      "q_published": 0.8468971284689712,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.74)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 181,
      "a_only": 79,
      "b_only": 102,
      "mean_a": 68.46666666666667,
      "mean_b": 70.0,
      "rate_a": 68.46666666666667,
      "rate_b": 70.0,
      "delta": -1.5333333333333334,
      "ci95": [
       -3.252032522066563,
       0.13947001569151027
      ],
      "p": 0.09299070092990701,
      "mid_p": 0.0796,
      "per_seed": {
       "42": -0.2,
       "43": -1.6,
       "44": -2.8
      },
      "p_het": 0.507949205079492,
      "mdd80": 2.423917850512284,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.42)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 54,
      "mean_a": 83.33333333333333,
      "mean_b": 84.006734006734,
      "delta": -0.6734006734006734,
      "ci95": [
       -2.9304029328548156,
       1.6025641047294497
      ],
      "p": 0.6701329867013298,
      "mid_p": 0.57325,
      "per_seed": {
       "42": 2.525252525252525,
       "43": 0.0,
       "44": -4.545454545454546
      },
      "p_het": null,
      "mdd80": 3.239726226313697,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9064728886227398,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.24)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 18,
      "mean_a": 91.25,
      "mean_b": 92.08333333333333,
      "delta": -0.8333333333333334,
      "ci95": [
       -1.7156862752972177,
       1.1495697700372283e-09
      ],
      "p": 0.08589141085891411,
      "mid_p": 0.06115,
      "per_seed": {
       "42": -1.0416666666666667,
       "43": -1.4583333333333333,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 1.226206539744295,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.23)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 195,
      "mean_a": 78.48751835535977,
      "mean_b": 78.70778267254038,
      "delta": -0.22026431718061673,
      "ci95": [
       -2.2222222242390597,
       1.777777779790878
      ],
      "p": 0.8889111088891111,
      "mid_p": 0.83455,
      "per_seed": {
       "42": 0.8810572687224669,
       "43": -0.8810572687224669,
       "44": -0.6607929515418502
      },
      "p_het": null,
      "mdd80": 2.8588129608850665,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9804891070525976,
      "label_source": "none",
      "q": 0.9895677098956772,
      "label": "none",
      "q_prev": 0.9760119878423117,
      "label_prev": "none",
      "q_published": 0.9804891070525976,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.86)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 61,
      "a_only": 25,
      "b_only": 36,
      "mean_a": 41.19850187265918,
      "mean_b": 45.3183520599251,
      "rate_a": 41.19850187265917,
      "rate_b": 45.3183520599251,
      "delta": -4.119850187265918,
      "ci95": [
       -9.929078019679523,
       1.6260162663769293
      ],
      "p": 0.20237976202379762,
      "mid_p": 0.16305,
      "per_seed": {
       "42": -6.741573033707865,
       "43": -4.49438202247191,
       "44": -1.1235955056179776
      },
      "p_het": 0.7584241575842415,
      "mdd80": 8.258463318986516,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.5337488229199059,
      "label_source": "none",
      "q": 0.5996437393297708,
      "label": "none",
      "q_prev": 0.5337488229199059,
      "label_prev": "none",
      "q_published": 0.5337488229199059,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.26)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 177,
      "a_only": 93,
      "b_only": 84,
      "mean_a": 70.6,
      "mean_b": 70.0,
      "rate_a": 70.6,
      "rate_b": 70.0,
      "delta": 0.6,
      "ci95": [
       -1.2711864426559754,
       2.4793388449143814
      ],
      "p": 0.5748425157484252,
      "mid_p": 0.5301,
      "per_seed": {
       "42": 1.6,
       "43": -0.2,
       "44": 0.4
      },
      "p_het": 0.6882311768823117,
      "mdd80": 2.680512572857757,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8468971284689712,
      "label_source": "none",
      "q": 0.8788555106753476,
      "label": "none",
      "q_prev": 0.8520611353498797,
      "label_prev": "none",
      "q_published": 0.8468971284689712,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.68)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 64,
      "mean_a": 84.34343434343434,
      "mean_b": 84.006734006734,
      "delta": 0.3367003367003367,
      "ci95": [
       -2.5641025668536455,
       3.205128207859513
      ],
      "p": 0.9082091790820918,
      "mid_p": 0.8192,
      "per_seed": {
       "42": 1.5151515151515151,
       "43": 1.0101010101010102,
       "44": -1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.123287924117594,
      "key": [
       "qwen3.6-35b-a3b",
       "gpqa",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.986290511220371,
      "label_source": "none",
      "q": 0.9998633164206514,
      "label": "none",
      "q_prev": 0.986290511220371,
      "label_prev": "none",
      "q_published": 0.986290511220371,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.12)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 13,
      "mean_a": 91.59722222222223,
      "mean_b": 92.08333333333333,
      "delta": -0.4861111111111111,
      "ci95": [
       -1.3392857152100794,
       0.3205128214552232
      ],
      "p": 0.386961303869613,
      "mid_p": 0.3012,
      "per_seed": {
       "42": -1.25,
       "43": -0.625,
       "44": 0.4166666666666667
      },
      "p_het": null,
      "mdd80": 1.186263391074067,
      "key": [
       "qwen3.6-35b-a3b",
       "aime25",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7142491857684461,
      "label_source": "none",
      "q": 0.7485331466853316,
      "label": "none",
      "q_prev": 0.7088382070883821,
      "label_prev": "none",
      "q_published": 0.7142491857684461,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.19)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 211,
      "mean_a": 79.0748898678414,
      "mean_b": 78.70778267254038,
      "delta": 0.3671071953010279,
      "ci95": [
       -1.8264840205307649,
       2.5641025663510213
      ],
      "p": 0.7905209479052094,
      "mid_p": 0.74265,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": 1.1013215859030836,
       "44": -0.6607929515418502
      },
      "p_het": null,
      "mdd80": 3.1379664569549925,
      "key": [
       "qwen3.6-35b-a3b",
       "lcb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.14)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 51,
      "a_only": 21,
      "b_only": 30,
      "mean_a": 41.947565543071164,
      "mean_b": 45.3183520599251,
      "rate_a": 41.947565543071164,
      "rate_b": 45.3183520599251,
      "delta": -3.3707865168539324,
      "ci95": [
       -8.974358979149748,
       2.272727278424508
      ],
      "p": 0.28587141285871415,
      "mid_p": 0.23305,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": -7.865168539325842,
       "44": -1.1235955056179776
      },
      "p_het": 0.525947405259474,
      "mdd80": 8.03832898323791,
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6230881336645097,
      "label_source": "none",
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.6230881336645097,
      "label_prev": "none",
      "q_published": 0.6230881336645097,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 8.04)"
     },
     {
      "model": "qwen3.6-35b-a3b",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 167,
      "a_only": 73,
      "b_only": 94,
      "mean_a": 68.6,
      "mean_b": 70.0,
      "rate_a": 68.60000000000001,
      "rate_b": 70.0,
      "delta": -1.4,
      "ci95": [
       -3.068340308576345,
       0.2699055347483169
      ],
      "p": 0.11688831116888311,
      "mid_p": 0.10065,
      "per_seed": {
       "42": -2.4,
       "43": 0.2,
       "44": -2.0
      },
      "p_het": 0.43625637436256376,
      "mdd80": 2.385855118475599,
      "key": [
       "qwen3.6-35b-a3b",
       "swe",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.425048404250484,
      "label_source": "none",
      "q": 0.49216131018477094,
      "label": "none",
      "q_prev": 0.4187043982168947,
      "label_prev": "none",
      "q_published": 0.425048404250484,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.39)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 79,
      "mean_a": 72.39057239057239,
      "mean_b": 73.56902356902357,
      "delta": -1.1784511784511784,
      "ci95": [
       -4.361370719449978,
       1.9607843173703268
      ],
      "p": 0.533046695330467,
      "mid_p": 0.46885,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -5.555555555555555,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.51846468544439,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8200718389699493,
      "label_source": "none",
      "q": 0.8472265356245834,
      "label": "none",
      "q_prev": 0.8200718389699493,
      "label_prev": "none",
      "q_published": 0.8200718389699493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.52)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 29,
      "mean_a": 87.91666666666667,
      "mean_b": 87.84722222222223,
      "delta": 0.06944444444444445,
      "ci95": [
       -1.190476191836415,
       1.339285715656822
      ],
      "p": 1.0,
      "mid_p": 0.91345,
      "per_seed": {
       "42": -2.0833333333333335,
       "43": 2.2916666666666665,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 1.8080290304521878,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.81)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 135,
      "mean_a": 68.79588839941263,
      "mean_b": 69.60352422907489,
      "delta": -0.8076358296622613,
      "ci95": [
       -2.5641025658024086,
       0.9302325599680578
      ],
      "p": 0.40645935406459355,
      "mid_p": 0.36365,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -1.9823788546255507,
       "44": 0.22026431718061673
      },
      "p_het": null,
      "mdd80": 2.4974126342910354,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 12,
      "a_only": 4,
      "b_only": 8,
      "mean_a": 4.49438202247191,
      "mean_b": 5.992509363295881,
      "rate_a": 4.49438202247191,
      "rate_b": 5.99250936329588,
      "delta": -1.4981273408239701,
      "ci95": [
       -3.787878790191476,
       0.7936507960774998
      ],
      "p": 0.36346365363463656,
      "mid_p": 0.2354,
      "per_seed": {
       "42": -4.49438202247191,
       "43": -1.1235955056179776,
       "44": 1.1235955056179776
      },
      "p_het": 0.27217278272172785,
      "mdd80": 3.2744340371770946,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6891810818918108,
      "label_source": "none",
      "q": 0.7290510618359651,
      "label": "none",
      "q_prev": 0.6891810818918108,
      "label_prev": "none",
      "q_published": 0.6946077045838723,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.27)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 254,
      "a_only": 109,
      "b_only": 145,
      "mean_a": 20.6,
      "mean_b": 23.0,
      "rate_a": 20.599999999999998,
      "rate_b": 23.0,
      "delta": -2.4,
      "ci95": [
       -4.521963826343285,
       -0.2699055309094578
      ],
      "p": 0.030496950304969503,
      "mid_p": 0.0264,
      "per_seed": {
       "42": -0.4,
       "43": -1.2,
       "44": -5.6
      },
      "p_het": 0.09479052094790522,
      "mdd80": 3.0389598382945673,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0305, q 0.30)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 84,
      "mean_a": 71.88552188552188,
      "mean_b": 73.56902356902357,
      "delta": -1.6835016835016836,
      "ci95": [
       -4.71380471682874,
       1.3888888920485023
      ],
      "p": 0.32536746325367466,
      "mid_p": 0.27635,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": -5.05050505050505,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.361614891947921,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6507349265073493,
      "label_source": "none",
      "q": 0.6910459396538223,
      "label": "none",
      "q_prev": 0.6507349265073493,
      "label_prev": "none",
      "q_published": 0.6507349265073493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.36)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 86.94444444444444,
      "mean_b": 87.84722222222223,
      "delta": -0.9027777777777778,
      "ci95": [
       -2.777777779663084,
       0.7812500015828914
      ],
      "p": 0.49405059494050596,
      "mid_p": 0.4448,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": 0.8333333333333334,
       "44": -2.7083333333333335
      },
      "p_het": null,
      "mdd80": 2.543648684731317,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7906409359064094,
      "label_source": "none",
      "q": 0.8179044164549062,
      "label": "none",
      "q_prev": 0.7854049032182875,
      "label_prev": "none",
      "q_published": 0.7906409359064094,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.54)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 160,
      "mean_a": 67.40088105726872,
      "mean_b": 69.60352422907489,
      "delta": -2.202643171806167,
      "ci95": [
       -4.166666668583378,
       -0.28011204298790227
      ],
      "p": 0.0316968303169683,
      "mid_p": 0.0268,
      "per_seed": {
       "42": -1.5418502202643172,
       "43": -3.5242290748898677,
       "44": -1.5418502202643172
      },
      "p_het": null,
      "mdd80": 2.7777331814115156,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0317, q 0.30)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 16,
      "a_only": 5,
      "b_only": 11,
      "mean_a": 3.745318352059925,
      "mean_b": 5.992509363295881,
      "rate_a": 3.7453183520599254,
      "rate_b": 5.99250936329588,
      "delta": -2.247191011235955,
      "ci95": [
       -5.555555558621639,
       0.8333333367632649
      ],
      "p": 0.2933706629337066,
      "mid_p": 0.2065,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -3.3707865168539324,
       "44": 0.0
      },
      "p_het": 0.6748325167483251,
      "mdd80": 4.566159590344925,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6230881336645097,
      "label_source": "none",
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.6230881336645097,
      "label_prev": "none",
      "q_published": 0.6230881336645097,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.57)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 271,
      "a_only": 102,
      "b_only": 169,
      "mean_a": 18.533333333333335,
      "mean_b": 23.0,
      "rate_a": 18.53333333333333,
      "rate_b": 23.0,
      "delta": -4.466666666666667,
      "ci95": [
       -6.611570250147857,
       -2.3319615890303496
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -4.6,
       "43": -5.4,
       "44": -3.4
      },
      "p_het": 0.7586241375862414,
      "mdd80": 3.0586501738981364,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.0023997600239976007,
      "label_source": "below_detected",
      "q": 0.011998800119988003,
      "label": "below_detected",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.0001, q 0.0120)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 69,
      "mean_a": 73.4006734006734,
      "mean_b": 73.56902356902357,
      "delta": -0.16835016835016836,
      "ci95": [
       -2.5889967660751694,
       2.287581701730117
      ],
      "p": 1.0,
      "mid_p": 0.8932,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 0.0,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 3.485306428622306,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.49)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 87.22222222222223,
      "mean_b": 87.84722222222223,
      "delta": -0.625,
      "ci95": [
       -1.923076924583763,
       0.6944444457741499
      ],
      "p": 0.393960603939606,
      "mid_p": 0.33995,
      "per_seed": {
       "42": 0.0,
       "43": -0.625,
       "44": -1.25
      },
      "p_het": null,
      "mdd80": 1.870751002858458,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7162920071629201,
      "label_source": "none",
      "q": 0.7504011503611544,
      "label": "none",
      "q_prev": 0.7109063529737252,
      "label_prev": "none",
      "q_published": 0.7162920071629201,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.87)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 67.91483113069016,
      "mean_b": 69.60352422907489,
      "delta": -1.6886930983847284,
      "ci95": [
       -3.4690799414894276,
       0.1406469778395908
      ],
      "p": 0.0776922307769223,
      "mid_p": 0.06495,
      "per_seed": {
       "42": -3.303964757709251,
       "43": -0.44052863436123346,
       "44": -1.3215859030837005
      },
      "p_het": null,
      "mdd80": 2.579883522959188,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.37292270772922703,
      "label_source": "none",
      "q": 0.46615338466153383,
      "label": "none",
      "q_prev": 0.37292270772922703,
      "label_prev": "none",
      "q_published": 0.37292270772922703,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.58)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 17,
      "a_only": 7,
      "b_only": 10,
      "mean_a": 4.868913857677903,
      "mean_b": 5.992509363295881,
      "rate_a": 4.868913857677903,
      "rate_b": 5.99250936329588,
      "delta": -1.1235955056179776,
      "ci95": [
       -3.546099293067706,
       1.3888888912200303
      ],
      "p": 0.5646435356464353,
      "mid_p": 0.39885,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": -1.1235955056179776,
       "44": -1.1235955056179776
      },
      "p_het": 1.0,
      "mdd80": 3.52705204221066,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.8520611353498797,
      "label_source": "none",
      "q": 0.8788555106753476,
      "label": "none",
      "q_prev": 0.8520611353498797,
      "label_prev": "none",
      "q_published": 0.8468971284689712,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.53)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 275,
      "a_only": 127,
      "b_only": 148,
      "mean_a": 21.6,
      "mean_b": 23.0,
      "rate_a": 21.599999999999998,
      "rate_b": 23.0,
      "delta": -1.4,
      "ci95": [
       -3.614457833539172,
       0.8163265328663558
      ],
      "p": 0.24047595240475952,
      "mid_p": 0.2191,
      "per_seed": {
       "42": -1.4,
       "43": -0.4,
       "44": -2.4
      },
      "p_het": 0.7722227777222278,
      "mdd80": 3.1666959402013664,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5652006227948633,
      "label_source": "none",
      "q": 0.6246954251943226,
      "label": "none",
      "q_prev": 0.5652006227948633,
      "label_prev": "none",
      "q_published": 0.5652006227948633,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.17)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 86,
      "mean_a": 71.88552188552188,
      "mean_b": 73.56902356902357,
      "delta": -1.6835016835016836,
      "ci95": [
       -4.333333335956158,
       1.0000000026480222
      ],
      "p": 0.2642735726427357,
      "mid_p": 0.2188,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -7.575757575757576,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 3.8117506144402338,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5849690260331765,
      "label_source": "none",
      "q": 0.6472005860638426,
      "label": "none",
      "q_prev": 0.587274605872746,
      "label_prev": "none",
      "q_published": 0.5849690260331765,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.81)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 32,
      "mean_a": 86.80555555555556,
      "mean_b": 87.84722222222223,
      "delta": -1.0416666666666667,
      "ci95": [
       -3.044871797194604,
       0.8928571449337495
      ],
      "p": 0.38986101389861016,
      "mid_p": 0.35285,
      "per_seed": {
       "42": 0.625,
       "43": -1.6666666666666667,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 2.814307631216824,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7142491857684461,
      "label_source": "none",
      "q": 0.7485331466853316,
      "label": "none",
      "q_prev": 0.7088382070883821,
      "label_prev": "none",
      "q_published": 0.7142491857684461,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.81)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 150,
      "mean_a": 68.4287812041116,
      "mean_b": 69.60352422907489,
      "delta": -1.1747430249632893,
      "ci95": [
       -3.056768560812979,
       0.7183908064480153
      ],
      "p": 0.2508749125087491,
      "mid_p": 0.2232,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": -2.202643171806167,
       "44": -1.5418502202643172
      },
      "p_het": null,
      "mdd80": 2.698118629414787,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.56801866983113,
      "label_source": "none",
      "q": 0.6271872812718727,
      "label": "none",
      "q_prev": 0.56801866983113,
      "label_prev": "none",
      "q_published": 0.56801866983113,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.70)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 18,
      "a_only": 8,
      "b_only": 10,
      "mean_a": 5.2434456928838955,
      "mean_b": 5.992509363295881,
      "rate_a": 5.2434456928838955,
      "rate_b": 5.99250936329588,
      "delta": -0.7490636704119851,
      "ci95": [
       -4.347826090437003,
       2.8368794360187284
      ],
      "p": 0.8508149185081492,
      "mid_p": 0.70985,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 0.32556744325567444,
      "mdd80": 5.134932314620189,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.9497468857765385,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.9497468857765385,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 5.13)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 272,
      "a_only": 106,
      "b_only": 166,
      "mean_a": 19.0,
      "mean_b": 23.0,
      "rate_a": 19.0,
      "rate_b": 23.0,
      "delta": -4.0,
      "ci95": [
       -6.153846155913599,
       -1.8445322771911439
      ],
      "p": 0.0005999400059994001,
      "mid_p": 0.0005,
      "per_seed": {
       "42": -4.4,
       "43": -4.0,
       "44": -3.6
      },
      "p_het": 0.9637036296370363,
      "mdd80": 3.0798805891504815,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.009599040095990401,
      "label_source": "below_detected",
      "q": 0.035996400359964,
      "label": "below_detected",
      "q_prev": 0.009599040095990401,
      "label_prev": "below_detected",
      "q_published": 0.009599040095990401,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.0006, q 0.0360)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 85,
      "mean_a": 72.72727272727273,
      "mean_b": 73.56902356902357,
      "delta": -0.8417508417508418,
      "ci95": [
       -4.081632656335311,
       2.405498285102456
      ],
      "p": 0.6836316368363163,
      "mid_p": 0.6084,
      "per_seed": {
       "42": 3.0303030303030303,
       "43": -6.0606060606060606,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.636373498914135,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9064728886227398,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.64)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 28,
      "mean_a": 86.94444444444444,
      "mean_b": 87.84722222222223,
      "delta": -0.9027777777777778,
      "ci95": [
       -2.272727274610427,
       0.3472222237940764
      ],
      "p": 0.29327067293270676,
      "mid_p": 0.23695,
      "per_seed": {
       "42": -0.625,
       "43": 0.20833333333333334,
       "44": -2.2916666666666665
      },
      "p_het": null,
      "mdd80": 1.8724863938392802,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6230881336645097,
      "label_source": "none",
      "q": 0.6705615152770437,
      "label": "none",
      "q_prev": 0.6230881336645097,
      "label_prev": "none",
      "q_published": 0.6230881336645097,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.87)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 148,
      "mean_a": 68.28193832599119,
      "mean_b": 69.60352422907489,
      "delta": -1.3215859030837005,
      "ci95": [
       -3.1818181837382076,
       0.574712645531105
      ],
      "p": 0.19208079192080793,
      "mid_p": 0.168,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": -0.8810572687224669,
       "44": -2.643171806167401
      },
      "p_het": null,
      "mdd80": 2.6848047529649604,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5124820851248209,
      "label_source": "none",
      "q": 0.5765423457654235,
      "label": "none",
      "q_prev": 0.5124820851248209,
      "label_prev": "none",
      "q_published": 0.5124820851248209,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.68)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 18,
      "a_only": 8,
      "b_only": 10,
      "mean_a": 5.2434456928838955,
      "mean_b": 5.992509363295881,
      "rate_a": 5.2434456928838955,
      "rate_b": 5.99250936329588,
      "delta": -0.7490636704119851,
      "ci95": [
       -3.7037037073483825,
       2.2727272757808548
      ],
      "p": 0.8076192380761924,
      "mid_p": 0.63825,
      "per_seed": {
       "42": -2.247191011235955,
       "43": 0.0,
       "44": 0.0
      },
      "p_het": 0.8853114688531147,
      "mdd80": 4.2713745842978925,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.9420507224639855,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.27)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 274,
      "a_only": 120,
      "b_only": 154,
      "mean_a": 20.733333333333334,
      "mean_b": 23.0,
      "rate_a": 20.733333333333334,
      "rate_b": 23.0,
      "delta": -2.2666666666666666,
      "ci95": [
       -4.417670684890043,
       -0.13280212271199568
      ],
      "p": 0.0448955104489551,
      "mid_p": 0.04015,
      "per_seed": {
       "42": -0.8,
       "43": -2.2,
       "44": -3.8
      },
      "p_het": 0.5522447755224478,
      "mdd80": 3.0624094422255603,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.25654577399402917,
      "label_source": "below_nominal",
      "q": 0.33671632836716325,
      "label": "below_nominal",
      "q_prev": 0.25654577399402917,
      "label_prev": "below_nominal",
      "q_published": 0.25654577399402917,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0449, q 0.34)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 79,
      "mean_a": 73.06397306397307,
      "mean_b": 73.56902356902357,
      "delta": -0.5050505050505051,
      "ci95": [
       -3.2608695681752877,
       2.247191014295825
      ],
      "p": 0.8094190580941906,
      "mid_p": 0.7209,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": -3.0303030303030303,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 3.9366287416610493,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9466237842235193,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9420507224639855,
      "label_prev": "none",
      "q_published": 0.9466237842235193,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.94)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 24,
      "mean_a": 87.5,
      "mean_b": 87.84722222222223,
      "delta": -0.3472222222222222,
      "ci95": [
       -1.909722224189096,
       1.190476192131698
      ],
      "p": 0.7262273772622738,
      "mid_p": 0.65665,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": 1.875,
       "44": -2.0833333333333335
      },
      "p_het": null,
      "mdd80": 2.2157218512410055,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9270987794837537,
      "label_source": "none",
      "q": 0.9370675835642243,
      "label": "none",
      "q_prev": 0.9221934949362207,
      "label_prev": "none",
      "q_published": 0.9270987794837537,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.22)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 147,
      "mean_a": 68.94273127753304,
      "mean_b": 69.60352422907489,
      "delta": -0.6607929515418502,
      "ci95": [
       -2.5862068984328035,
       1.2759170674921436
      ],
      "p": 0.5526447355264473,
      "mid_p": 0.50465,
      "per_seed": {
       "42": 1.9823788546255507,
       "43": -3.303964757709251,
       "44": -0.6607929515418502
      },
      "p_het": null,
      "mdd80": 2.760272509801837,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8341807328701092,
      "label_source": "none",
      "q": 0.8668937027865841,
      "label": "none",
      "q_prev": 0.8394603577616921,
      "label_prev": "none",
      "q_published": 0.8341807328701092,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.76)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 13,
      "a_only": 5,
      "b_only": 8,
      "mean_a": 4.868913857677903,
      "mean_b": 5.992509363295881,
      "rate_a": 4.868913857677903,
      "rate_b": 5.99250936329588,
      "delta": -1.1235955056179776,
      "ci95": [
       -3.1007751958483816,
       0.8130081321816371
      ],
      "p": 0.4540545945405459,
      "mid_p": 0.2891,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -2.247191011235955,
       "44": 2.247191011235955
      },
      "p_het": 0.37736226377362264,
      "mdd80": 2.797193623248898,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.7463911143132261,
      "label_source": "none",
      "q": 0.7839791560412304,
      "label": "none",
      "q_prev": 0.7463911143132261,
      "label_prev": "none",
      "q_published": 0.7515386392395242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.80)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 279,
      "a_only": 126,
      "b_only": 153,
      "mean_a": 21.2,
      "mean_b": 23.0,
      "rate_a": 21.2,
      "rate_b": 23.0,
      "delta": -1.8,
      "ci95": [
       -4.005722463015751,
       0.4016064279056578
      ],
      "p": 0.12068793120687932,
      "mid_p": 0.10705,
      "per_seed": {
       "42": -0.4,
       "43": -1.0,
       "44": -4.0
      },
      "p_het": 0.3685631436856314,
      "mdd80": 3.149932235888824,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.43231497745747816,
      "label_source": "none",
      "q": 0.4948076620909338,
      "label": "none",
      "q_prev": 0.42595740425957407,
      "label_prev": "none",
      "q_published": 0.43231497745747816,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.15)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 77,
      "mean_a": 72.39057239057239,
      "mean_b": 72.89562289562289,
      "delta": -0.5050505050505051,
      "ci95": [
       -3.5842293939524072,
       2.6217228499169742
      ],
      "p": 0.8342165783421658,
      "mid_p": 0.751,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": 0.0,
       "44": 0.0
      },
      "p_het": null,
      "mdd80": 4.435414172883276,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.954184955336242,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.949716349119805,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.44)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 31,
      "mean_a": 87.91666666666667,
      "mean_b": 88.54166666666667,
      "delta": -0.625,
      "ci95": [
       -1.4880952390287936,
       0.20833333459750983
      ],
      "p": 0.21537846215378462,
      "mid_p": 0.16425,
      "per_seed": {
       "42": -3.9583333333333335,
       "43": 0.625,
       "44": 1.4583333333333333
      },
      "p_het": null,
      "mdd80": 1.2124429971531432,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5431293605333344,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5431293605333344,
      "label_prev": "none",
      "q_published": 0.5431293605333344,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.21)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 144,
      "mean_a": 68.79588839941263,
      "mean_b": 68.94273127753304,
      "delta": -0.14684287812041116,
      "ci95": [
       -1.9704433517903317,
       1.6877637148320894
      ],
      "p": 0.9357064293570643,
      "mid_p": 0.87405,
      "per_seed": {
       "42": 0.44052863436123346,
       "43": 0.0,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.614532441281279,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.61)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 15,
      "a_only": 4,
      "b_only": 11,
      "mean_a": 4.49438202247191,
      "mean_b": 7.116104868913857,
      "rate_a": 4.49438202247191,
      "rate_b": 7.116104868913858,
      "delta": -2.6217228464419478,
      "ci95": [
       -5.185185187713881,
       2.7729845459594654e-09
      ],
      "p": 0.0903909609039096,
      "mid_p": 0.054,
      "per_seed": {
       "42": -4.49438202247191,
       "43": -3.3707865168539324,
       "44": 0.0
      },
      "p_het": 0.5456454354564544,
      "mdd80": 3.7058686530546834,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.71)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 256,
      "a_only": 113,
      "b_only": 143,
      "mean_a": 20.6,
      "mean_b": 22.6,
      "rate_a": 20.599999999999998,
      "rate_b": 22.600000000000005,
      "delta": -2.0,
      "ci95": [
       -4.044630406597175,
       2.1632204033525523e-09
      ],
      "p": 0.06569343065693431,
      "mid_p": 0.0571,
      "per_seed": {
       "42": -2.0,
       "43": -0.4,
       "44": -3.6
      },
      "p_het": 0.4804519548045195,
      "mdd80": 2.8907104557261754,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.3354558161205156,
      "label_source": "none",
      "q": 0.42611955020714143,
      "label": "none",
      "q_prev": 0.3354558161205156,
      "label_prev": "none",
      "q_published": 0.3354558161205156,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.89)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 96,
      "mean_a": 71.88552188552188,
      "mean_b": 72.89562289562289,
      "delta": -1.0101010101010102,
      "ci95": [
       -4.494382026335473,
       2.4822695072148755
      ],
      "p": 0.634936506349365,
      "mid_p": 0.56735,
      "per_seed": {
       "42": -2.525252525252525,
       "43": 0.5050505050505051,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.9862354518995495,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.880836771814148,
      "label_source": "none",
      "q": 0.9016849794310509,
      "label": "none",
      "q_prev": 0.880836771814148,
      "label_prev": "none",
      "q_published": 0.880836771814148,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.99)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 37,
      "mean_a": 86.94444444444444,
      "mean_b": 88.54166666666667,
      "delta": -1.5972222222222223,
      "ci95": [
       -3.5256410278740193,
       0.2777777796618082
      ],
      "p": 0.12668733126687332,
      "mid_p": 0.1064,
      "per_seed": {
       "42": -2.7083333333333335,
       "43": -0.8333333333333334,
       "44": -1.25
      },
      "p_het": null,
      "mdd80": 2.7183157429257014,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.43295670432956707,
      "label_source": "none",
      "q": 0.4948076620909338,
      "label": "none",
      "q_prev": 0.42702579057162776,
      "label_prev": "none",
      "q_published": 0.43295670432956707,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.72)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 165,
      "mean_a": 67.40088105726872,
      "mean_b": 68.94273127753304,
      "delta": -1.5418502202643172,
      "ci95": [
       -3.3182503788985933,
       0.2801120465508645
      ],
      "p": 0.10748925107489252,
      "mid_p": 0.09125,
      "per_seed": {
       "42": -0.44052863436123346,
       "43": -1.5418502202643172,
       "44": -2.643171806167401
      },
      "p_het": null,
      "mdd80": 2.571761282368174,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.41519657558053724,
      "label_source": "none",
      "q": 0.4843960048439601,
      "label": "none",
      "q_prev": 0.40870912908709134,
      "label_prev": "none",
      "q_published": 0.41519657558053724,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.57)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 19,
      "a_only": 5,
      "b_only": 14,
      "mean_a": 3.745318352059925,
      "mean_b": 7.116104868913857,
      "rate_a": 3.7453183520599254,
      "rate_b": 7.116104868913858,
      "delta": -3.3707865168539324,
      "ci95": [
       -6.837606841564807,
       3.6590937697579046e-09
      ],
      "p": 0.0933906609339066,
      "mid_p": 0.06015,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -5.617977528089888,
       "44": -1.1235955056179776
      },
      "p_het": 0.54994500549945,
      "mdd80": 4.8868597627172,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.89)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 271,
      "a_only": 105,
      "b_only": 166,
      "mean_a": 18.533333333333335,
      "mean_b": 22.6,
      "rate_a": 18.53333333333333,
      "rate_b": 22.600000000000005,
      "delta": -4.066666666666666,
      "ci95": [
       -6.182795701051447,
       -1.928374653443591
      ],
      "p": 0.0004999500049995,
      "mid_p": 0.0003,
      "per_seed": {
       "42": -6.2,
       "43": -4.6,
       "44": -1.4
      },
      "p_het": 0.19568043195680432,
      "mdd80": 3.0406485049274847,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.008570571514277144,
      "label_source": "below_detected",
      "q": 0.035996400359964,
      "label": "below_detected",
      "q_prev": 0.008570571514277144,
      "label_prev": "below_detected",
      "q_published": 0.008570571514277144,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.0005, q 0.0360)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 73.4006734006734,
      "mean_b": 72.89562289562289,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.508960576673776,
       3.559870553097798
      ],
      "p": 0.8213178682131786,
      "mid_p": 0.74075,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": 5.555555555555555,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.337413268433559,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9522526008268738,
      "label_source": "none",
      "q": 0.9615428701032336,
      "label": "none",
      "q_prev": 0.9476744633228985,
      "label_prev": "none",
      "q_published": 0.9522526008268738,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.34)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 31,
      "mean_a": 87.22222222222223,
      "mean_b": 88.54166666666667,
      "delta": -1.3194444444444444,
      "ci95": [
       -2.6785714300350647,
       1.326640145393803e-09
      ],
      "p": 0.05599440055994401,
      "mid_p": 0.0384,
      "per_seed": {
       "42": -1.875,
       "43": -2.2916666666666665,
       "44": 0.20833333333333334
      },
      "p_het": null,
      "mdd80": 1.914383679229615,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.2986368029863681,
      "label_source": "none",
      "q": 0.3839616038396161,
      "label": "none",
      "q_prev": 0.2986368029863681,
      "label_prev": "none",
      "q_published": 0.2986368029863681,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.91)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 146,
      "mean_a": 67.91483113069016,
      "mean_b": 68.94273127753304,
      "delta": -1.0279001468428781,
      "ci95": [
       -2.6610644273227226,
       0.5979073260135283
      ],
      "p": 0.24427557244275572,
      "mid_p": 0.2126,
      "per_seed": {
       "42": -2.202643171806167,
       "43": 1.5418502202643172,
       "44": -2.4229074889867843
      },
      "p_het": null,
      "mdd80": 2.3291976695523706,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5652006227948633,
      "label_source": "none",
      "q": 0.6246954251943226,
      "label": "none",
      "q_prev": 0.5652006227948633,
      "label_prev": "none",
      "q_published": 0.5652006227948633,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.33)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 22,
      "a_only": 8,
      "b_only": 14,
      "mean_a": 4.868913857677903,
      "mean_b": 7.116104868913857,
      "rate_a": 4.868913857677903,
      "rate_b": 7.116104868913858,
      "delta": -2.247191011235955,
      "ci95": [
       -5.405405409194425,
       0.8130081333939969
      ],
      "p": 0.24567543245675433,
      "mid_p": 0.1707,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": -3.3707865168539324,
       "44": -2.247191011235955
      },
      "p_het": 0.9681031896810319,
      "mdd80": 4.444320303446167,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.5652006227948633,
      "label_source": "none",
      "q": 0.6246954251943226,
      "label": "none",
      "q_prev": 0.5652006227948633,
      "label_prev": "none",
      "q_published": 0.5652006227948633,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.44)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 279,
      "a_only": 132,
      "b_only": 147,
      "mean_a": 21.6,
      "mean_b": 22.6,
      "rate_a": 21.599999999999998,
      "rate_b": 22.600000000000005,
      "delta": -1.0,
      "ci95": [
       -3.217503219642671,
       1.2145749010182971
      ],
      "p": 0.41515848415158485,
      "mid_p": 0.3827,
      "per_seed": {
       "42": -3.0,
       "43": 0.4,
       "44": -0.4
      },
      "p_het": 0.43145685431456854,
      "mdd80": 3.1676205905588475,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.17)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 74,
      "mean_a": 71.88552188552188,
      "mean_b": 72.89562289562289,
      "delta": -1.0101010101010102,
      "ci95": [
       -3.9603960424874853,
       1.9230769258693217
      ],
      "p": 0.5765423457654234,
      "mid_p": 0.50465,
      "per_seed": {
       "42": -1.5151515151515151,
       "43": -2.0202020202020203,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.204937190002435,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8468971284689712,
      "label_source": "none",
      "q": 0.8788555106753476,
      "label": "none",
      "q_prev": 0.8520611353498797,
      "label_prev": "none",
      "q_published": 0.8468971284689712,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.20)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 35,
      "mean_a": 86.80555555555556,
      "mean_b": 88.54166666666667,
      "delta": -1.7361111111111112,
      "ci95": [
       -4.42708333585783,
       0.8680555588138867
      ],
      "p": 0.24727527247275272,
      "mid_p": 0.22425,
      "per_seed": {
       "42": -1.25,
       "43": -3.3333333333333335,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 3.784452921630755,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5652006227948633,
      "label_source": "none",
      "q": 0.6246954251943226,
      "label": "none",
      "q_prev": 0.5652006227948633,
      "label_prev": "none",
      "q_published": 0.5652006227948633,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.78)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 149,
      "mean_a": 68.4287812041116,
      "mean_b": 68.94273127753304,
      "delta": -0.5139500734214391,
      "ci95": [
       -2.341597797853757,
       1.3157894755042099
      ],
      "p": 0.6344365563443656,
      "mid_p": 0.57825,
      "per_seed": {
       "42": 1.3215859030837005,
       "43": -0.22026431718061673,
       "44": -2.643171806167401
      },
      "p_het": null,
      "mdd80": 2.613946532379452,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.880836771814148,
      "label_source": "none",
      "q": 0.9016849794310509,
      "label": "none",
      "q_prev": 0.880836771814148,
      "label_prev": "none",
      "q_published": 0.880836771814148,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.61)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 17,
      "a_only": 6,
      "b_only": 11,
      "mean_a": 5.2434456928838955,
      "mean_b": 7.116104868913857,
      "rate_a": 5.2434456928838955,
      "rate_b": 7.116104868913858,
      "delta": -1.8726591760299625,
      "ci95": [
       -5.0724637712066505,
       1.4492753655252757
      ],
      "p": 0.3675632436756324,
      "mid_p": 0.27065,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": 0.0,
       "44": -2.247191011235955
      },
      "p_het": 0.7393260673932607,
      "mdd80": 4.661108088204161,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6891810818918108,
      "label_source": "none",
      "q": 0.7290510618359651,
      "label": "none",
      "q_prev": 0.6891810818918108,
      "label_prev": "none",
      "q_published": 0.6946077045838723,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.66)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 272,
      "a_only": 109,
      "b_only": 163,
      "mean_a": 19.0,
      "mean_b": 22.6,
      "rate_a": 19.0,
      "rate_b": 22.600000000000005,
      "delta": -3.6,
      "ci95": [
       -5.7692307713123325,
       -1.424501422184791
      ],
      "p": 0.0011998800119988001,
      "mid_p": 0.001,
      "per_seed": {
       "42": -6.0,
       "43": -3.2,
       "44": -1.6
      },
      "p_het": 0.26247375262473754,
      "mdd80": 3.1051921405774565,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.015998400159984,
      "label_source": "below_detected",
      "q": 0.047995200479952004,
      "label": "below_detected",
      "q_prev": 0.015998400159984,
      "label_prev": "below_detected",
      "q_published": 0.015998400159984,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.00120, q 0.0480)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 72.72727272727273,
      "mean_b": 72.89562289562289,
      "delta": -0.16835016835016836,
      "ci95": [
       -3.5294117686162902,
       3.205128208328519
      ],
      "p": 1.0,
      "mid_p": 0.9221,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -0.5050505050505051,
       "44": -1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.813197538072888,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.81)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 86.94444444444444,
      "mean_b": 88.54166666666667,
      "delta": -1.5972222222222223,
      "ci95": [
       -3.750000002162522,
       0.37878788149300946
      ],
      "p": 0.1902809719028097,
      "mid_p": 0.16135,
      "per_seed": {
       "42": -2.5,
       "43": -1.4583333333333333,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 2.950858075661971,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5124820851248209,
      "label_source": "none",
      "q": 0.5765423457654235,
      "label": "none",
      "q_prev": 0.5124820851248209,
      "label_prev": "none",
      "q_published": 0.5124820851248209,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.95)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 157,
      "mean_a": 68.28193832599119,
      "mean_b": 68.94273127753304,
      "delta": -0.6607929515418502,
      "ci95": [
       -2.4132730033025247,
       1.0852713196664436
      ],
      "p": 0.5044495550444955,
      "mid_p": 0.45655,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": 1.1013215859030836,
       "44": -3.7444933920704844
      },
      "p_het": null,
      "mdd80": 2.500420961164504,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7987772651306297,
      "label_source": "none",
      "q": 0.8235911102767274,
      "label": "none",
      "q_prev": 0.7964992974386771,
      "label_prev": "none",
      "q_published": 0.7987772651306297,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.50)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 19,
      "a_only": 7,
      "b_only": 12,
      "mean_a": 5.2434456928838955,
      "mean_b": 7.116104868913857,
      "rate_a": 5.2434456928838955,
      "rate_b": 7.116104868913858,
      "delta": -1.8726591760299625,
      "ci95": [
       -4.878048783745713,
       0.9523809559730816
      ],
      "p": 0.33536646335366466,
      "mid_p": 0.2405,
      "per_seed": {
       "42": -2.247191011235955,
       "43": -2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 1.0,
      "mdd80": 4.1670270226612445,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6651896793791696,
      "label_source": "none",
      "q": 0.7060346596919256,
      "label": "none",
      "q_prev": 0.6651896793791696,
      "label_prev": "none",
      "q_published": 0.6651896793791696,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.17)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 266,
      "a_only": 119,
      "b_only": 147,
      "mean_a": 20.733333333333334,
      "mean_b": 22.6,
      "rate_a": 20.733333333333334,
      "rate_b": 22.600000000000005,
      "delta": -1.8666666666666667,
      "ci95": [
       -3.9743589763769656,
       0.25940337430690574
      ],
      "p": 0.09359064093590641,
      "mid_p": 0.0829,
      "per_seed": {
       "42": -2.4,
       "43": -1.4,
       "44": -1.8
      },
      "p_het": 0.9376062393760624,
      "mdd80": 3.0258836673120393,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.03)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 73.06397306397307,
      "mean_b": 72.89562289562289,
      "delta": 0.16835016835016836,
      "ci95": [
       -2.8735632209797983,
       3.2128514092466194
      ],
      "p": 1.0,
      "mid_p": 0.9171,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": 2.525252525252525,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.349980253170406,
      "key": [
       "nemotron3-nano",
       "gpqa",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.35)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 29,
      "mean_a": 87.5,
      "mean_b": 88.54166666666667,
      "delta": -1.0416666666666667,
      "ci95": [
       -2.450980393409309,
       0.3472222239704206
      ],
      "p": 0.1713828617138286,
      "mid_p": 0.14285,
      "per_seed": {
       "42": -2.7083333333333335,
       "43": 0.20833333333333334,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 1.9998844754220695,
      "key": [
       "nemotron3-nano",
       "aime25",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.4996126893334763,
      "label_source": "none",
      "q": 0.5680527837627196,
      "label": "none",
      "q_prev": 0.4996126893334763,
      "label_prev": "none",
      "q_published": 0.4996126893334763,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.00)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 146,
      "mean_a": 68.94273127753304,
      "mean_b": 68.94273127753304,
      "delta": 0.0,
      "ci95": [
       -1.7615176168008588,
       1.7713365558848175
      ],
      "p": 1.0,
      "mid_p": 0.9671,
      "per_seed": {
       "42": 3.0837004405286343,
       "43": -1.3215859030837005,
       "44": -1.7621145374449338
      },
      "p_het": null,
      "mdd80": 2.5249423219038354,
      "key": [
       "nemotron3-nano",
       "lcb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.52)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 18,
      "a_only": 6,
      "b_only": 12,
      "mean_a": 4.868913857677903,
      "mean_b": 7.116104868913857,
      "rate_a": 4.868913857677903,
      "rate_b": 7.116104868913858,
      "delta": -2.247191011235955,
      "ci95": [
       -5.185185188086429,
       0.7575757606075453
      ],
      "p": 0.21747825217478253,
      "mid_p": 0.1471,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -4.49438202247191,
       "44": 1.1235955056179776
      },
      "p_het": 0.44185581441855815,
      "mdd80": 4.247310501612892,
      "key": [
       "nemotron3-nano",
       "tb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.5431293605333344,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5431293605333344,
      "label_prev": "none",
      "q_published": 0.5431293605333344,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.25)"
     },
     {
      "model": "nemotron3-nano",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 269,
      "a_only": 124,
      "b_only": 145,
      "mean_a": 21.2,
      "mean_b": 22.6,
      "rate_a": 21.2,
      "rate_b": 22.600000000000005,
      "delta": -1.4,
      "ci95": [
       -3.617571061572109,
       0.8163265328661065
      ],
      "p": 0.24117588241175883,
      "mid_p": 0.21815,
      "per_seed": {
       "42": -2.0,
       "43": -0.2,
       "44": -2.0
      },
      "p_het": 0.7504249575042495,
      "mdd80": 3.168920974361634,
      "key": [
       "nemotron3-nano",
       "swe",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5652006227948633,
      "label_source": "none",
      "q": 0.6246954251943226,
      "label": "none",
      "q_prev": 0.5652006227948633,
      "label_prev": "none",
      "q_published": 0.5652006227948633,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.17)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 92,
      "mean_a": 77.10437710437711,
      "mean_b": 75.08417508417509,
      "delta": 2.0202020202020203,
      "ci95": [
       -0.7168458810418085,
       4.810996566419401
      ],
      "p": 0.19118088191180882,
      "mid_p": 0.1588,
      "per_seed": {
       "42": 2.0202020202020203,
       "43": 2.0202020202020203,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 3.9507669046528475,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5124820851248209,
      "label_source": "none",
      "q": 0.5765423457654235,
      "label": "none",
      "q_prev": 0.5124820851248209,
      "label_prev": "none",
      "q_published": 0.5124820851248209,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.95)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 36,
      "mean_a": 87.15277777777777,
      "mean_b": 87.43055555555556,
      "delta": -0.2777777777777778,
      "ci95": [
       -1.4705882363528673,
       0.9259259269349449
      ],
      "p": 0.7204279572042795,
      "mid_p": 0.6367,
      "per_seed": {
       "42": -0.4166666666666667,
       "43": -0.8333333333333334,
       "44": 0.4166666666666667
      },
      "p_het": null,
      "mdd80": 1.7127964360123415,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9270987794837537,
      "label_source": "none",
      "q": 0.9370675835642243,
      "label": "none",
      "q_prev": 0.9221934949362207,
      "label_prev": "none",
      "q_published": 0.9270987794837537,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.71)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 130,
      "mean_a": 80.10279001468429,
      "mean_b": 79.66226138032306,
      "delta": 0.44052863436123346,
      "ci95": [
       -1.255230127133387,
       2.1406727846388858
      ],
      "p": 0.674032596740326,
      "mid_p": 0.6132,
      "per_seed": {
       "42": -0.22026431718061673,
       "43": 0.6607929515418502,
       "44": 0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.4270628120752495,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9064728886227398,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.43)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 17,
      "b_only": 25,
      "mean_a": 22.846441947565545,
      "mean_b": 25.84269662921348,
      "rate_a": 22.84644194756554,
      "rate_b": 25.84269662921348,
      "delta": -2.9962546816479403,
      "ci95": [
       -7.93650794173117,
       1.8518518578343766
      ],
      "p": 0.30256974302569745,
      "mid_p": 0.2409,
      "per_seed": {
       "42": 2.247191011235955,
       "43": -7.865168539325842,
       "44": -3.3707865168539324
      },
      "p_het": 0.24137586241375864,
      "mdd80": 6.995772458152953,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6314498984884122,
      "label_source": "none",
      "q": 0.6786611058520318,
      "label": "none",
      "q_prev": 0.6314498984884122,
      "label_prev": "none",
      "q_published": 0.6314498984884122,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.00)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 253,
      "a_only": 110,
      "b_only": 143,
      "mean_a": 48.0,
      "mean_b": 50.2,
      "rate_a": 48.0,
      "rate_b": 50.199999999999996,
      "delta": -2.2,
      "ci95": [
       -4.166666668581264,
       -0.26350460942084536
      ],
      "p": 0.032996700329967,
      "mid_p": 0.0289,
      "per_seed": {
       "42": -5.2,
       "43": -2.4,
       "44": 1.0
      },
      "p_het": 0.06829317068293171,
      "mdd80": 2.7896025679801815,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_dense",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.21922132111113216,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.21922132111113216,
      "label_prev": "below_nominal",
      "q_published": 0.21922132111113216,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0330, q 0.30)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 85,
      "mean_a": 75.58922558922559,
      "mean_b": 75.08417508417509,
      "delta": 0.5050505050505051,
      "ci95": [
       -2.666666669802906,
       3.666666669785827
      ],
      "p": 0.8389161083891611,
      "mid_p": 0.76065,
      "per_seed": {
       "42": -1.0101010101010102,
       "43": 1.0101010101010102,
       "44": 1.5151515151515151
      },
      "p_het": null,
      "mdd80": 4.526453854645111,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.954184955336242,
      "label_source": "none",
      "q": 0.9631867001979048,
      "label": "none",
      "q_prev": 0.949716349119805,
      "label_prev": "none",
      "q_published": 0.954184955336242,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.53)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 40,
      "mean_a": 85.48611111111111,
      "mean_b": 87.43055555555556,
      "delta": -1.9444444444444444,
      "ci95": [
       -4.166666669242424,
       0.20833333657681397
      ],
      "p": 0.096990300969903,
      "mid_p": 0.0832,
      "per_seed": {
       "42": -2.7083333333333335,
       "43": -2.7083333333333335,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 3.126826676976841,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.13)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 153,
      "mean_a": 78.41409691629956,
      "mean_b": 79.66226138032306,
      "delta": -1.2481644640234948,
      "ci95": [
       -3.0567685607374466,
       0.5822416320851225
      ],
      "p": 0.20687931206879312,
      "mid_p": 0.18085,
      "per_seed": {
       "42": -1.1013215859030836,
       "43": -1.7621145374449338,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.6008123733882287,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5396851619185907,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5396851619185907,
      "label_prev": "none",
      "q_published": 0.5396851619185907,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.60)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 14,
      "b_only": 26,
      "mean_a": 21.348314606741575,
      "mean_b": 25.84269662921348,
      "rate_a": 21.34831460674157,
      "rate_b": 25.84269662921348,
      "delta": -4.49438202247191,
      "ci95": [
       -9.756097566686766,
       0.7936507992412941
      ],
      "p": 0.125987401259874,
      "mid_p": 0.09715,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": -11.235955056179776,
       "44": -1.1235955056179776
      },
      "p_het": 0.1151884811518848,
      "mdd80": 7.539939333051427,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.42702579057162776,
      "label_source": "none",
      "q": 0.4948076620909338,
      "label": "none",
      "q_prev": 0.42702579057162776,
      "label_prev": "none",
      "q_published": 0.43295670432956707,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.54)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 240,
      "a_only": 104,
      "b_only": 136,
      "mean_a": 48.06666666666667,
      "mean_b": 50.2,
      "rate_a": 48.06666666666667,
      "rate_b": 50.199999999999996,
      "delta": -2.1333333333333333,
      "ci95": [
       -4.131054133181269,
       -0.1338688065599672
      ],
      "p": 0.040495950404959506,
      "mid_p": 0.03445,
      "per_seed": {
       "42": -4.2,
       "43": -3.0,
       "44": 0.8
      },
      "p_het": 0.12088791120887911,
      "mdd80": 2.856801301822964,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.24297570242975705,
      "label_source": "below_nominal",
      "q": 0.32396760323967605,
      "label": "below_nominal",
      "q_prev": 0.24297570242975705,
      "label_prev": "below_nominal",
      "q_published": 0.24297570242975705,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0405, q 0.32)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 82,
      "mean_a": 73.06397306397307,
      "mean_b": 75.08417508417509,
      "delta": -2.0202020202020203,
      "ci95": [
       -4.76190476487694,
       0.7092198610235071
      ],
      "p": 0.18848115188481152,
      "mid_p": 0.1557,
      "per_seed": {
       "42": -5.555555555555555,
       "43": 1.0101010101010102,
       "44": -1.5151515151515151
      },
      "p_het": null,
      "mdd80": 3.9102304938459183,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5124820851248209,
      "label_source": "none",
      "q": 0.5765423457654235,
      "label": "none",
      "q_prev": 0.5124820851248209,
      "label_prev": "none",
      "q_published": 0.5124820851248209,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.91)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 26,
      "mean_a": 87.08333333333333,
      "mean_b": 87.43055555555556,
      "delta": -0.3472222222222222,
      "ci95": [
       -1.7628205144611973,
       1.041666668415815
      ],
      "p": 0.6996300369963003,
      "mid_p": 0.6295,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": -0.8333333333333334,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 2.004376074741835,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9125609178212614,
      "label_source": "none",
      "q": 0.9225890597753411,
      "label": "none",
      "q_prev": 0.9076281561033085,
      "label_prev": "none",
      "q_published": 0.9125609178212614,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.00)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 130,
      "mean_a": 78.19383259911895,
      "mean_b": 79.66226138032306,
      "delta": -1.4684287812041117,
      "ci95": [
       -3.1298904556018643,
       0.15503876139936285
      ],
      "p": 0.09729027097290271,
      "mid_p": 0.08215,
      "per_seed": {
       "42": -2.8634361233480177,
       "43": 0.0,
       "44": -1.5418502202643172
      },
      "p_het": null,
      "mdd80": 2.347749552922964,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.35)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 44,
      "a_only": 16,
      "b_only": 28,
      "mean_a": 21.348314606741575,
      "mean_b": 25.84269662921348,
      "rate_a": 21.34831460674157,
      "rate_b": 25.84269662921348,
      "delta": -4.49438202247191,
      "ci95": [
       -9.649122813038794,
       0.7246376861895398
      ],
      "p": 0.11648835116488351,
      "mid_p": 0.08825,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -8.98876404494382,
       "44": -1.1235955056179776
      },
      "p_het": 0.44275572442755723,
      "mdd80": 7.414160234608224,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.4187043982168947,
      "label_source": "none",
      "q": 0.49216131018477094,
      "label": "none",
      "q_prev": 0.4187043982168947,
      "label_prev": "none",
      "q_published": 0.425048404250484,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.41)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 239,
      "a_only": 112,
      "b_only": 127,
      "mean_a": 49.2,
      "mean_b": 50.2,
      "rate_a": 49.199999999999996,
      "rate_b": 50.199999999999996,
      "delta": -1.0,
      "ci95": [
       -3.1420765049233204,
       1.145038169982427
      ],
      "p": 0.38786121387861217,
      "mid_p": 0.3548,
      "per_seed": {
       "42": -1.4,
       "43": -2.6,
       "44": 1.0
      },
      "p_het": 0.3254674532546745,
      "mdd80": 3.0640147462683327,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r60",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7142491857684461,
      "label_source": "none",
      "q": 0.7485331466853316,
      "label": "none",
      "q_prev": 0.7088382070883821,
      "label_prev": "none",
      "q_published": 0.7142491857684461,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.06)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 82,
      "mean_a": 75.75757575757575,
      "mean_b": 75.08417508417509,
      "delta": 0.6734006734006734,
      "ci95": [
       -2.4822695068664906,
       3.819444447688638
      ],
      "p": 0.7468253174682532,
      "mid_p": 0.66925,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": 2.0202020202020203,
       "44": -0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.5038553777305586,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.939122582587102,
      "label_source": "none",
      "q": 0.948905109489051,
      "label": "none",
      "q_prev": 0.9343065693430657,
      "label_prev": "none",
      "q_published": 0.939122582587102,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.50)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 31,
      "mean_a": 86.52777777777777,
      "mean_b": 87.43055555555556,
      "delta": -0.9027777777777778,
      "ci95": [
       -2.884615386914689,
       1.0416666684988014
      ],
      "p": 0.43485651434856515,
      "mid_p": 0.39655,
      "per_seed": {
       "42": -1.6666666666666667,
       "43": -0.625,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 2.806126504199508,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7355348381245792,
      "label_source": "none",
      "q": 0.7677480427139768,
      "label": "none",
      "q_prev": 0.7304269573042697,
      "label_prev": "none",
      "q_published": 0.7355348381245792,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.81)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 78.56093979441997,
      "mean_b": 79.66226138032306,
      "delta": -1.1013215859030836,
      "ci95": [
       -2.753623190034393,
       0.5822416319433961
      ],
      "p": 0.21757824217578242,
      "mid_p": 0.18695,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -0.8810572687224669,
       "44": -1.7621145374449338
      },
      "p_het": null,
      "mdd80": 2.3841533948056672,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5431293605333344,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5431293605333344,
      "label_prev": "none",
      "q_published": 0.5431293605333344,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.38)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 42,
      "a_only": 16,
      "b_only": 26,
      "mean_a": 22.09737827715356,
      "mean_b": 25.84269662921348,
      "rate_a": 22.097378277153563,
      "rate_b": 25.84269662921348,
      "delta": -3.745318352059925,
      "ci95": [
       -9.090909096303328,
       1.6260162659884725
      ],
      "p": 0.22177782221777823,
      "mid_p": 0.1763,
      "per_seed": {
       "42": -3.3707865168539324,
       "43": -7.865168539325842,
       "44": 0.0
      },
      "p_het": 0.4016598340165983,
      "mdd80": 7.659421273922674,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.5431293605333344,
      "label_source": "none",
      "q": 0.6048486060484861,
      "label": "none",
      "q_prev": 0.5431293605333344,
      "label_prev": "none",
      "q_published": 0.5431293605333344,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.66)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 247,
      "a_only": 97,
      "b_only": 150,
      "mean_a": 46.666666666666664,
      "mean_b": 50.2,
      "rate_a": 46.666666666666664,
      "rate_b": 50.199999999999996,
      "delta": -3.533333333333333,
      "ci95": [
       -5.649717516358251,
       -1.4157014136647403
      ],
      "p": 0.0008999100089991,
      "mid_p": 0.0006,
      "per_seed": {
       "42": -4.6,
       "43": -2.6,
       "44": -3.4
      },
      "p_het": 0.7277272272772722,
      "mdd80": 3.026065024695358,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u32",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.012704611891752,
      "label_source": "below_detected",
      "q": 0.043195680431956804,
      "label": "below_detected",
      "q_prev": 0.012704611891752,
      "label_prev": "below_detected",
      "q_published": 0.012704611891752,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.0009, q 0.0432)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 83,
      "mean_a": 77.60942760942761,
      "mean_b": 75.08417508417509,
      "delta": 2.525252525252525,
      "ci95": [
       -0.3968254002600262,
       5.555555558668425
      ],
      "p": 0.1274872512748725,
      "mid_p": 0.10395,
      "per_seed": {
       "42": 0.0,
       "43": 5.05050505050505,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 4.254185954091509,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.43295670432956707,
      "label_source": "none",
      "q": 0.4948076620909338,
      "label": "none",
      "q_prev": 0.42702579057162776,
      "label_prev": "none",
      "q_published": 0.43295670432956707,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.25)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 40,
      "mean_a": 86.59722222222223,
      "mean_b": 87.43055555555556,
      "delta": -0.8333333333333334,
      "ci95": [
       -2.7343750017910806,
       1.0416666686828862
      ],
      "p": 0.43825617438256176,
      "mid_p": 0.39635,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": -3.5416666666666665,
       "44": 0.625
      },
      "p_het": null,
      "mdd80": 2.698749214379321,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7355348381245792,
      "label_source": "none",
      "q": 0.7677480427139768,
      "label": "none",
      "q_prev": 0.7304269573042697,
      "label_prev": "none",
      "q_published": 0.7355348381245792,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.70)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 140,
      "mean_a": 79.0748898678414,
      "mean_b": 79.66226138032306,
      "delta": -0.5873715124816447,
      "ci95": [
       -2.4691358044438942,
       1.3043478279519196
      ],
      "p": 0.597040295970403,
      "mid_p": 0.5472,
      "per_seed": {
       "42": -0.6607929515418502,
       "43": -0.22026431718061673,
       "44": -0.8810572687224669
      },
      "p_het": null,
      "mdd80": 2.696920976278097,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8492878522798607,
      "label_source": "none",
      "q": 0.8805499818116347,
      "label": "none",
      "q_prev": 0.8543431371148598,
      "label_prev": "none",
      "q_published": 0.8492878522798607,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.70)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 36,
      "a_only": 16,
      "b_only": 20,
      "mean_a": 24.344569288389515,
      "mean_b": 25.84269662921348,
      "rate_a": 24.34456928838951,
      "rate_b": 25.84269662921348,
      "delta": -1.4981273408239701,
      "ci95": [
       -6.0606060652196465,
       3.0303030348679107
      ],
      "p": 0.6260373962603739,
      "mid_p": 0.52055,
      "per_seed": {
       "42": 3.3707865168539324,
       "43": -5.617977528089888,
       "44": -2.247191011235955
      },
      "p_het": 0.29287071292870714,
      "mdd80": 6.497302183843646,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.880836771814148,
      "label_source": "none",
      "q": 0.9016849794310509,
      "label": "none",
      "q_prev": 0.880836771814148,
      "label_prev": "none",
      "q_published": 0.8786489772075423,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.50)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 233,
      "a_only": 106,
      "b_only": 127,
      "mean_a": 48.8,
      "mean_b": 50.2,
      "rate_a": 48.800000000000004,
      "rate_b": 50.199999999999996,
      "delta": -1.4,
      "ci95": [
       -3.3467202161388547,
       0.5398110680886754
      ],
      "p": 0.1710828917108289,
      "mid_p": 0.15255,
      "per_seed": {
       "42": -2.2,
       "43": -2.4,
       "44": 0.4
      },
      "p_het": 0.4831516848315168,
      "mdd80": 2.7777164992602303,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u64",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.4996126893334763,
      "label_source": "none",
      "q": 0.5680527837627196,
      "label": "none",
      "q_prev": 0.4996126893334763,
      "label_prev": "none",
      "q_published": 0.4996126893334763,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.78)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 77,
      "mean_a": 75.25252525252525,
      "mean_b": 75.08417508417509,
      "delta": 0.16835016835016836,
      "ci95": [
       -2.7210884382883904,
       3.09278350813653
      ],
      "p": 1.0,
      "mid_p": 0.9114,
      "per_seed": {
       "42": -3.5353535353535355,
       "43": 3.0303030303030303,
       "44": 1.0101010101010102
      },
      "p_het": null,
      "mdd80": 4.155193114155121,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.16)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 34,
      "mean_a": 87.91666666666667,
      "mean_b": 87.43055555555556,
      "delta": 0.4861111111111111,
      "ci95": [
       -0.7440476203740192,
       1.7361111121589823
      ],
      "p": 0.51004899510049,
      "mid_p": 0.4417,
      "per_seed": {
       "42": 0.8333333333333334,
       "43": -0.20833333333333334,
       "44": 0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.772577480618562,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7987772651306297,
      "label_source": "none",
      "q": 0.825581871343067,
      "label": "none",
      "q_prev": 0.7987772651306297,
      "label_prev": "none",
      "q_published": 0.7987772651306297,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.77)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 78.8546255506608,
      "mean_b": 79.66226138032306,
      "delta": -0.8076358296622613,
      "ci95": [
       -2.575107297853643,
       0.9722222239029356
      ],
      "p": 0.416958304169583,
      "mid_p": 0.37375,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": -1.9823788546255507,
       "44": -0.6607929515418502
      },
      "p_het": null,
      "mdd80": 2.5352879007777203,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7199280071992801,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.54)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 49,
      "a_only": 17,
      "b_only": 32,
      "mean_a": 20.224719101123597,
      "mean_b": 25.84269662921348,
      "rate_a": 20.224719101123597,
      "rate_b": 25.84269662921348,
      "delta": -5.617977528089888,
      "ci95": [
       -10.606060611092389,
       -0.7092198535228558
      ],
      "p": 0.0428957104289571,
      "mid_p": 0.0308,
      "per_seed": {
       "42": -5.617977528089888,
       "43": -8.98876404494382,
       "44": -2.247191011235955
      },
      "p_het": 0.6064393560643936,
      "mdd80": 7.073304150262597,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.25109684153535866,
      "label_source": "below_nominal",
      "q": 0.3320958226757969,
      "label": "below_nominal",
      "q_prev": 0.25109684153535866,
      "label_prev": "below_nominal",
      "q_published": 0.25109684153535866,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0429, q 0.33)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "fp8kv_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 235,
      "a_only": 112,
      "b_only": 123,
      "mean_a": 49.46666666666667,
      "mean_b": 50.2,
      "rate_a": 49.46666666666667,
      "rate_b": 50.199999999999996,
      "delta": -0.7333333333333333,
      "ci95": [
       -2.7465667933957,
       1.2820512839809726
      ],
      "p": 0.5178482151784821,
      "mid_p": 0.47505,
      "per_seed": {
       "42": -1.2,
       "43": -1.0,
       "44": 0.0
      },
      "p_het": 0.8873112688731127,
      "mdd80": 2.879266390614261,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u128",
       "fp8kv_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8018294944699078,
      "label_source": "none",
      "q": 0.8285571442855714,
      "label": "none",
      "q_prev": 0.8018294944699078,
      "label_prev": "none",
      "q_published": 0.8018294944699078,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.88)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 82,
      "mean_a": 77.10437710437711,
      "mean_b": 76.43097643097643,
      "delta": 0.6734006734006734,
      "ci95": [
       -2.539682542700348,
       3.883495148706246
      ],
      "p": 0.7531246875312468,
      "mid_p": 0.6793,
      "per_seed": {
       "42": 2.525252525252525,
       "43": -3.5353535353535355,
       "44": 3.0303030303030303
      },
      "p_het": null,
      "mdd80": 4.590665903940224,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.939122582587102,
      "label_source": "none",
      "q": 0.948905109489051,
      "label": "none",
      "q_prev": 0.9343065693430657,
      "label_prev": "none",
      "q_published": 0.939122582587102,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.59)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 27,
      "mean_a": 87.15277777777777,
      "mean_b": 87.91666666666667,
      "delta": -0.7638888888888888,
      "ci95": [
       -1.7045454558420023,
       0.17361111229665618
      ],
      "p": 0.1518848115188481,
      "mid_p": 0.11775,
      "per_seed": {
       "42": -0.8333333333333334,
       "43": -0.625,
       "44": -0.8333333333333334
      },
      "p_het": null,
      "mdd80": 1.3423245835391824,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.46142221220915886,
      "label_source": "none",
      "q": 0.5282949965872978,
      "label": "none",
      "q_prev": 0.46142221220915886,
      "label_prev": "none",
      "q_published": 0.46142221220915886,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.34)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 115,
      "mean_a": 80.10279001468429,
      "mean_b": 80.46989720998532,
      "delta": -0.3671071953010279,
      "ci95": [
       -1.7906336101467097,
       1.0558069396195102
      ],
      "p": 0.6918308169183082,
      "mid_p": 0.62015,
      "per_seed": {
       "42": 1.1013215859030836,
       "43": 0.0,
       "44": -2.202643171806167
      },
      "p_het": null,
      "mdd80": 2.034360281965535,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9123043739582085,
      "label_source": "none",
      "q": 0.9224410892244108,
      "label": "none",
      "q_prev": 0.9073191041551583,
      "label_prev": "none",
      "q_published": 0.9123043739582085,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.03)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 31,
      "a_only": 14,
      "b_only": 17,
      "mean_a": 22.846441947565545,
      "mean_b": 23.970037453183522,
      "rate_a": 22.84644194756554,
      "rate_b": 23.970037453183522,
      "delta": -1.1235955056179776,
      "ci95": [
       -5.303030307243713,
       3.0303030344988118
      ],
      "p": 0.7302269773022698,
      "mid_p": 0.60625,
      "per_seed": {
       "42": -1.1235955056179776,
       "43": 1.1235955056179776,
       "44": -3.3707865168539324
      },
      "p_het": 0.712928707129287,
      "mdd80": 5.955860335186861,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.9223919713291829,
      "label_source": "none",
      "q": 0.9371897034895442,
      "label": "none",
      "q_prev": 0.9223919713291829,
      "label_prev": "none",
      "q_published": 0.9272723521298665,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 5.96)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_dense",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 253,
      "a_only": 107,
      "b_only": 146,
      "mean_a": 48.0,
      "mean_b": 50.6,
      "rate_a": 48.0,
      "rate_b": 50.6,
      "delta": -2.6,
      "ci95": [
       -4.489795920291401,
       -0.6944444424670901
      ],
      "p": 0.007999200079992,
      "mid_p": 0.0071,
      "per_seed": {
       "42": -5.0,
       "43": -3.2,
       "44": 0.4
      },
      "p_het": 0.12318768123187682,
      "mdd80": 2.712549996246756,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_dense",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.07999200079992001,
      "label_source": "below_detected",
      "q": 0.1371291442284343,
      "label": "below_nominal",
      "q_prev": 0.07999200079992001,
      "label_prev": "below_detected",
      "q_published": 0.07999200079992001,
      "label_published": "below_detected",
      "changed": true,
      "text": "below, nominal (p 0.00800, q 0.137)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 81,
      "mean_a": 75.58922558922559,
      "mean_b": 76.43097643097643,
      "delta": -0.8417508417508418,
      "ci95": [
       -3.875968995730034,
       2.1806853610446906
      ],
      "p": 0.665033496650335,
      "mid_p": 0.58715,
      "per_seed": {
       "42": -0.5050505050505051,
       "43": -4.545454545454546,
       "44": 2.525252525252525
      },
      "p_het": null,
      "mdd80": 4.328710489326038,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9064728886227398,
      "label_source": "none",
      "q": 0.9166010773224352,
      "label": "none",
      "q_prev": 0.9014922683555819,
      "label_prev": "none",
      "q_published": 0.9064728886227398,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.33)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 35,
      "mean_a": 85.48611111111111,
      "mean_b": 87.91666666666667,
      "delta": -2.4305555555555554,
      "ci95": [
       -4.42708333521295,
       -0.5208333309362086
      ],
      "p": 0.0091990800919908,
      "mid_p": 0.00605,
      "per_seed": {
       "42": -3.125,
       "43": -2.5,
       "44": -1.6666666666666667
      },
      "p_het": null,
      "mdd80": 2.7918095323582195,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.08831116888311169,
      "label_source": "below_detected",
      "q": 0.1471852814718528,
      "label": "below_nominal",
      "q_prev": 0.08831116888311169,
      "label_prev": "below_detected",
      "q_published": 0.08831116888311169,
      "label_published": "below_detected",
      "changed": true,
      "text": "below, nominal (p 0.00920, q 0.147)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 142,
      "mean_a": 78.41409691629956,
      "mean_b": 80.46989720998532,
      "delta": -2.0558002936857562,
      "ci95": [
       -3.7356321855476953,
       -0.40816326378082946
      ],
      "p": 0.021397860213978603,
      "mid_p": 0.01685,
      "per_seed": {
       "42": 0.22026431718061673,
       "43": -2.4229074889867843,
       "44": -3.9647577092511015
      },
      "p_het": null,
      "mdd80": 2.3781528177263915,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.1834102304055309,
      "label_source": "below_nominal",
      "q": 0.28530480285304805,
      "label": "below_nominal",
      "q_prev": 0.1834102304055309,
      "label_prev": "below_nominal",
      "q_published": 0.1834102304055309,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0214, q 0.29)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 37,
      "a_only": 15,
      "b_only": 22,
      "mean_a": 21.348314606741575,
      "mean_b": 23.970037453183522,
      "rate_a": 21.34831460674157,
      "rate_b": 23.970037453183522,
      "delta": -2.6217228464419478,
      "ci95": [
       -7.971014497915631,
       2.7777777844549636
      ],
      "p": 0.41235876412358763,
      "mid_p": 0.341,
      "per_seed": {
       "42": -4.49438202247191,
       "43": -2.247191011235955,
       "44": -1.1235955056179776
      },
      "p_het": 0.8571142885711429,
      "mdd80": 7.682196664935915,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.7147856642907138,
      "label_source": "none",
      "q": 0.7524059624112777,
      "label": "none",
      "q_prev": 0.7147856642907138,
      "label_prev": "none",
      "q_published": 0.7199280071992801,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.68)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r40",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 252,
      "a_only": 107,
      "b_only": 145,
      "mean_a": 48.06666666666667,
      "mean_b": 50.6,
      "rate_a": 48.06666666666667,
      "rate_b": 50.6,
      "delta": -2.533333333333333,
      "ci95": [
       -4.687500002097613,
       -0.39370078529956376
      ],
      "p": 0.0263973602639736,
      "mid_p": 0.02265,
      "per_seed": {
       "42": -4.0,
       "43": -3.8,
       "44": 0.2
      },
      "p_het": 0.1750824917508249,
      "mdd80": 3.068792210013342,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r40",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.2184609125294367,
      "label_source": "below_nominal",
      "q": 0.30041440300414407,
      "label": "below_nominal",
      "q_prev": 0.2184609125294367,
      "label_prev": "below_nominal",
      "q_published": 0.2184609125294367,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0264, q 0.30)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 78,
      "mean_a": 73.06397306397307,
      "mean_b": 76.43097643097643,
      "delta": -3.367003367003367,
      "ci95": [
       -6.382978726570993,
       -0.3436426086077872
      ],
      "p": 0.0385961403859614,
      "mid_p": 0.02995,
      "per_seed": {
       "42": -5.05050505050505,
       "43": -4.545454545454546,
       "44": -0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.316333087944991,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.2375147100674548,
      "label_source": "below_nominal",
      "q": 0.3194163342286461,
      "label": "below_nominal",
      "q_prev": 0.2375147100674548,
      "label_prev": "below_nominal",
      "q_published": 0.2375147100674548,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0386, q 0.32)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 87.08333333333333,
      "mean_b": 87.91666666666667,
      "delta": -0.8333333333333334,
      "ci95": [
       -2.0833333356954533,
       0.48076923229348756
      ],
      "p": 0.2633736626337366,
      "mid_p": 0.21965,
      "per_seed": {
       "42": 0.0,
       "43": -0.625,
       "44": -1.875
      },
      "p_het": null,
      "mdd80": 1.8325724117550786,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5849690260331765,
      "label_source": "none",
      "q": 0.6472005860638426,
      "label": "none",
      "q_prev": 0.587274605872746,
      "label_prev": "none",
      "q_published": 0.5849690260331765,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.83)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 78.19383259911895,
      "mean_b": 80.46989720998532,
      "delta": -2.276064610866373,
      "ci95": [
       -3.7558685461774797,
       -0.7680491535696918
      ],
      "p": 0.0025997400259974,
      "mid_p": 0.0019,
      "per_seed": {
       "42": -1.5418502202643172,
       "43": -0.6607929515418502,
       "44": -4.6255506607929515
      },
      "p_het": null,
      "mdd80": 2.1354041989413366,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.029711314582827428,
      "label_source": "below_detected",
      "q": 0.069326400693264,
      "label": "below_detected",
      "q_prev": 0.029711314582827428,
      "label_prev": "below_detected",
      "q_published": 0.029711314582827428,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.00260, q 0.0693)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 17,
      "b_only": 24,
      "mean_a": 21.348314606741575,
      "mean_b": 23.970037453183522,
      "rate_a": 21.34831460674157,
      "rate_b": 23.970037453183522,
      "delta": -2.6217228464419478,
      "ci95": [
       -7.246376816069949,
       2.040816330754076
      ],
      "p": 0.3468653134686531,
      "mid_p": 0.27535,
      "per_seed": {
       "42": -6.741573033707865,
       "43": 0.0,
       "44": -1.1235955056179776
      },
      "p_het": 0.49805019498050196,
      "mdd80": 6.637587027908607,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.6768103677437134,
      "label_source": "none",
      "q": 0.7176523726937651,
      "label": "none",
      "q_prev": 0.6768103677437134,
      "label_prev": "none",
      "q_published": 0.6823579937088259,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.64)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_r60",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 255,
      "a_only": 117,
      "b_only": 138,
      "mean_a": 49.2,
      "mean_b": 50.6,
      "rate_a": 49.199999999999996,
      "rate_b": 50.6,
      "delta": -1.4,
      "ci95": [
       -3.5573122550957943,
       0.781250002124591
      ],
      "p": 0.23007699230076992,
      "mid_p": 0.20655,
      "per_seed": {
       "42": -1.2,
       "43": -3.4,
       "44": 0.4
      },
      "p_het": 0.3461653834616538,
      "mdd80": 3.1007845000131096,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_r60",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_r60",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.557762405577624,
      "label_source": "none",
      "q": 0.620432338788593,
      "label": "none",
      "q_prev": 0.557762405577624,
      "label_prev": "none",
      "q_published": 0.557762405577624,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 3.10)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 90,
      "mean_a": 75.75757575757575,
      "mean_b": 76.43097643097643,
      "delta": -0.6734006734006734,
      "ci95": [
       -4.000000003284876,
       2.6936026969688402
      ],
      "p": 0.7694230576942306,
      "mid_p": 0.6979,
      "per_seed": {
       "42": 1.0101010101010102,
       "43": -3.5353535353535355,
       "44": 0.5050505050505051
      },
      "p_het": null,
      "mdd80": 4.783939533805406,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.9419971708412915,
      "label_source": "none",
      "q": 0.955904409559044,
      "label": "none",
      "q_prev": 0.9419971708412915,
      "label_prev": "none",
      "q_published": 0.9419971708412915,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.78)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 33,
      "mean_a": 86.52777777777777,
      "mean_b": 87.91666666666667,
      "delta": -1.3888888888888888,
      "ci95": [
       -3.273809525833679,
       0.4166666684820501
      ],
      "p": 0.19218078192180782,
      "mid_p": 0.16305,
      "per_seed": {
       "42": -2.0833333333333335,
       "43": -0.4166666666666667,
       "44": -1.6666666666666667
      },
      "p_het": null,
      "mdd80": 2.637595291379564,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.5124820851248209,
      "label_source": "none",
      "q": 0.5765423457654235,
      "label": "none",
      "q_prev": 0.5124820851248209,
      "label_prev": "none",
      "q_published": 0.5124820851248209,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.64)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 128,
      "mean_a": 78.56093979441997,
      "mean_b": 80.46989720998532,
      "delta": -1.908957415565345,
      "ci95": [
       -3.437967116648138,
       -0.41152263234679987
      ],
      "p": 0.018598140185981403,
      "mid_p": 0.01475,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": -1.5418502202643172,
       "44": -4.845814977973569
      },
      "p_het": null,
      "mdd80": 2.163009677100748,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.1716751401782899,
      "label_source": "below_nominal",
      "q": 0.27897210278972107,
      "label": "below_nominal",
      "q_prev": 0.1716751401782899,
      "label_prev": "below_nominal",
      "q_published": 0.1716751401782899,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0186, q 0.28)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 41,
      "a_only": 18,
      "b_only": 23,
      "mean_a": 22.09737827715356,
      "mean_b": 23.970037453183522,
      "rate_a": 22.097378277153563,
      "rate_b": 23.970037453183522,
      "delta": -1.8726591760299625,
      "ci95": [
       -7.317073176637393,
       3.546099295893268
      ],
      "p": 0.5980401959804019,
      "mid_p": 0.51165,
      "per_seed": {
       "42": -6.741573033707865,
       "43": 1.1235955056179776,
       "44": 0.0
      },
      "p_het": 0.3187681231876812,
      "mdd80": 7.763944557378078,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.8543431371148598,
      "label_source": "none",
      "q": 0.8805499818116347,
      "label": "none",
      "q_prev": 0.8543431371148598,
      "label_prev": "none",
      "q_published": 0.8492878522798607,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 7.76)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u32",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 237,
      "a_only": 89,
      "b_only": 148,
      "mean_a": 46.666666666666664,
      "mean_b": 50.6,
      "rate_a": 46.666666666666664,
      "rate_b": 50.6,
      "delta": -3.933333333333333,
      "ci95": [
       -5.942028987688146,
       -1.937984494191305
      ],
      "p": 9.999000099990002e-05,
      "mid_p": 0.0,
      "per_seed": {
       "42": -4.4,
       "43": -3.4,
       "44": -4.0
      },
      "p_het": 0.9328067193280672,
      "mdd80": 2.861703570609191,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u32",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u32",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.0023997600239976007,
      "label_source": "below_detected",
      "q": 0.011998800119988003,
      "label": "below_detected",
      "q_prev": 0.0023997600239976007,
      "label_prev": "below_detected",
      "q_published": 0.0023997600239976007,
      "label_published": "below_detected",
      "changed": false,
      "text": "below, detected (p 0.0001, q 0.0120)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 79,
      "mean_a": 77.60942760942761,
      "mean_b": 76.43097643097643,
      "delta": 1.1784511784511784,
      "ci95": [
       -2.12765957795083,
       4.494382026159243
      ],
      "p": 0.5526447355264473,
      "mid_p": 0.48925,
      "per_seed": {
       "42": 0.5050505050505051,
       "43": -0.5050505050505051,
       "44": 3.5353535353535355
      },
      "p_het": null,
      "mdd80": 4.732794586569287,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.8341807328701092,
      "label_source": "none",
      "q": 0.8668937027865841,
      "label": "none",
      "q_prev": 0.8394603577616921,
      "label_prev": "none",
      "q_published": 0.8341807328701092,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.73)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 29,
      "mean_a": 86.59722222222223,
      "mean_b": 87.91666666666667,
      "delta": -1.3194444444444444,
      "ci95": [
       -2.976190477974744,
       0.2976190493611495
      ],
      "p": 0.15898410158984103,
      "mid_p": 0.1326,
      "per_seed": {
       "42": 0.0,
       "43": -3.3333333333333335,
       "44": -0.625
      },
      "p_het": null,
      "mdd80": 2.3398022746969023,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.47695230476952305,
      "label_source": "none",
      "q": 0.5450883483080263,
      "label": "none",
      "q_prev": 0.47695230476952305,
      "label_prev": "none",
      "q_published": 0.47695230476952305,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.34)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 131,
      "mean_a": 79.0748898678414,
      "mean_b": 80.46989720998532,
      "delta": -1.395007342143906,
      "ci95": [
       -3.044871796672309,
       0.28612303454006394
      ],
      "p": 0.11548845115488451,
      "mid_p": 0.09765,
      "per_seed": {
       "42": 0.6607929515418502,
       "43": -0.8810572687224669,
       "44": -3.9647577092511015
      },
      "p_het": null,
      "mdd80": 2.3806727966292835,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.425048404250484,
      "label_source": "none",
      "q": 0.49216131018477094,
      "label": "none",
      "q_prev": 0.4187043982168947,
      "label_prev": "none",
      "q_published": 0.425048404250484,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.38)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 31,
      "a_only": 16,
      "b_only": 15,
      "mean_a": 24.344569288389515,
      "mean_b": 23.970037453183522,
      "rate_a": 24.34456928838951,
      "rate_b": 23.970037453183522,
      "delta": 0.37453183520599254,
      "ci95": [
       -4.385964917839919,
       5.185185189945026
      ],
      "p": 1.0,
      "mid_p": 0.88465,
      "per_seed": {
       "42": 0.0,
       "43": 3.3707865168539324,
       "44": -2.247191011235955
      },
      "p_het": 0.523047695230477,
      "mdd80": 6.840531987786297,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.84)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u64",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 235,
      "a_only": 104,
      "b_only": 131,
      "mean_a": 48.8,
      "mean_b": 50.6,
      "rate_a": 48.800000000000004,
      "rate_b": 50.6,
      "delta": -1.8,
      "ci95": [
       -3.825136614090961,
       0.2624671936263348
      ],
      "p": 0.09409059094090591,
      "mid_p": 0.08255,
      "per_seed": {
       "42": -2.0,
       "43": -3.2,
       "44": -0.2
      },
      "p_het": 0.4914508549145086,
      "mdd80": 2.9214236831730496,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u64",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u64",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.39575703446604493,
      "label_source": "none",
      "q": 0.47652377619380926,
      "label": "none",
      "q_prev": 0.39575703446604493,
      "label_prev": "none",
      "q_published": 0.39575703446604493,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.92)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "gpqa",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 594,
      "n_clusters": 198,
      "n_diff_items": 85,
      "mean_a": 75.25252525252525,
      "mean_b": 76.43097643097643,
      "delta": -1.1784511784511784,
      "ci95": [
       -4.214559390428923,
       1.851851854630827
      ],
      "p": 0.5125487451254874,
      "mid_p": 0.44825,
      "per_seed": {
       "42": -3.0303030303030303,
       "43": -2.525252525252525,
       "44": 2.0202020202020203
      },
      "p_het": null,
      "mdd80": 4.3356837689907985,
      "key": [
       "nemotron3.5-lightning",
       "gpqa",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.7987772651306297,
      "label_source": "none",
      "q": 0.825581871343067,
      "label": "none",
      "q_prev": 0.7987772651306297,
      "label_prev": "none",
      "q_published": 0.7987772651306297,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 4.34)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "aime25",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 90,
      "n_clusters": 30,
      "n_diff_items": 30,
      "mean_a": 87.91666666666667,
      "mean_b": 87.91666666666667,
      "delta": 0.0,
      "ci95": [
       -1.1217948730971083,
       1.1363636379261797
      ],
      "p": 1.0,
      "mid_p": 0.95185,
      "per_seed": {
       "42": 0.4166666666666667,
       "43": 0.0,
       "44": -0.4166666666666667
      },
      "p_het": null,
      "mdd80": 1.6139132031355825,
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 1.0,
      "label_source": "none",
      "q": 1.0,
      "label": "none",
      "q_prev": 1.0,
      "label_prev": "none",
      "q_published": 1.0,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 1.61)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "lcb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1362,
      "n_clusters": 454,
      "n_diff_items": 134,
      "mean_a": 78.8546255506608,
      "mean_b": 80.46989720998532,
      "delta": -1.6152716593245227,
      "ci95": [
       -3.144654089685927,
       -0.1377410454504864
      ],
      "p": 0.048095190480951906,
      "mid_p": 0.0394,
      "per_seed": {
       "42": 1.5418502202643172,
       "43": -2.643171806167401,
       "44": -3.7444933920704844
      },
      "p_het": null,
      "mdd80": 2.1490504936135273,
      "key": [
       "nemotron3.5-lightning",
       "lcb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.262337402623374,
      "label_source": "below_nominal",
      "q": 0.33949546221848403,
      "label": "below_nominal",
      "q_prev": 0.262337402623374,
      "label_prev": "below_nominal",
      "q_published": 0.262337402623374,
      "label_published": "below_nominal",
      "changed": false,
      "text": "below, nominal (p 0.0481, q 0.34)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "tb",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 267,
      "n_clusters": 89,
      "n_diff_items": 40,
      "a_only": 15,
      "b_only": 25,
      "mean_a": 20.224719101123597,
      "mean_b": 23.970037453183522,
      "rate_a": 20.224719101123597,
      "rate_b": 23.970037453183522,
      "delta": -3.745318352059925,
      "ci95": [
       -8.333333337971592,
       0.7936507984554173
      ],
      "p": 0.1483851614838516,
      "mid_p": 0.1105,
      "per_seed": {
       "42": -8.98876404494382,
       "43": 0.0,
       "44": -2.247191011235955
      },
      "p_het": 0.28157184281571845,
      "mdd80": 6.523085129180576,
      "key": [
       "nemotron3.5-lightning",
       "tb",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "tbp v1",
      "source_file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "5258d19c0bd01ddbb341475ae2058f16",
      "q_source": 0.46142221220915886,
      "label_source": "none",
      "q": 0.5282949965872978,
      "label": "none",
      "q_prev": 0.46142221220915886,
      "label_prev": "none",
      "q_published": 0.46142221220915886,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 6.52)"
     },
     {
      "model": "nemotron3.5-lightning",
      "bench": "swe",
      "a": "jqs_f_u128",
      "b": "blasst_t50_s1",
      "n_items": 1500,
      "n_clusters": 500,
      "n_diff_items": 235,
      "a_only": 109,
      "b_only": 126,
      "mean_a": 49.46666666666667,
      "mean_b": 50.6,
      "rate_a": 49.46666666666667,
      "rate_b": 50.6,
      "delta": -1.1333333333333333,
      "ci95": [
       -3.137254903922445,
       0.8810572709333877
      ],
      "p": 0.3056694330566943,
      "mid_p": 0.27655,
      "per_seed": {
       "42": -1.0,
       "43": -1.8,
       "44": -0.6
      },
      "p_het": 0.8973102689731027,
      "mdd80": 2.8719007286966334,
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_u128",
       "blasst_t50_s1"
      ],
      "row_arm": "jqs_f_u128",
      "source": "published",
      "source_file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "source_md5": "0fbfda98ffb396326706eee16312b604",
      "q_source": 0.6318023659818893,
      "label_source": "none",
      "q": 0.679265406792654,
      "label": "none",
      "q_prev": 0.6324195166690226,
      "label_prev": "none",
      "q_published": 0.6318023659818893,
      "label_published": "none",
      "changed": false,
      "text": "no detected difference (MDD80 2.87)"
     }
    ],
    "counts": {
     "m": 240,
     "by_bench": {
      "gpqa": 48,
      "aime25": 48,
      "lcb": 48,
      "tb": 48,
      "swe": 48
     },
     "n_p05": 34,
     "n_p05_below": 32,
     "n_p05_above": 2,
     "above_detected": 1,
     "above_nominal": 1,
     "below_detected": 9,
     "below_nominal": 23,
     "none": 206,
     "smallest_q_below": 0.011998800119988003
    },
    "counts_prev": {
     "m": 240,
     "by_bench": {
      "gpqa": 48,
      "aime25": 48,
      "lcb": 48,
      "tb": 48,
      "swe": 48
     },
     "n_p05": 34,
     "n_p05_below": 32,
     "n_p05_above": 2,
     "above_detected": 1,
     "above_nominal": 1,
     "below_detected": 24,
     "below_nominal": 18,
     "none": 196,
     "smallest_q_below": 0.0023997600239976007
    },
    "label_changes": [
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "fp8kv_s1_sxs"
      ],
      "source": "sxs",
      "delta": -0.9402283411685695,
      "p": 0.3174682531746825,
      "q_prev": 0.0023997600239976007,
      "q": 0.6802891139457482,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "fp8kv_s1_sxs"
      ],
      "source": "sxs",
      "delta": -2.2864828513786146,
      "p": 0.006199380061993801,
      "q_prev": 0.0023997600239976007,
      "q": 0.12398760123987601,
      "label_prev": "below_detected",
      "label": "below_nominal"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "fp8kv_s1_sxs"
      ],
      "source": "sxs",
      "delta": -0.1342281879194631,
      "p": 0.9399060093990601,
      "q_prev": 0.005537907747686769,
      "q": 1.0,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "fp8kv_s1_sxs"
      ],
      "source": "sxs",
      "delta": -0.7372654155495979,
      "p": 0.45915408459154083,
      "q_prev": 0.0023997600239976007,
      "q": 0.7871212878712128,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "fp8kv_s1_sxs"
      ],
      "source": "sxs",
      "delta": 0.1341381623071764,
      "p": 0.9388061193880612,
      "q_prev": 0.0023997600239976007,
      "q": 1.0,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "fp8kv_s1_sxs"
      ],
      "source": "sxs",
      "delta": 0.6032171581769437,
      "p": 0.49935006499350065,
      "q_prev": 0.0023997600239976007,
      "q": 0.8208494219071243,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_dense_sxs",
       "blasst_t50_s1_sxs"
      ],
      "source": "sxs",
      "delta": -1.0067114093959733,
      "p": 0.2766723327667233,
      "q_prev": 0.0023997600239976007,
      "q": 0.6705615152770437,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r40_sxs",
       "blasst_t50_s1_sxs"
      ],
      "source": "sxs",
      "delta": -2.2834116856950972,
      "p": 0.005499450054994501,
      "q_prev": 0.0023997600239976007,
      "q": 0.11998800119988001,
      "label_prev": "below_detected",
      "label": "below_nominal"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_r60_sxs",
       "blasst_t50_s1_sxs"
      ],
      "source": "sxs",
      "delta": -0.4024144869215292,
      "p": 0.6826317368263174,
      "q_prev": 0.010498950104989501,
      "q": 0.9166010773224352,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u32_sxs",
       "blasst_t50_s1_sxs"
      ],
      "source": "sxs",
      "delta": -1.0046885465505693,
      "p": 0.2896710328967103,
      "q_prev": 0.0023997600239976007,
      "q": 0.6705615152770437,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u64_sxs",
       "blasst_t50_s1_sxs"
      ],
      "source": "sxs",
      "delta": 0.0,
      "p": 1.0,
      "q_prev": 0.003999600039996001,
      "q": 1.0,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.8-27b",
       "swe",
       "jqs_f_u128_sxs",
       "blasst_t50_s1_sxs"
      ],
      "source": "sxs",
      "delta": 0.46885465505693236,
      "p": 0.6335366463353664,
      "q_prev": 0.003999600039996001,
      "q": 0.9016849794310509,
      "label_prev": "below_detected",
      "label": "none"
     },
     {
      "key": [
       "qwen3.6-35b-a3b",
       "tb",
       "jqs_f_r40",
       "fp8kv_s1"
      ],
      "source": "tbp v1",
      "delta": -8.239700374531836,
      "p": 0.006999300069993001,
      "q_prev": 0.07303617464340523,
      "q": 0.12921784744602463,
      "label_prev": "below_detected",
      "label": "below_nominal"
     },
     {
      "key": [
       "nemotron3.5-lightning",
       "swe",
       "jqs_f_dense",
       "blasst_t50_s1"
      ],
      "source": "published",
      "delta": -2.6,
      "p": 0.007999200079992,
      "q_prev": 0.07999200079992001,
      "q": 0.1371291442284343,
      "label_prev": "below_detected",
      "label": "below_nominal"
     },
     {
      "key": [
       "nemotron3.5-lightning",
       "aime25",
       "jqs_f_r40",
       "blasst_t50_s1"
      ],
      "source": "published",
      "delta": -2.4305555555555554,
      "p": 0.0091990800919908,
      "q_prev": 0.08831116888311169,
      "q": 0.1471852814718528,
      "label_prev": "below_detected",
      "label": "below_nominal"
     }
    ],
    "sources": [
     {
      "source": "published",
      "file": "log/sparse/dev/stats/paired_baselines_bl2_h2h.json",
      "md5": "0fbfda98ffb396326706eee16312b604",
      "members": 180
     },
     {
      "source": "tbp v1",
      "file": "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json",
      "md5": "5258d19c0bd01ddbb341475ae2058f16",
      "members": 48
     },
     {
      "source": "sxs",
      "file": null,
      "md5": null,
      "members": 12
     }
    ],
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.8689355539464156,
        "ci95": [
         -2.62793914413688,
         0.8968609883625264
        ],
        "p": 0.3852614738526147,
        "n_items": 1381,
        "mean_a": 87.32802317161477,
        "mean_b": 88.19695872556119,
        "per_seed": {
         "42": -1.7391304347826086,
         "43": -1.293103448275862,
         "44": 0.437636761487965
        },
        "p_het": 0.5102489751024898,
        "mdd80": 2.519186073291635,
        "shift_vs_primary": 0.07129278722215382,
        "q_sub": 0.7425924074259241,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_dense_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -1.0130246020260492,
        "ci95": [
         -2.769230771097811,
         0.7299270090575598
        ],
        "p": 0.2973702629737026,
        "n_items": 1382,
        "mean_a": 87.4095513748191,
        "mean_b": 88.42257597684515,
        "per_seed": {
         "42": -2.832244008714597,
         "43": -2.159827213822894,
         "44": 1.9565217391304348
        },
        "p_het": 0.038196180381961806,
        "mdd80": 2.5008594010029213,
        "shift_vs_primary": -0.006313192630075903,
        "q_sub": 0.6791096591275452,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r40_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -2.1754894851341553,
        "ci95": [
         -3.819918146151447,
         -0.5547850192564704
        ],
        "p": 0.011498850114988501,
        "n_items": 1379,
        "mean_a": 86.00435097897027,
        "mean_b": 88.17984046410443,
        "per_seed": {
         "42": -0.4357298474945534,
         "43": -4.103671706263499,
         "44": -1.9693654266958425
        },
        "p_het": 0.20407959204079593,
        "mdd80": 2.333601223194569,
        "shift_vs_primary": 0.11099336624445932,
        "q_sub": 0.18398160183981602,
        "label_sub": "below_nominal",
        "label_primary": "below_nominal",
        "label_changed": false
       },
       "jqs_f_r40_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -2.24475018102824,
        "ci95": [
         -3.909774437812889,
         -0.5797101432668013
        ],
        "p": 0.009999000099990002,
        "n_items": 1381,
        "mean_a": 86.09703113685735,
        "mean_b": 88.34178131788559,
        "per_seed": {
         "42": -1.091703056768559,
         "43": -4.761904761904762,
         "44": -0.8676789587852495
        },
        "p_het": 0.14188581141885812,
        "mdd80": 2.380007739059415,
        "shift_vs_primary": 0.03866150466685703,
        "q_sub": 0.1714114302855429,
        "label_sub": "below_nominal",
        "label_primary": "below_nominal",
        "label_changed": false
       },
       "jqs_f_r60_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.1447178002894356,
        "ci95": [
         -1.5736766826650155,
         1.8662519458586484
        ],
        "p": 0.9315068493150684,
        "n_items": 1382,
        "mean_a": 88.27785817655571,
        "mean_b": 88.13314037626628,
        "per_seed": {
         "42": 0.6521739130434783,
         "43": -0.43103448275862066,
         "44": 0.2183406113537118
        },
        "p_het": 0.8636136386361364,
        "mdd80": 2.458528134458832,
        "shift_vs_primary": 0.2789459882088987,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r60_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -0.21691973969631237,
        "ci95": [
         -1.884253029811151,
         1.449275363985738
        ],
        "p": 0.8668133186681332,
        "n_items": 1383,
        "mean_a": 88.1417208966016,
        "mean_b": 88.3586406362979,
        "per_seed": {
         "42": -0.4357298474945534,
         "43": -1.2958963282937366,
         "44": 1.0845986984815619
        },
        "p_het": 0.5236476352364764,
        "mdd80": 2.3824835420159163,
        "shift_vs_primary": 0.18549474722521683,
        "q_sub": 0.9807763409705542,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.6502890173410405,
        "ci95": [
         -2.4566474006461965,
         1.173020529703546
        ],
        "p": 0.5344465553444655,
        "n_items": 1384,
        "mean_a": 87.5,
        "mean_b": 88.15028901734104,
        "per_seed": {
         "42": -0.6507592190889371,
         "43": -1.7241379310344827,
         "44": 0.4357298474945534
        },
        "p_het": 0.6031396860313969,
        "mdd80": 2.5941354281346287,
        "shift_vs_primary": 0.0869763982085574,
        "q_sub": 0.8438629821228402,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -1.0108303249097472,
        "ci95": [
         -2.8064992632785826,
         0.7874015764364357
        ],
        "p": 0.3027697230276972,
        "n_items": 1385,
        "mean_a": 87.36462093862816,
        "mean_b": 88.37545126353791,
        "per_seed": {
         "42": -1.7391304347826086,
         "43": -2.591792656587473,
         "44": 1.2987012987012987
        },
        "p_het": 0.15158484151584842,
        "mdd80": 2.568572572590458,
        "shift_vs_primary": -0.006141778359177952,
        "q_sub": 0.6791096591275452,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.21691973969631237,
        "ci95": [
         -1.4556040773742895,
         1.8842530298118154
        ],
        "p": 0.8714128587141285,
        "n_items": 1383,
        "mean_a": 88.3586406362979,
        "mean_b": 88.1417208966016,
        "per_seed": {
         "42": 1.5217391304347827,
         "43": -1.9396551724137931,
         "44": 1.0893246187363834
        },
        "p_het": 0.18758124187581243,
        "mdd80": 2.3870066939770633,
        "shift_vs_primary": 0.08278157738913597,
        "q_sub": 0.9807763409705542,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": 0.0,
        "ci95": [
         -1.7830609230803798,
         1.7857142875466638
        ],
        "p": 1.0,
        "n_items": 1384,
        "mean_a": 88.36705202312139,
        "mean_b": 88.36705202312139,
        "per_seed": {
         "42": 0.2178649237472767,
         "43": -2.8077753779697625,
         "44": 2.5974025974025974
        },
        "p_het": 0.022897710228977103,
        "mdd80": 2.5506152040867764,
        "shift_vs_primary": 0.0,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.8670520231213873,
        "ci95": [
         -0.7352941192728845,
         2.472527474050511
        ],
        "p": 0.32986701329867013,
        "n_items": 1384,
        "mean_a": 89.01734104046243,
        "mean_b": 88.15028901734104,
        "per_seed": {
         "42": 0.21691973969631237,
         "43": 0.646551724137931,
         "44": 1.7429193899782136
        },
        "p_het": 0.7134286571342866,
        "mdd80": 2.2926404844901778,
        "shift_vs_primary": 0.26383486494444364,
        "q_sub": 0.7006025061210693,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": 0.6498194945848376,
        "ci95": [
         -1.0463378193901973,
         2.359882007643252
        ],
        "p": 0.5038496150384961,
        "n_items": 1385,
        "mean_a": 89.02527075812274,
        "mean_b": 88.37545126353791,
        "per_seed": {
         "42": -0.6521739130434783,
         "43": -0.2159827213822894,
         "44": 2.813852813852814
        },
        "p_het": 0.17378262173782622,
        "mdd80": 2.4344363448340722,
        "shift_vs_primary": 0.1809648395279052,
        "q_sub": 0.8235911102767274,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -1.0810810810810811,
        "ci95": [
         -2.759526939870658,
         0.5882352959289776
        ],
        "p": 0.24337566243375663,
        "n_items": 1480,
        "mean_a": 87.22972972972973,
        "mean_b": 88.3108108108108,
        "per_seed": {
         "42": -2.636916835699797,
         "43": -1.0060362173038229,
         "44": 0.40816326530612246
        },
        "p_het": 0.2715728427157284,
        "mdd80": 2.3926565150058274,
        "shift_vs_primary": -0.14085273991251168,
        "q_sub": 0.6181881811818818,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_dense_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -1.012829169480081,
        "ci95": [
         -2.6888604369288025,
         0.6711409412697416
        ],
        "p": 0.2766723327667233,
        "n_items": 1481,
        "mean_a": 87.30587440918299,
        "mean_b": 88.31870357866306,
        "per_seed": {
         "42": -3.4552845528455283,
         "43": -1.814516129032258,
         "44": 2.231237322515213
        },
        "p_het": 0.012698730126987301,
        "mdd80": 2.401403869727044,
        "shift_vs_primary": -0.006117760084107804,
        "q_sub": 0.664013598640136,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r40_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -2.435723951285521,
        "ci95": [
         -4.055944057615481,
         -0.8207934320212906
        ],
        "p": 0.0028997100289971,
        "n_items": 1478,
        "mean_a": 85.85926928281461,
        "mean_b": 88.29499323410013,
        "per_seed": {
         "42": -1.016260162601626,
         "43": -3.8306451612903225,
         "44": -2.4489795918367347
        },
        "p_het": 0.36676332366763326,
        "mdd80": 2.3121726323865475,
        "shift_vs_primary": -0.14924109990690626,
        "q_sub": 0.06959304069593039,
        "label_sub": "below_detected",
        "label_primary": "below_nominal",
        "label_changed": true
       },
       "jqs_f_r40_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -2.2972972972972974,
        "ci95": [
         -3.901734105761601,
         -0.6877579075802254
        ],
        "p": 0.005499450054994501,
        "n_items": 1480,
        "mean_a": 85.94594594594595,
        "mean_b": 88.24324324324324,
        "per_seed": {
         "42": -1.4256619144602851,
         "43": -4.444444444444445,
         "44": -1.0121457489878543
        },
        "p_het": 0.21197880211978803,
        "mdd80": 2.297039200520026,
        "shift_vs_primary": -0.013885611602200143,
        "q_sub": 0.10998900109989002,
        "label_sub": "below_nominal",
        "label_primary": "below_nominal",
        "label_changed": false
       },
       "jqs_f_r60_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.2700877785280216,
        "ci95": [
         -1.9230769247516912,
         1.3966480464142539
        ],
        "p": 0.8106189381061893,
        "n_items": 1481,
        "mean_a": 87.98109385550303,
        "mean_b": 88.25118163403106,
        "per_seed": {
         "42": 0.2028397565922921,
         "43": -0.2012072434607646,
         "44": -0.814663951120163
        },
        "p_het": 0.8548145185481452,
        "mdd80": 2.372618191145376,
        "shift_vs_primary": -0.13585959060855854,
        "q_sub": 0.9512414612197316,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_r60_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -0.4048582995951417,
        "ci95": [
         -1.9858156044930584,
         1.179554392098156
        ],
        "p": 0.6826317368263174,
        "n_items": 1482,
        "mean_a": 87.85425101214575,
        "mean_b": 88.25910931174089,
        "per_seed": {
         "42": -0.6097560975609756,
         "43": -1.0080645161290323,
         "44": 0.4048582995951417
        },
        "p_het": 0.7832216778322167,
        "mdd80": 2.262300190783688,
        "shift_vs_primary": -0.0024438126736124888,
        "q_sub": 0.9166010773224352,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.8091706001348618,
        "ci95": [
         -2.5606469020144287,
         0.9433962281595306
        ],
        "p": 0.41185881411858816,
        "n_items": 1483,
        "mean_a": 87.45785569790964,
        "mean_b": 88.2670262980445,
        "per_seed": {
         "42": -0.8097165991902834,
         "43": -1.6096579476861168,
         "44": 0.0
        },
        "p_het": 0.7337266273372662,
        "mdd80": 2.504350976487304,
        "shift_vs_primary": -0.07190518458526385,
        "q_sub": 0.7467909925425368,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u32_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -0.9433962264150944,
        "ci95": [
         -2.6717557268175147,
         0.8010680925138074
        ],
        "p": 0.32466753324667535,
        "n_items": 1484,
        "mean_a": 87.33153638814017,
        "mean_b": 88.27493261455525,
        "per_seed": {
         "42": -1.6227180527383367,
         "43": -2.4193548387096775,
         "44": 1.2121212121212122
        },
        "p_het": 0.1658834116588341,
        "mdd80": 2.4820384338930754,
        "shift_vs_primary": 0.06129232013547492,
        "q_sub": 0.6910459396538223,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.0,
        "ci95": [
         -1.5781922541848046,
         1.5781922541848046
        ],
        "p": 1.0,
        "n_items": 1482,
        "mean_a": 88.25910931174089,
        "mean_b": 88.25910931174089,
        "per_seed": {
         "42": 1.2170385395537526,
         "43": -1.6096579476861168,
         "44": 0.4065040650406504
        },
        "p_het": 0.3417658234176582,
        "mdd80": 2.2558782332432075,
        "shift_vs_primary": -0.1341381623071764,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u64_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": 0.0,
        "ci95": [
         -1.7402945131024978,
         1.744186048386959
        ],
        "p": 1.0,
        "n_items": 1483,
        "mean_a": 88.2670262980445,
        "mean_b": 88.2670262980445,
        "per_seed": {
         "42": 0.2032520325203252,
         "43": -2.4193548387096775,
         "44": 2.2222222222222223
        },
        "p_het": 0.0565943405659434,
        "mdd80": 2.490369545275525,
        "shift_vs_primary": 0.0,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.4720161834120027,
        "ci95": [
         -1.0638297887420691,
         2.0202020216519827
        ],
        "p": 0.6113388661133886,
        "n_items": 1483,
        "mean_a": 88.73904248145651,
        "mean_b": 88.2670262980445,
        "per_seed": {
         "42": 0.4048582995951417,
         "43": 0.6036217303822937,
         "44": 0.4065040650406504
        },
        "p_het": 0.9998000199980002,
        "mdd80": 2.2041675256134234,
        "shift_vs_primary": -0.13120097476494097,
        "q_sub": 0.8946422430927637,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_u128_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": 0.4716981132075472,
        "ci95": [
         -1.2195121968160954,
         2.156334233488807
        ],
        "p": 0.6335366463353664,
        "n_items": 1484,
        "mean_a": 88.7466307277628,
        "mean_b": 88.27493261455525,
        "per_seed": {
         "42": -0.2028397565922921,
         "43": -0.20161290322580644,
         "44": 1.8181818181818181
        },
        "p_het": 0.4988501149885011,
        "mdd80": 2.412728379797524,
        "shift_vs_primary": 0.0028434581506148193,
        "q_sub": 0.9016849794310509,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "unavailable",
      "why": "unavailable: the route-(i) scan was not validated before the START marker"
     },
     "drop_probed": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -1.0914051841746248,
        "ci95": [
         -2.788844623165021,
         0.58394160762933
        ],
        "p": 0.23657634236576341,
        "n_items": 1466,
        "mean_a": 87.3806275579809,
        "mean_b": 88.47203274215552,
        "per_seed": {
         "42": -2.4193548387096775,
         "43": -1.0,
         "44": 0.2127659574468085
        },
        "p_het": 0.39346065393460655,
        "mdd80": 2.410541245293813,
        "shift_vs_primary": -0.15117684300605538,
        "q_sub": 0.6181881811818818,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       },
       "jqs_f_dense_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -1.0224948875255624,
        "ci95": [
         -2.649006624096542,
         0.5722460674755757
        ],
        "p": 0.2586741325867413,
        "n_items": 1467,
        "mean_a": 87.4573960463531,
        "mean_b": 88.47989093387866,
        "per_seed": {
         "42": -3.4343434343434343,
         "43": -1.8036072144288577,
         "44": 2.3255813953488373
        },
        "p_het": 0.011998800119988001,
        "mdd80": 2.3022397339185985,
        "shift_vs_primary": -0.015783478129589135,
        "q_sub": 0.6334876716409992,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false
       }
      },
      "other_label_changes": [],
      "left_out": [
       [
        44,
        252
       ],
       [
        44,
        253
       ],
       [
        44,
        254
       ],
       [
        44,
        255
       ],
       [
        44,
        256
       ],
       [
        44,
        257
       ],
       [
        44,
        258
       ],
       [
        44,
        259
       ],
       [
        44,
        263
       ],
       [
        44,
        267
       ],
       [
        44,
        271
       ],
       [
        44,
        272
       ],
       [
        44,
        273
       ],
       [
        44,
        274
       ],
       [
        44,
        275
       ],
       [
        44,
        276
       ],
       [
        44,
        281
       ],
       [
        44,
        298
       ],
       [
        44,
        303
       ],
       [
        44,
        308
       ],
       [
        44,
        310
       ],
       [
        44,
        311
       ],
       [
        44,
        312
       ]
      ],
      "applies_to": [
       "jqs_f_dense_sxs|fp8kv_s1_sxs",
       "jqs_f_dense_sxs|blasst_t50_s1_sxs"
      ],
      "not_applicable": [
       "jqs_f_r40_sxs|fp8kv_s1_sxs",
       "jqs_f_r40_sxs|blasst_t50_s1_sxs",
       "jqs_f_r60_sxs|fp8kv_s1_sxs",
       "jqs_f_r60_sxs|blasst_t50_s1_sxs",
       "jqs_f_u32_sxs|fp8kv_s1_sxs",
       "jqs_f_u32_sxs|blasst_t50_s1_sxs",
       "jqs_f_u64_sxs|fp8kv_s1_sxs",
       "jqs_f_u64_sxs|blasst_t50_s1_sxs",
       "jqs_f_u128_sxs|fp8kv_s1_sxs",
       "jqs_f_u128_sxs|blasst_t50_s1_sxs"
      ]
     },
     "by_period_stack": {
      "status": "unavailable",
      "why": "Final registered stack record and split inputs were not completed."
     },
     "zero_as_failure": {
      "status": "complete",
      "members": {
       "jqs_f_dense_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.7333333333333333,
        "ci95": [
         -2.426564497146642,
         0.9523809540998587
        ],
        "p": 0.44355564443555645,
        "n_items": 1500,
        "mean_a": 87.0,
        "mean_b": 87.73333333333333,
        "per_seed": {
         "42": -2.4,
         "43": -1.0,
         "44": 1.2
        },
        "p_het": 0.17278272172782722,
        "mdd80": 2.414943260103766,
        "shift_vs_primary": 0.20689500783523618,
        "q_sub": 0.7752268251435726,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_dense_sxs": 4,
         "fp8kv_s1_sxs": 8
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "pairs_restored": 11
       },
       "jqs_f_dense_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -0.9333333333333333,
        "ci95": [
         -2.6143790866121854,
         0.7352941191780005
        ],
        "p": 0.31356864313568644,
        "n_items": 1500,
        "mean_a": 87.0,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -3.2,
         "43": -1.6,
         "44": 2.0
        },
        "p_het": 0.031796820317968204,
        "mdd80": 2.3940222914486635,
        "shift_vs_primary": 0.07337807606263991,
        "q_sub": 0.6841497668414978,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_dense_sxs": 4,
         "blasst_t50_s1_sxs": 7
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_dense_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "pairs_restored": 10
       },
       "jqs_f_r40_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -2.2666666666666666,
        "ci95": [
         -3.897849464010484,
         -0.6459948304705941
        ],
        "p": 0.007599240075992401,
        "n_items": 1500,
        "mean_a": 85.46666666666667,
        "mean_b": 87.73333333333333,
        "per_seed": {
         "42": -1.0,
         "43": -3.8,
         "44": -2.0
        },
        "p_het": 0.37376262373762625,
        "mdd80": 2.3241110409779937,
        "shift_vs_primary": 0.019816184711948015,
        "q_sub": 0.1371291442284343,
        "label_sub": "below_nominal",
        "label_primary": "below_nominal",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r40_sxs": 6,
         "fp8kv_s1_sxs": 8
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "pairs_restored": 13
       },
       "jqs_f_r40_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -2.466666666666667,
        "ci95": [
         -4.068241471386363,
         -0.8438818548343479
        ],
        "p": 0.0027997200279972004,
        "n_items": 1500,
        "mean_a": 85.46666666666667,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -1.8,
         "43": -4.4,
         "44": -1.2
        },
        "p_het": 0.28117188281171884,
        "mdd80": 2.3044602632666185,
        "shift_vs_primary": -0.18325498097156956,
        "q_sub": 0.06719328067193281,
        "label_sub": "below_detected",
        "label_primary": "below_nominal",
        "label_changed": true,
        "zero_token_rows": {
         "jqs_f_r40_sxs": 6,
         "blasst_t50_s1_sxs": 7
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r40_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "pairs_restored": 11
       },
       "jqs_f_r60_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.06666666666666667,
        "ci95": [
         -1.7333333349949427,
         1.6000000016616094
        ],
        "p": 1.0,
        "n_items": 1500,
        "mean_a": 87.66666666666667,
        "mean_b": 87.73333333333333,
        "per_seed": {
         "42": 0.2,
         "43": -0.2,
         "44": -0.2
        },
        "p_het": 0.9834016598340166,
        "mdd80": 2.3823441340458293,
        "shift_vs_primary": 0.06756152125279642,
        "q_sub": 1.0,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r60_sxs": 3,
         "fp8kv_s1_sxs": 8
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "pairs_restored": 10
       },
       "jqs_f_r60_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -0.26666666666666666,
        "ci95": [
         -1.8361581937479166,
         1.3175230582190376
        ],
        "p": 0.8055194480551945,
        "n_items": 1500,
        "mean_a": 87.66666666666667,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -0.6,
         "43": -0.8,
         "44": 0.6
        },
        "p_het": 0.7793220677932207,
        "mdd80": 2.2539462071350274,
        "shift_vs_primary": 0.13574782025486254,
        "q_sub": 0.9512414612197316,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_r60_sxs": 3,
         "blasst_t50_s1_sxs": 7
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_r60_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "pairs_restored": 9
       },
       "jqs_f_u32_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": -0.4,
        "ci95": [
         -2.15053763616697,
         1.338688087416286
        ],
        "p": 0.7186281371862814,
        "n_items": 1500,
        "mean_a": 87.33333333333333,
        "mean_b": 87.73333333333333,
        "per_seed": {
         "42": -0.4,
         "43": -1.6,
         "44": 0.8
        },
        "p_het": 0.5169483051694831,
        "mdd80": 2.493760927995922,
        "shift_vs_primary": 0.3372654155495979,
        "q_sub": 0.9370675835642243,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u32_sxs": 1,
         "fp8kv_s1_sxs": 8
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "pairs_restored": 8
       },
       "jqs_f_u32_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": -0.6,
        "ci95": [
         -2.3224043733426747,
         1.1396011414574163
        ],
        "p": 0.5469453054694531,
        "n_items": 1500,
        "mean_a": 87.33333333333333,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": -1.2,
         "43": -2.2,
         "44": 1.6
        },
        "p_het": 0.15958404159584041,
        "mdd80": 2.474306556598694,
        "shift_vs_primary": 0.4046885465505693,
        "q_sub": 0.8668937027865841,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u32_sxs": 1,
         "blasst_t50_s1_sxs": 7
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u32_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "pairs_restored": 7
       },
       "jqs_f_u64_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.4,
        "ci95": [
         -1.1764705897802106,
         1.9920318740932186
        ],
        "p": 0.6842315768423157,
        "n_items": 1500,
        "mean_a": 88.13333333333334,
        "mean_b": 87.73333333333333,
        "per_seed": {
         "42": 1.2,
         "43": -1.6,
         "44": 1.6
        },
        "p_het": 0.22567743225677434,
        "mdd80": 2.264538975297919,
        "shift_vs_primary": 0.2658618376928236,
        "q_sub": 0.9225594294503134,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u64_sxs": 1,
         "fp8kv_s1_sxs": 8
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "pairs_restored": 9
       },
       "jqs_f_u64_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": 0.2,
        "ci95": [
         -1.526717558894914,
         1.9363762120361436
        ],
        "p": 0.8818118188181182,
        "n_items": 1500,
        "mean_a": 88.13333333333334,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": 0.4,
         "43": -2.2,
         "44": 2.4
        },
        "p_het": 0.06329367063293671,
        "mdd80": 2.475084336780903,
        "shift_vs_primary": 0.2,
        "q_sub": 0.9797909097979092,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u64_sxs": 1,
         "blasst_t50_s1_sxs": 7
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u64_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "pairs_restored": 8
       },
       "jqs_f_u128_sxs|fp8kv_s1_sxs": {
        "status": "complete",
        "delta": 0.8666666666666667,
        "ci95": [
         -0.6775067766319302,
         2.42914979914993
        ],
        "p": 0.3114688531146885,
        "n_items": 1500,
        "mean_a": 88.6,
        "mean_b": 87.73333333333333,
        "per_seed": {
         "42": 0.8,
         "43": 0.6,
         "44": 1.2
        },
        "p_het": 0.9681031896810319,
        "mdd80": 2.220337518729045,
        "shift_vs_primary": 0.26344950848972304,
        "q_sub": 0.6841497668414978,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u128_sxs": 1,
         "fp8kv_s1_sxs": 8
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "fp8kv_s1_sxs": 0
        },
        "pairs_restored": 8
       },
       "jqs_f_u128_sxs|blasst_t50_s1_sxs": {
        "status": "complete",
        "delta": 0.6666666666666666,
        "ci95": [
         -1.0014306169494631,
         2.345679013896684
        ],
        "p": 0.47365263473652636,
        "n_items": 1500,
        "mean_a": 88.6,
        "mean_b": 87.93333333333334,
        "per_seed": {
         "42": 0.0,
         "43": 0.0,
         "44": 2.0
        },
        "p_het": 0.5114488551144886,
        "mdd80": 2.3921900961314546,
        "shift_vs_primary": 0.19781201160973427,
        "q_sub": 0.8005396643434248,
        "label_sub": "none",
        "label_primary": "none",
        "label_changed": false,
        "zero_token_rows": {
         "jqs_f_u128_sxs": 1,
         "blasst_t50_s1_sxs": 7
        },
        "zero_token_passes_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "missing_rows_scored_failed": {
         "jqs_f_u128_sxs": 0,
         "blasst_t50_s1_sxs": 0
        },
        "pairs_restored": 7
       }
      },
      "other_label_changes": [],
      "rule": "the addendum v2's zero_token_as_failure: every (seed, instance) an item, no pair dropped; a zero-token row (tokens == 0, whatever its resolved field) or a missing row scores 0 on its side; same test and seed tuple as the contrast; the label its p gets substituted into the family's BH; never decides",
      "items_total": 1500
     }
    }
   }
  },
  "table1": {
   "dense_sxs": {
    "label": "Dense bf16 (reference)",
    "per_seed": [
     84.6,
     89.2,
     86.2
    ],
    "mean": 86.66666666666667,
    "sd": 2.3352373184182698,
    "cell": "86.7 ± 2.3",
    "rate_agentic": 86.66666666666667,
    "zero_token_rows": 4,
    "missing_rows": 0
   },
   "jqs_f_dense_sxs": {
    "label": "Jet-QSparse, dense NVFP4 decode",
    "per_seed": [
     83.8,
     90.0,
     87.2
    ],
    "mean": 87.0,
    "sd": 3.1048349392520063,
    "cell": "87.0 ± 3.1",
    "rate_agentic": 87.0,
    "zero_token_rows": 4,
    "missing_rows": 0
   },
   "jqs_f_r40_sxs": {
    "label": "Jet-QSparse, rho = 0.40",
    "per_seed": [
     85.2,
     87.2,
     84.0
    ],
    "mean": 85.46666666666667,
    "sd": 1.6165807537309533,
    "cell": "85.5 ± 1.6",
    "rate_agentic": 85.46666666666665,
    "zero_token_rows": 6,
    "missing_rows": 0
   },
   "jqs_f_r60_sxs": {
    "label": "Jet-QSparse, rho = 0.60",
    "per_seed": [
     86.4,
     90.8,
     85.8
    ],
    "mean": 87.66666666666667,
    "sd": 2.730079363925767,
    "cell": "87.7 ± 2.7",
    "rate_agentic": 87.66666666666667,
    "zero_token_rows": 3,
    "missing_rows": 0
   },
   "jqs_f_u32_sxs": {
    "label": "Jet-QSparse, N = 32",
    "per_seed": [
     85.8,
     89.4,
     86.8
    ],
    "mean": 87.33333333333333,
    "sd": 1.8583146486355187,
    "cell": "87.3 ± 1.9",
    "rate_agentic": 87.33333333333333,
    "zero_token_rows": 1,
    "missing_rows": 0
   },
   "jqs_f_u64_sxs": {
    "label": "Jet-QSparse, N = 64",
    "per_seed": [
     87.4,
     89.4,
     87.6
    ],
    "mean": 88.13333333333334,
    "sd": 1.1015141094572232,
    "cell": "88.1 ± 1.1",
    "rate_agentic": 88.13333333333333,
    "zero_token_rows": 1,
    "missing_rows": 0
   },
   "jqs_f_u128_sxs": {
    "label": "Jet-QSparse, N = 128",
    "per_seed": [
     87.0,
     91.6,
     87.2
    ],
    "mean": 88.6,
    "sd": 2.599999999999996,
    "cell": "88.6 ± 2.6",
    "rate_agentic": 88.60000000000001,
    "zero_token_rows": 1,
    "missing_rows": 0
   },
   "quest_b2048_s1_sxs": {
    "label": "Quest (2048-token budget)",
    "per_seed": [
     2.6,
     2.2,
     1.6
    ],
    "mean": 2.1333333333333333,
    "sd": 0.5033222956847166,
    "cell": "2.1 ± 0.5",
    "rate_agentic": 2.1333333333333333,
    "zero_token_rows": 83,
    "missing_rows": 0
   },
   "sparq_c8_s1_sxs": {
    "label": "SparQ (r = d/8, k = S/16)",
    "per_seed": [
     87.8,
     91.0,
     87.2
    ],
    "mean": 88.66666666666667,
    "sd": 2.042873792805941,
    "cell": "88.7 ± 2.0",
    "rate_agentic": 88.66666666666667,
    "zero_token_rows": 5,
    "missing_rows": 0
   },
   "loki_k25_d25_s1_sxs": {
    "label": "Loki (k_f = d_f = 0.25)",
    "per_seed": [
     86.0,
     90.0,
     87.8
    ],
    "mean": 87.93333333333334,
    "sd": 2.003330560175563,
    "cell": "87.9 ± 2.0",
    "rate_agentic": 87.93333333333334,
    "zero_token_rows": 3,
    "missing_rows": 0
   },
   "tri_b4096_s1_sxs": {
    "label": "TriAttention (4096 decode tokens)",
    "per_seed": [
     84.0,
     89.0,
     88.2
    ],
    "mean": 87.06666666666666,
    "sd": 2.6857649437978255,
    "cell": "87.1 ± 2.7",
    "rate_agentic": 87.06666666666666,
    "zero_token_rows": 9,
    "missing_rows": 0
   },
   "fp8kv_s1_sxs": {
    "label": "TRT-LLM FP8 KV (FP8 attention, unit scale)",
    "per_seed": [
     86.2,
     91.0,
     86.0
    ],
    "mean": 87.73333333333333,
    "sd": 2.830783166074952,
    "cell": "87.7 ± 2.8",
    "rate_agentic": 87.73333333333333,
    "zero_token_rows": 8,
    "missing_rows": 0
   },
   "blasst_t50_s1_sxs": {
    "label": "BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors)",
    "per_seed": [
     87.0,
     91.6,
     85.2
    ],
    "mean": 87.93333333333334,
    "sd": 3.300505011863079,
    "cell": "87.9 ± 3.3",
    "rate_agentic": 87.93333333333334,
    "zero_token_rows": 7,
    "missing_rows": 0
   }
  },
  "cross": {
   "seed_tuple": [
    20261024,
    29,
    0,
    1
   ],
   "pairs": [
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "dense_sxs",
     "b": "dense_s1",
     "label": "bf16 sxs vs bf16 S1",
     "n_items": 1495,
     "n_clusters": 500,
     "n_diff_items": 177,
     "a_only": 118,
     "b_only": 59,
     "mean_a": 86.88963210702342,
     "mean_b": 82.94314381270902,
     "rate_a": 86.66666666666667,
     "rate_b": 82.73333333333333,
     "delta": 3.9464882943143813,
     "ci95": [
      2.118644065871764,
      5.769230770971845
     ],
     "ci95_bootstrap": [
      2.1390374331550803,
      5.811623246492986
     ],
     "se": 0.9354407599936596,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 4.0241448692152915,
      "43": 2.2,
      "44": 5.622489959839357
     },
     "p_het": 0.267973202679732,
     "mdd80": 2.609086144215092
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "jqs_f_dense_sxs",
     "b": "jqs_f_dense",
     "label": "final dense NVFP4 (sxs) vs final dense NVFP4",
     "n_items": 1491,
     "n_clusters": 499,
     "n_diff_items": 172,
     "a_only": 117,
     "b_only": 55,
     "mean_a": 87.32394366197182,
     "mean_b": 83.16566063044937,
     "rate_a": 87.0,
     "rate_b": 82.8,
     "delta": 4.158283031522468,
     "ci95": [
      2.1306818160433023,
      6.18421052830204
     ],
     "ci95_bootstrap": [
      2.1505015273294483,
      6.25
     ],
     "se": 1.0440642161098284,
     "p": 0.00029997000299970003,
     "mid_p": 0.0002,
     "per_seed": {
      "42": 3.024193548387097,
      "43": 3.006012024048096,
      "44": 6.451612903225806
     },
     "p_het": 0.11588841115888411,
     "mdd80": 2.897070102062505
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "jqs_f_r40_sxs",
     "b": "jqs_f_r40",
     "label": "final rho 0.40 (sxs) vs final rho 0.40",
     "n_items": 1493,
     "n_clusters": 500,
     "n_diff_items": 182,
     "a_only": 122,
     "b_only": 60,
     "mean_a": 85.86738111185532,
     "mean_b": 81.71466845277963,
     "rate_a": 85.46666666666665,
     "rate_b": 81.60000000000001,
     "delta": 4.152712659075687,
     "ci95": [
      2.275960168706858,
      6.030855541930434
     ],
     "ci95_bootstrap": [
      2.216252518468771,
      6.099297977318782
     ],
     "se": 0.9850255364519384,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 6.237424547283702,
      "43": 0.8016032064128257,
      "44": 5.4325955734406435
     },
     "p_het": 0.0183981601839816,
     "mdd80": 2.6836358872310107
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "jqs_f_r60_sxs",
     "b": "jqs_f_r60",
     "label": "final rho 0.60 (sxs) vs final rho 0.60",
     "n_items": 1496,
     "n_clusters": 500,
     "n_diff_items": 190,
     "a_only": 126,
     "b_only": 64,
     "mean_a": 87.83422459893048,
     "mean_b": 83.68983957219251,
     "rate_a": 87.66666666666667,
     "rate_b": 83.6,
     "delta": 4.144385026737968,
     "ci95": [
      2.216427638276333,
      6.075949368911398
     ],
     "ci95_bootstrap": [
      2.2696929238985315,
      6.091030789825971
     ],
     "se": 0.9824600457913928,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 3.8152610441767068,
      "43": 4.4,
      "44": 4.216867469879518
     },
     "p_het": 0.9682031796820318,
     "mdd80": 2.7584126838102137
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "jqs_f_u32_sxs",
     "b": "jqs_f_u32",
     "label": "final N = 32 (sxs) vs final N = 32",
     "n_items": 1499,
     "n_clusters": 500,
     "n_diff_items": 180,
     "a_only": 125,
     "b_only": 55,
     "mean_a": 87.39159439626418,
     "mean_b": 82.72181454302869,
     "rate_a": 87.33333333333333,
     "rate_b": 82.73333333333333,
     "delta": 4.66977985323549,
     "ci95": [
      2.6950354588960286,
      6.640106243661444
     ],
     "ci95_bootstrap": [
      2.6720106880427523,
      6.666666666666667
     ],
     "se": 1.0169568098884534,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 5.01002004008016,
      "43": 4.0,
      "44": 5.0
     },
     "p_het": 0.8555144485551445,
     "mdd80": 2.81955486993344
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "jqs_f_u64_sxs",
     "b": "jqs_f_u64",
     "label": "final N = 64 (sxs) vs final N = 64",
     "n_items": 1499,
     "n_clusters": 500,
     "n_diff_items": 185,
     "a_only": 128,
     "b_only": 57,
     "mean_a": 88.19212808539027,
     "mean_b": 83.45563709139427,
     "rate_a": 88.13333333333333,
     "rate_b": 83.46666666666667,
     "delta": 4.736490993995997,
     "ci95": [
      2.879581150010366,
      6.589147288614046
     ],
     "ci95_bootstrap": [
      2.870493991989319,
      6.604402935290193
     ],
     "se": 0.9469608344369003,
     "p": 0.00019998000199980003,
     "mid_p": 0.0001,
     "per_seed": {
      "42": 6.212424849699399,
      "43": 1.0,
      "44": 7.0
     },
     "p_het": 0.0100989901009899,
     "mdd80": 2.6512389364040607
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "jqs_f_u128_sxs",
     "b": "jqs_f_u128",
     "label": "final N = 128 (sxs) vs final N = 128",
     "n_items": 1498,
     "n_clusters": 500,
     "n_diff_items": 196,
     "a_only": 140,
     "b_only": 56,
     "mean_a": 88.71829105473965,
     "mean_b": 83.11081441922563,
     "rate_a": 88.60000000000001,
     "rate_b": 83.00000000000001,
     "delta": 5.607476635514018,
     "ci95": [
      3.516174400053822,
      7.692307694302585
     ],
     "ci95_bootstrap": [
      3.5380507343124163,
      7.68716577540107
     ],
     "se": 1.0589273695568377,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 5.61122244488978,
      "43": 6.4,
      "44": 4.809619238476954
     },
     "p_het": 0.7522247775222478,
     "mdd80": 2.9846959939884683
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "quest_b2048_s1_sxs",
     "b": "quest_b2048_s1",
     "label": "Quest b2048 (sxs) vs Quest b2048",
     "n_items": 1413,
     "n_clusters": 491,
     "n_diff_items": 53,
     "a_only": 10,
     "b_only": 43,
     "mean_a": 2.264685067232838,
     "mean_b": 4.600141542816702,
     "rate_a": 2.1333333333333333,
     "rate_b": 4.666666666666667,
     "delta": -2.335456475583864,
     "ci95": [
      -3.305785124907585,
      -1.36570561353115
     ],
     "ci95_bootstrap": [
      -3.3451957295373664,
      -1.4094184557663105
     ],
     "se": 0.49628871495791127,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": -1.7241379310344827,
      "43": -2.5,
      "44": -2.771855010660981
     },
     "p_het": 0.7437256274372562,
     "mdd80": 1.386581111670671
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "sparq_c8_s1_sxs",
     "b": "sparq_c8_s1",
     "label": "SparQ c8 (sxs) vs SparQ c8",
     "n_items": 1488,
     "n_clusters": 499,
     "n_diff_items": 160,
     "a_only": 115,
     "b_only": 45,
     "mean_a": 88.97849462365592,
     "mean_b": 84.2741935483871,
     "rate_a": 88.66666666666667,
     "rate_b": 83.66666666666667,
     "delta": 4.704301075268817,
     "ci95": [
      2.884615382761482,
      6.521739132156755
     ],
     "ci95_bootstrap": [
      2.8975253432800607,
      6.564075156808626
     ],
     "se": 0.9274513181631353,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 5.487804878048781,
      "43": 4.008016032064128,
      "44": 4.627766599597585
     },
     "p_het": 0.754024597540246,
     "mdd80": 2.5994641261596043
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "loki_k25_d25_s1_sxs",
     "b": "loki_k25_d25_s1",
     "label": "Loki k25 d25 (sxs) vs Loki k25 d25",
     "n_items": 1492,
     "n_clusters": 500,
     "n_diff_items": 163,
     "a_only": 119,
     "b_only": 44,
     "mean_a": 88.1367292225201,
     "mean_b": 83.10991957104558,
     "rate_a": 87.93333333333334,
     "rate_b": 82.8,
     "delta": 5.02680965147453,
     "ci95": [
      3.299492384158741,
      6.749311296529456
     ],
     "ci95_bootstrap": [
      3.3400133600534403,
      6.7921990585070615
     ],
     "se": 0.8828429338856348,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 6.0728744939271255,
      "43": 3.4,
      "44": 5.622489959839357
     },
     "p_het": 0.35996400359964004,
     "mdd80": 2.4655967523639055
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "tri_b4096_s1_sxs",
     "b": "tri_b4096_s1",
     "label": "TriAttention b4096 (sxs) vs TriAttention b4096",
     "n_items": 1488,
     "n_clusters": 500,
     "n_diff_items": 172,
     "a_only": 120,
     "b_only": 52,
     "mean_a": 87.56720430107526,
     "mean_b": 82.99731182795699,
     "rate_a": 87.06666666666666,
     "rate_b": 82.73333333333333,
     "delta": 4.56989247311828,
     "ci95": [
      2.7631578929697755,
      6.3599458746006
     ],
     "ci95_bootstrap": [
      2.814966267963634,
      6.308830754391262
     ],
     "se": 0.8961428352218341,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 3.054989816700611,
      "43": 3.6,
      "44": 7.042253521126761
     },
     "p_het": 0.12088791120887911,
     "mdd80": 2.570636022270584
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "fp8kv_s1_sxs",
     "b": "fp8kv_s1",
     "label": "FP8 KV (sxs) vs FP8 KV",
     "n_items": 1490,
     "n_clusters": 500,
     "n_diff_items": 144,
     "a_only": 78,
     "b_only": 66,
     "mean_a": 88.18791946308725,
     "mean_b": 87.38255033557047,
     "rate_a": 87.73333333333333,
     "rate_b": 87.13333333333333,
     "delta": 0.8053691275167785,
     "ci95": [
      -0.8010680923788331,
      2.401129945175609
     ],
     "ci95_bootstrap": [
      -0.8059100067159167,
      2.42098184263618
     ],
     "se": 0.8271501165508442,
     "p": 0.37036296370362964,
     "mid_p": 0.33015,
     "per_seed": {
      "42": 0.8064516129032258,
      "43": 1.0,
      "44": 0.6072874493927125
     },
     "p_het": 0.9946005399460054,
     "mdd80": 2.288621310964591
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "blasst_t50_s1_sxs",
     "b": "blasst_t50_s1",
     "label": "BLASST t50 (sxs) vs BLASST t50",
     "n_items": 1491,
     "n_clusters": 500,
     "n_diff_items": 139,
     "a_only": 78,
     "b_only": 61,
     "mean_a": 88.32997987927565,
     "mean_b": 87.18980549966466,
     "rate_a": 87.93333333333334,
     "rate_b": 86.93333333333334,
     "delta": 1.1401743796109993,
     "ci95": [
      -0.40816326687217397,
      2.6950354626309427
     ],
     "ci95_bootstrap": [
      -0.4682274247491639,
      2.735202417989384
     ],
     "se": 0.8077707292359718,
     "p": 0.1795820417958204,
     "mid_p": 0.1553,
     "per_seed": {
      "42": 1.6161616161616161,
      "43": 2.404809619238477,
      "44": -0.6036217303822937
     },
     "p_het": 0.263973602639736,
     "mdd80": 2.2178661847919297
    }
   ],
   "window_diagnostics": [
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "dense_sxs",
     "b": "dense_s1",
     "label": "bf16 sxs vs bf16 S1",
     "n_items": 1495,
     "n_clusters": 500,
     "n_diff_items": 177,
     "a_only": 118,
     "b_only": 59,
     "mean_a": 86.88963210702342,
     "mean_b": 82.94314381270902,
     "rate_a": 86.66666666666667,
     "rate_b": 82.73333333333333,
     "delta": 3.9464882943143813,
     "ci95": [
      2.118644065871764,
      5.769230770971845
     ],
     "ci95_bootstrap": [
      2.1390374331550803,
      5.811623246492986
     ],
     "se": 0.9354407599936596,
     "p": 9.999000099990002e-05,
     "mid_p": 0.0,
     "per_seed": {
      "42": 4.0241448692152915,
      "43": 2.2,
      "44": 5.622489959839357
     },
     "p_het": 0.267973202679732,
     "mdd80": 2.609086144215092
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "a": "dense_sxs",
     "b": "dense_s1d",
     "label": "bf16 sxs vs bf16 S1d (bl2 window control)",
     "n_items": 1491,
     "n_clusters": 500,
     "n_diff_items": 132,
     "a_only": 59,
     "b_only": 73,
     "mean_a": 86.98859825620389,
     "mean_b": 87.92756539235413,
     "rate_a": 86.66666666666667,
     "rate_b": 87.53333333333335,
     "delta": -0.9389671361502347,
     "ci95": [
      -2.4531024547284495,
      0.5509641888563588
     ],
     "ci95_bootstrap": [
      -2.4193548387096775,
      0.5387205387205387
     ],
     "se": 0.762058208421814,
     "p": 0.2538746125387461,
     "mid_p": 0.2202,
     "per_seed": {
      "42": -0.20242914979757085,
      "43": -2.2,
      "44": -0.4024144869215292
     },
     "p_het": 0.5296470352964704,
     "mdd80": 2.1470161618476022
    }
   ],
   "item_index_equal_to_family_bd": true,
   "diagnostic_equals_pair_1": true,
   "note": "descriptive: no BH, no verdict (prereg descriptive.cross_window)"
  },
  "seed_rates": {
   "dense_sxs": [
    84.6,
    89.2,
    86.2
   ],
   "jqs_f_dense_sxs": [
    83.8,
    90.0,
    87.2
   ],
   "jqs_f_r40_sxs": [
    85.2,
    87.2,
    84.0
   ],
   "jqs_f_r60_sxs": [
    86.4,
    90.8,
    85.8
   ],
   "jqs_f_u32_sxs": [
    85.8,
    89.4,
    86.8
   ],
   "jqs_f_u64_sxs": [
    87.4,
    89.4,
    87.6
   ],
   "jqs_f_u128_sxs": [
    87.0,
    91.6,
    87.2
   ],
   "quest_b2048_s1_sxs": [
    2.6,
    2.2,
    1.6
   ],
   "sparq_c8_s1_sxs": [
    87.8,
    91.0,
    87.2
   ],
   "loki_k25_d25_s1_sxs": [
    86.0,
    90.0,
    87.8
   ],
   "tri_b4096_s1_sxs": [
    84.0,
    89.0,
    88.2
   ],
   "fp8kv_s1_sxs": [
    86.2,
    91.0,
    86.0
   ],
   "blasst_t50_s1_sxs": [
    87.0,
    91.6,
    85.2
   ]
  },
  "sens_inputs": {
   "status": "complete",
   "route_prov": {
    "route_i": "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/ctl2/route_i_v1.json",
    "route_i_md5": "34ac3bdd21633be60c937c73db3a6f87",
    "source": {
     "synthesis": "log/sparse/dev/bigmodels/bl2/incidents/leak_1023/synthesis.md",
     "synthesis_md5": "cef3f57b780b2409740ffd9aba79067d",
     "A_exposure_md5": "588ba9b7e45cf511ae108f87ddf09c80",
     "u36_eps3_jsonl": "/tmp/[redacted-session]/-home-hcai-workspace-code-jet-qs/d8ccd053-6e82-448b-a983-3aff57522550/scratchpad/leak_verify/u36_eps3.jsonl (session scratch, not durable)",
     "u36_eps3_md5": "14edcc8ef436ed8de31824fe3141392d",
     "u36_novel_md5": "083c3f58f02275a56dfec818f9184297",
     "u36_idx_md5": "486d75150713df4988327318e4dd8ab9",
     "v_u36scan_md5": "0b03477c20ce7c7ada3b6bc705e64f41",
     "episodes_scanned": 15120
    }
   },
   "dataset_order_n": 500,
   "scan_status": "unavailable: the route-(i) scan was not validated before the START marker",
   "probed": {
    "pairs": [
     [
      44,
      252
     ],
     [
      44,
      253
     ],
     [
      44,
      254
     ],
     [
      44,
      255
     ],
     [
      44,
      256
     ],
     [
      44,
      257
     ],
     [
      44,
      258
     ],
     [
      44,
      259
     ],
     [
      44,
      263
     ],
     [
      44,
      267
     ],
     [
      44,
      271
     ],
     [
      44,
      272
     ],
     [
      44,
      273
     ],
     [
      44,
      274
     ],
     [
      44,
      275
     ],
     [
      44,
      276
     ],
     [
      44,
      281
     ],
     [
      44,
      298
     ],
     [
      44,
      303
     ],
     [
      44,
      308
     ],
     [
      44,
      310
     ],
     [
      44,
      311
     ],
     [
      44,
      312
     ]
    ],
    "instances": [
     "django__django-9296",
     "matplotlib__matplotlib-13989",
     "matplotlib__matplotlib-14623",
     "matplotlib__matplotlib-20488",
     "matplotlib__matplotlib-20676",
     "matplotlib__matplotlib-20826",
     "matplotlib__matplotlib-20859",
     "matplotlib__matplotlib-21568",
     "matplotlib__matplotlib-23299",
     "matplotlib__matplotlib-24026",
     "matplotlib__matplotlib-24627",
     "matplotlib__matplotlib-24637",
     "matplotlib__matplotlib-24870",
     "matplotlib__matplotlib-24970",
     "matplotlib__matplotlib-25122",
     "matplotlib__matplotlib-25287",
     "matplotlib__matplotlib-25960",
     "pydata__xarray-2905",
     "pydata__xarray-3993",
     "pydata__xarray-4687",
     "pydata__xarray-4966",
     "pydata__xarray-6461",
     "pydata__xarray-6599"
    ],
    "line_no": 166
   },
   "probed_why": null
  },
  "proven_reads": null,
  "period": null,
  "inventory": {
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "ae17ac1f8bc091907a6424f0c3b65b57",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard0of8/summary.json": "e3870d686725d4861a436fba10598bb1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "6f2a2c75700c025e7e3e4314f9f9d89c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard1of8/summary.json": "f08e42bd58abaa35106f1f6390f962e7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "42313c9d51984ebabfdececd8686609a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard2of8/summary.json": "5beb8bdb773a363857491288119c7567",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "8035e55a3a1d61b35af4925473bdaeb5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard3of8/summary.json": "3aef6430be656a6d5183b40ac014795b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "23030d416b5b3e7e0e3d7f3c5eb0dd41",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard4of8/summary.json": "15eb3202a566226ac90b371298fd0c19",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "8be63c1b6ad3b94e9e5c30201f5c298f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard5of8/summary.json": "06d3af7814896f2798b66db5866f40cf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "5d73215d8e769a6b01bc124e6dbab726",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard6of8/summary.json": "87fa313e0a8f52da5bbd04fd2750f125",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "fd3cd055f341a26388706e7896bf2270",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed42/shard7of8/summary.json": "4c247ccb0a437ba39160bfe584a8873f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "9fea67703c7773ed53f5169bff74fff2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard0of8/summary.json": "e8db26ca2d1a37e3f4f67b1f6ae6ea2d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "799cbdd42685428b47a1e4d43b9eef13",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard1of8/summary.json": "ca5d0ce001efb6a32f5ead2ba065cfd4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "38e1febae459a6f2ee303f0367ae058e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard2of8/summary.json": "0502ec54efacff9519af48f40bc533b9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "f093f6fa8552f62f60d44ad3ff9ff025",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard3of8/summary.json": "077a7cda8b4066e44456be01bdcb068a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "9860715a748c0aff2f039dc7fbf526d4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard4of8/summary.json": "b8bee856e17d8f374c3235ffa926445c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "73657ef843e55f77fb4ef28c0dec574c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard5of8/summary.json": "eb769d3a50f16544a3a99e4e68cae38e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "012350f08a324dba3516a0c699ae6d09",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard6of8/summary.json": "b1d587a00f2fbb69d34189d0d4c31fe5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "232800eb1f8519cdac6c9402c070590f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed43/shard7of8/summary.json": "aebe4f3d385f1bb9a46ef6bc364e86ea",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "dd33f866072b11d1d9690ab047bb495b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard0of8/summary.json": "501ff5390af441877fb56b7193c7ac0b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "987d38761c9170ccdc54afc42ffbd7fc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard1of8/summary.json": "79af2d44d83edcac8c50f84472e96f56",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "b1d947310bf108b5770108e7fc4887b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard2of8/summary.json": "4092da1340448b6ad195b1d42338cf49",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "7aabde13e940e07541381248b72145ff",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard3of8/summary.json": "cd770c2cb4cdd31d1efb9aafa0105e2a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "8ff46af62fab572a962a0e660e21f355",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard4of8/summary.json": "4dc5f2ceefd6a4fdfbd606e2bdb289c1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "ea62af68b44c6fabec20bb97e0132c1f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard5of8/summary.json": "d5e7bc3fb296c4a90f8965a27cd72d80",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "c150a09cb4ba3b6c1e2d99ef618d5934",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard6of8/summary.json": "2f8d9f053c74688b078b01ec4f41a613",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "83d48804fe8953c392c9fceb0a53d8b7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_sxs/swebench/seed44/shard7of8/summary.json": "0e056e8929b6c41c99d36d6b787e2683",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "387d58fcc9859eb861faf68c1b6c3f4c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard0of8/summary.json": "9c714075f676d914bc644aa8bdadfd69",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "aae4151596946cbbdf9c922eb97c443a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard1of8/summary.json": "69e5c04ecde9a4300a640bd6ece3f89f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "bd6e119fb5046a9b574adf9d3941cc47",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard2of8/summary.json": "91baee9e5ff01c3c92342288a6383f02",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "9da059cd02749048b0808ddd330a0518",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard3of8/summary.json": "b370e9f58c56207fad1b1b5d5d7e4bb8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "9b122ef0e34b82418063e3eda9c9fd6b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard4of8/summary.json": "f46b0d3effc520acc60080ad5fc81f52",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "d6330f214cfea801bf61cc050b547171",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard5of8/summary.json": "859eb5f1b6c029905c504bae8467775e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "221c1c397b307c47cf87a375bec2a13a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard6of8/summary.json": "9795822178050b7a5a4f9c6b068f2847",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "ef465443b32a51ef411862a96941f407",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed42/shard7of8/summary.json": "fc71e11b163fa4ccd8e7b2a97abfd74b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "48c47cbe5e186aa73818a77b34423305",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard0of8/summary.json": "abf2276cf296454eda6c3b6cefc44938",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "ecbe0b85184da04792d2e1b05c35c21d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard1of8/summary.json": "328d34e62ca12ee92d638c9be23b2d68",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "c77c34ed2336aa409681ea797adac73c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard2of8/summary.json": "d274dc352fa03b269039d7324a94dd83",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "4a0fa2709ed275696b020343cb613ff3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard3of8/summary.json": "77ae1de71f912796ad4249bbf63cea7b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "f70b03ea7ce552d5ad3dff168f9496e7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard4of8/summary.json": "f08454007fad5925a090751151d8171f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "bb69d1af3d8bed50a7fb7a71138c0da6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard5of8/summary.json": "4f08a1838a9899565096db1cae3bb77e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "c006baed18c1f1394f15090973be008b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard6of8/summary.json": "235fe138c919a8fa06532c8ab1b52ce0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "953f238fa31f9170f95dde1956fb80e5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed43/shard7of8/summary.json": "5fad11c55204c99a759e137f5370d310",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "93bfe7d5a52d9499adee6920cbc139cc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard0of8/summary.json": "df3a47a8b7f850e23ed5d646e1ed544a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "d2ab857ae4fcf79472c70bf1ecbe35cc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard1of8/summary.json": "26700da830d9d530c93d89680f8cf75e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "cf87ba55c9444f52d285ea265dacc431",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard2of8/summary.json": "28fc758f86a9756b0628bf663f38a58b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "b10ebbfcb75643edc9cba143553c21d0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard3of8/summary.json": "df360ce821a862c162ac70d7d600b698",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "89530d7fa48e2c0c587249578f236880",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard4of8/summary.json": "bd58f2e0540d6934a24c92edd86a360e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "c8c437795614f9dc04bfbb3b3766cf65",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard5of8/summary.json": "a1c03434aaf02014b39b1cf4faa87fe8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "ae281637ad53625cd4be5fbbd5358b6d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard6of8/summary.json": "1e97aea927d2ec1e83f30416b640c24e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "01e4152d6ddb4f623ad17adaa9360171",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_dense_sxs/swebench/seed44/shard7of8/summary.json": "314eb2f93e7406b615fe71ffd0e2b5d4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "8e6f5003f57d41c8a587732d8ef3c437",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard0of8/summary.json": "97e770707644737d61cd374c3413c6ac",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "16f4d01dc95ab31d97f6f92e7cb8dda0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard1of8/summary.json": "7cb01f778811b7a972c468c13e229149",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "67ac9617c115583b23add6ee10f0696e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard2of8/summary.json": "b94c538b5831d7399dabf14c650f558d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "e56aca1e60751c869cd4676a4f88384b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard3of8/summary.json": "7e2d7ecfeb7e257f76c299e5e8421a3d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "1ea9c935a211a2c0aa55ff7e1ead9c05",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard4of8/summary.json": "46883a1ffeed5bedb98ea06544d462e8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "6f992fc049974720f364b015810c63bc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard5of8/summary.json": "a543aa7b57c0de454ebdb47541a91f28",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "29885d2bf59b6737748575c951993e8a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard6of8/summary.json": "575298a733e6617e979cd50d24712af9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "a80c9a006ee099c59ca10780f25f1b3e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed42/shard7of8/summary.json": "f8f7845572e53a89d4fe2eba8b8def20",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "634740f944d9e2017c5b3efaf0d2cc30",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard0of8/summary.json": "e9c28f0340b7638d32c3f043166370a4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "2a468e88d318e79cc353b016ba35c54a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard1of8/summary.json": "ff4019c302d3233ad1f976acfb4b5506",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "85b735d737caa1b16c5e97096f0e1e17",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard2of8/summary.json": "8a140ca3281eeaf5ad689ac9e09296ba",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "b5e8dcb854b0c3639800eca5431bd533",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard3of8/summary.json": "7bb681cd7c6e89785574858f8c085461",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "1a79b739aff4687863ea5e5dd9dc0f29",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard4of8/summary.json": "fdcdc7956b1e4e1c4b616c0d896631ad",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "5429d82fce7df8b56e7d7efd8c805ef2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard5of8/summary.json": "44831d6090acde49d6bf78ebf31e009d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "d2bfc53190a138aea05a11523a2ee109",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard6of8/summary.json": "3e4f692640ad1af00249749e45320633",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "28b8a41952f40ed5e2d059d4041575d5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed43/shard7of8/summary.json": "767d301b1227f316609c6e021587ebba",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "63117d0c6b3c0cbb3c03839b6a4ddf4e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard0of8/summary.json": "30a5d34c7c7c959205f196b7626d0157",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "6330fc14bf1360b47a01adb9828776d1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard1of8/summary.json": "3a557280ed2fbabe3d33d5368810bf0b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "0935de473a965dd34e8c0251307d7436",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard2of8/summary.json": "8c3018491d9c720a074b81e80c99b072",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "a1992a0306c24e497ba6b6c092c73972",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard3of8/summary.json": "93a2bd22785a77a8f1df93ee8d550dbd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "f030600c97a6075e26dd59ffc9a9b1c9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard4of8/summary.json": "4e85f82e14357181cb33494ab70b3087",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "6532cfbd58b863831949b29860ffde72",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard5of8/summary.json": "c9b5d1962c80601f9a7f491d8f483d06",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "e882c59806d63c82993462bd29d48d32",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard6of8/summary.json": "f395f89c8d832064f1fb38391c05ea88",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "a85e4ac23ae66b014acd6a682e8c545d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r40_sxs/swebench/seed44/shard7of8/summary.json": "bf9e4e960e794e6656d1ebcab473ed04",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "586c7735efe77030ec600c4bfc296eb3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard0of8/summary.json": "4fd430a11d5d263c027bc998fa83d365",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "fbb2a5011339f9471e4ead84a080b3b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard1of8/summary.json": "2fc38c1349719576b905c68c60f3681a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "29d18eadc272a47d5d5dba4e5ba2ccaa",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard2of8/summary.json": "1aa8642e192af6721ae32a8b8e7e4d39",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "429b25774aff951bedcc810eeefbd87e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard3of8/summary.json": "d1363164a6976bfc817dafcf45c2f075",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "ef04b82c2d99ae22d3e7152eec83f5a9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard4of8/summary.json": "5945405e63aced7af8cd425d6c8d8fc7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "ae4c8a6361d668592f992f0daeccf4f7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard5of8/summary.json": "d8f8d097be6523b2808077d15d3abfeb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "1c6b47ce18cc5a806b2d9faf9ff6c9a2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard6of8/summary.json": "4823d1598684962cc5d737e2b9598e73",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "194c605efa6857aa1c17d4ba9437648c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed42/shard7of8/summary.json": "c3d4877059a1c2f2bf81bfe85cc247a1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "3c4622303d26c65a725fdc1172c4d610",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard0of8/summary.json": "4e3547d4fd57e8978171a43517f02b3c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "138f42a9df7956685fa1d79bdb737b2a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard1of8/summary.json": "655710677ea94c962af7ababe8fe1d6e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "477ed955b36864b10a3ed949d9c368b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard2of8/summary.json": "d7c4c4f7f68385013c8582fbba1d445c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "40bb2c2e1ada0a9532fff2a1da2816ce",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard3of8/summary.json": "a7669bd774867bea0e15091d8e94d764",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "f8e1ca3e0637d29fb52411832fc45cd3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard4of8/summary.json": "c3d1e25b5f47631b320d807a920f6346",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "f0a3313a26e2d287978bf0dc7521486c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard5of8/summary.json": "8380ee30346870e574a7d07c090253c9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "f548285bd449ca7cd4840e6bd72be70d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard6of8/summary.json": "b93bce417d702435d9eececf0c26fa21",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "f2d789e4059d276d8b0b0796e297b889",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed43/shard7of8/summary.json": "5ee0c60123a34b8b49a34093d5e3f622",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "ff15d2af9a68cea5483a9fe7b99e58dd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard0of8/summary.json": "c3c80c303d707cde53f2683d13f13969",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "5977c4a160c8d22707e6c61b4a44c0e3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard1of8/summary.json": "fe218033d3d0fecd332f299dcac05838",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "fe78a5897e3c63464722acb605ad5d86",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard2of8/summary.json": "f5d841b2580bcbd66e577a57f2a51d69",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "7be351ffbda8bdb0b51fd21afe923783",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard3of8/summary.json": "744715c53840c2fa768798085b9d546e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "2567088ae0b7935ce1ef6eb6639eb8ed",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard4of8/summary.json": "52be383a97e19b101ba398df5713f2c3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "fd7c835f13a6534b5b296b1e1d8b2207",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard5of8/summary.json": "60cca842da4e492ae783f831a1d5f03e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "29a43280d2d1ffb4d5ab0a559dec2f6d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard6of8/summary.json": "02fd600d64e4ae81a6fb026fd9efe5e8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "0d1fd03a0acc38efd66039f4ce892c0a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_r60_sxs/swebench/seed44/shard7of8/summary.json": "bd5b5b660fc7e96a0d67c212e4f987cc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "c882d6007f9871df7553f7865f22a940",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard0of8/summary.json": "07fc25c13a80cd1e1e374c1060453c4e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "4d4a3ab643ae8205248efbc78f1d2cfb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard1of8/summary.json": "51cf3eb9493f5033bbfb39fa6cdfa0f8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "b7980dddd6009cc02560908174853035",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard2of8/summary.json": "a0a6f06e9bbd3a569789e011c0a8a3f9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "1bd43ae77a1c61c349a5c0458caa9719",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard3of8/summary.json": "858246cad3c16c5a687a9f08c2e992ed",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "c8686e12347c2a3afec921d8c8717a0f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard4of8/summary.json": "2cdb0b9412524484d0fa622771d5269f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "19a30884e63cc137c720fde4e9a8ef09",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard5of8/summary.json": "09c996b40e53edb64b95b160f0306c89",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "8f11bcf5d8a3651d87f9a25acbd4a108",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard6of8/summary.json": "017662814f57d41c53a342c22f5ca697",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "0067234818c0a15ad51425cc2811af77",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed42/shard7of8/summary.json": "601405ae930a2c90ef494c0847759262",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "590c7b32b6ed4e0a1f535cac4f5f3730",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard0of8/summary.json": "d6451866349eaf238346ed97ac14145d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "4ff354689f573ce88da5d9b5186e20f7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard1of8/summary.json": "e8842899929d218d1d3c5651425f8c06",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "bc9a3027066c83a4656229f5e5517c8b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard2of8/summary.json": "5196c0f9caa678e2d759d3568f26cded",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "9be50c19cc2a28cf73f0e8b23f96f62e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard3of8/summary.json": "495c9d757689c1112f6bed49a01aac23",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "1ef3f8f77f0e53c09e7442955a03ea6d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard4of8/summary.json": "b8de780dae27a042a90eff6d73af7699",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "9c24f737deab0b4e7c5e813385c4959a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard5of8/summary.json": "b4f7dd38762cbf303c9358ebb7b68201",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "adaf60c5a0fae798de3c254585ac10da",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard6of8/summary.json": "ac7d0e29d020a5066d6cc2c6ef6da77e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "4a71b9e9753ded081d3062fed42a9c0b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed43/shard7of8/summary.json": "e202d88bf7ac5241211ed128c048272c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "0945e038e4d8cf962b49fa9881604358",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard0of8/summary.json": "9bffad856a678c21b6f94e7dc7eca7b7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "d12b3431e45d7c705254e0fe7fad0863",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard1of8/summary.json": "a962f04d94bca32820849152cc58ccd2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "9c56d078dbf3846eaaea464a358395f1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard2of8/summary.json": "d843c818064a765bf1ee44a30590cb23",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "345363910ea0d543ed7f038b2890d561",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard3of8/summary.json": "434a44a7071e33d196c4fc5deb67a0ab",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "a5238b15d350a01f5e36103442770164",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard4of8/summary.json": "dec19f703e30ba1ea75259c9c44e1739",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "a1c85c46717c09caccfd354689a8a91a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard5of8/summary.json": "a78bf99e345aa61f5903935b12813f7b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "1ffc488a95698d5820a1abb71e3c11b6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard6of8/summary.json": "059e86ecce498a03dce90aa236ddc91a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "e3576e32306384dcb54e717cc57bd85c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u32_sxs/swebench/seed44/shard7of8/summary.json": "5161b7a53ebd057f333466e053310ea8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "b6fcf102d2646f3314785ba6eb866366",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard0of8/summary.json": "e0fbd273dc81a651d1d04c9b4a1dd572",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "e6ea5b0838e39f779716cff24f25018d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard1of8/summary.json": "08030da06147eb901ddd8ea623054a28",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "212c2caddc84117df04e60cb7dff0a0c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard2of8/summary.json": "b580915678ff12062c48d41232acd9db",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "bec6e884be65d86514c3946cc4abc3e8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard3of8/summary.json": "78abed91ba55e6fceeda3ecab1f1182a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "c90af67297684c4a7ff4ab475b22d70d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard4of8/summary.json": "ad040b7bb1abf63cf5535f8f9dec32fe",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "f01e80e65fac428f4f99e9389a40252a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard5of8/summary.json": "3fa06e651d2c12158b50a56f97cf3eb4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "903c9b9325416664f6a065e64c706201",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard6of8/summary.json": "730e4668cd96b06872bff8fbad50d3ba",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "3e04a0dbbb7baea892ebf77beb2b150f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed42/shard7of8/summary.json": "7f86f0c4851831eae6a62268d2310e28",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "12dc3720c812f6e26c115c66127bc089",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard0of8/summary.json": "0475cd6847d6b591502c9ca41127e588",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "ab562fcdb0ec0eeaa491fa1fbf864dd4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard1of8/summary.json": "df6b7deafdb4222feb8c44c30e467e5f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "b8ef4656b6dca27d7382e338c929ce38",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard2of8/summary.json": "802b05f68b4fbadae264670f3994c331",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "c20f0dfa0859547f20175b28d75e12ce",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard3of8/summary.json": "5a67b1af676cad49403a314b04a0ed5b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "17edcdb711e7dd1e0122432b532f3bd2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard4of8/summary.json": "e12b67844d8dc24f015dc362aca61c7a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "b22bc9be352f806aa902e789df67042a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard5of8/summary.json": "0d36745a43d76c68897db83c5df0eca6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "4ff97e5f613885a3f30b720ffd4b273c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard6of8/summary.json": "cf1f03cb45c8f0faab1867ddce127244",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "72846e65ef4b3c47994d4c016aae5dbe",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed43/shard7of8/summary.json": "41f7e05e64b7592ac258f175f426d777",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "61c6c37822e4a8adf850293a8e75c357",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard0of8/summary.json": "b3ef4c85452dc825c6deebcb1a29c3fd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "f669deda4b8b4ad0ab602f59cb09f992",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard1of8/summary.json": "3147cf35981edf251085d268aefdb61d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "055b325573ab4e9b73768eb6b5ce4fec",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard2of8/summary.json": "21ec21f84fe671adae4b5659bfdd8a2e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "a40170e7b18248491038064f9bc16229",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard3of8/summary.json": "48af56c4dda840f5f45e4933d1f41358",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "bbbdd6e379c1113dc265ff285b7941e4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard4of8/summary.json": "3bdb1f46713deca2dadcacae7d388dc7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "f0ce42ddd19d45c0efc56ad0214abf7c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard5of8/summary.json": "317ab2fc3d5f013b408e89d2e172c939",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "f33365e6ee7c868554501344a19af324",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard6of8/summary.json": "3a4d93882d87507751b307b8db35e779",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "c9ce8905aa1e4a0a923f438d7a954b71",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u64_sxs/swebench/seed44/shard7of8/summary.json": "cab96bcdcbf165ca3411e71717a85a66",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "69be67b82c267992c89f7604913fc6e5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard0of8/summary.json": "726f4bc58dc8d28202ebb93abb294701",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "b8e91723174645db055f5921f6ad0152",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard1of8/summary.json": "31840af0e41b5ad316de1696cd913c0f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "b52128c1dd7d034aa2ad24d37e90870e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard2of8/summary.json": "2c7351f9c092afb0d8f81ab16d3881da",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "b67e11913634883db2f010f815bd134b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard3of8/summary.json": "168649736044abc6d746550426af680b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "2b3c91692198ee89cda7c8dcadde376b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard4of8/summary.json": "5b464044999d310da5380e9ca0703dcb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "22b13dad49d510d7b96c58e98dfc46f8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard5of8/summary.json": "98edea950fc993b58262a09055f2e81b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "92dc4c794691800b0ffe684701883820",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard6of8/summary.json": "9767399887c6631a78f3ea15c23522e1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "aaebad182268fa64a9909e643e4684a6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed42/shard7of8/summary.json": "8aadc0bc2850cdda3302074e07ba8732",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "3dd89634a97c264cd6f1c7a9c6693aee",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard0of8/summary.json": "7ff789d246bfc03bc5d5d899fbbceb4b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "9fe9b10af95c09c4f485ee25a5103bb2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard1of8/summary.json": "c6fdeb6a4da457014d05a40a0a10feeb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "50cbc668a97def3ec4ce5bc818155183",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard2of8/summary.json": "7d91ad549fd7ab4f2c9292ed1f2714a2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "956585eafbe40e7fdbe0b63e90d732ae",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard3of8/summary.json": "f07fb878422e5780696df260719f7154",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "37d0aa6ddd9eacb37281f7f08a35d81c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard4of8/summary.json": "202590ffb604818c90a0fcf029a589ba",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "72a309af30184f71423018e12cbc17b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard5of8/summary.json": "f842a077c8a30d69bc1eb9cb12c35e8c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "3fe4bd10a634db64c6a4f3b176f6f9b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard6of8/summary.json": "e7e1d2476bb1c6555c1f0c24dec4164a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "1d1864de56caea6d726d5cb44b04bb2b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed43/shard7of8/summary.json": "57833af55f185d7891e618a992b11995",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "0cf280fdb5a512a1d9033ab3ab8f6b9c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard0of8/summary.json": "cd5e8c1307a57183eb4882ea1fdcf251",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "158e30fcc9d905ecb17595ab98f87e5f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard1of8/summary.json": "f6140e83a8ee53957991d397a08f9710",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "85433315ad4f0465a26925bfd759d56e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard2of8/summary.json": "70e1b8876e8038836dd7661d0e385ddd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "c13fa513befe80eccb24abed6b873604",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard3of8/summary.json": "0ed88b9288fce2e3d0bdbfd8ebda3190",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "cfaccab08c1a5fe942f6219467fbae1a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard4of8/summary.json": "f8df7a2ea03f96cd488727a229fd35ad",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "8e28b862dc36626d65ccb85d2981f68a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard5of8/summary.json": "1f6d74f62a73d59b09dadfd53c6aa07f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "9070adb8ecc6ff7e77a6511226ceb490",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard6of8/summary.json": "7808f8a43355ba90d2c61dc5d3f875a4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "d48a6c68902d05b89c964b24f6da9df7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_jqs_f_u128_sxs/swebench/seed44/shard7of8/summary.json": "66f1016908ce0520095a52fff7701664",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard0of16/swebench-verified_1.0/verified_log.jsonl": "6d6557f34214f31378979f22a28b1199",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard0of16/summary.json": "cfd2f60cf5ee004abd7d0c30bcee388e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard10of16/swebench-verified_1.0/verified_log.jsonl": "22021b6640bb6a5912c5d537a1918d9b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard10of16/summary.json": "c62966d3977621bbe25a800d2f7ffc2c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard11of16/swebench-verified_1.0/verified_log.jsonl": "48f2caebd657bac6547ab7b92c6b8ced",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard11of16/summary.json": "782398a916da3ca549c98514cf3864aa",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard12of16/swebench-verified_1.0/verified_log.jsonl": "d1b336072e56e83d7d7857cd881fd130",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard12of16/summary.json": "df24e905978ce4c24fb6b8bfd5cddd3b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard13of16/swebench-verified_1.0/verified_log.jsonl": "4dae85083049d74aba2b52e24d8bfed8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard13of16/summary.json": "b3bb111e4ac285f71c363cfd56a36e25",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard14of16/swebench-verified_1.0/verified_log.jsonl": "7838e8f998c28366af344a29e0bcebeb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard14of16/summary.json": "be4b73717e2edb5898e53a43c840b53e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard15of16/swebench-verified_1.0/verified_log.jsonl": "128ba738cf23845ff056954e591f05da",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard15of16/summary.json": "6fa883a77a6a10effa05b487ecdbd7ea",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard1of16/swebench-verified_1.0/verified_log.jsonl": "542189bcd4394b56a7a449aaa33b661d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard1of16/summary.json": "c1b1831ba3c1e441cd4ee882de14164e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard2of16/swebench-verified_1.0/verified_log.jsonl": "b9f0fc28229ff01f26818a643aeba39a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard2of16/summary.json": "a6ea2279c9e2a0bc2196d8080eaa5ca4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard3of16/swebench-verified_1.0/verified_log.jsonl": "39bbf93b0d0e5ba60cfad4f03cddd334",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard3of16/summary.json": "33b57c7cd0cfa5feb16b1a05dce4c7ae",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard4of16/swebench-verified_1.0/verified_log.jsonl": "a27f210fdba580f6ea219753ba3afc20",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard4of16/summary.json": "77926bb72267f6f71c36ba2e67b1ee81",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard5of16/swebench-verified_1.0/verified_log.jsonl": "5b81eb6272cbc9995628100531f531c1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard5of16/summary.json": "37c6ee396d1285cdb460b25d45f3464f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard6of16/swebench-verified_1.0/verified_log.jsonl": "32db2479c81d85e4657c700d3c7976ad",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard6of16/summary.json": "5a3cfcc9d47d64e871dd527a8b5e3a59",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard7of16/swebench-verified_1.0/verified_log.jsonl": "a4f489e6304f9225a888a09eb22d091c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard7of16/summary.json": "70c2b158865f3b9efb6a93113e61f836",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard8of16/swebench-verified_1.0/verified_log.jsonl": "30cd6b9bdb6e54d42fc2dd9dcc2bb3fd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard8of16/summary.json": "7a6609b66a7a33f2d2596158104ef5c3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard9of16/swebench-verified_1.0/verified_log.jsonl": "cf2c635c47679e44e6c1c5dcbdd0fb0b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed42/shard9of16/summary.json": "f21a72877e5bbe422e0d51d23f803733",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard0of16/swebench-verified_1.0/verified_log.jsonl": "e96c46db908aea6f39242e99c4ea61f1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard0of16/summary.json": "16a83bbc2c5b863530d85626abc7569d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard10of16/swebench-verified_1.0/verified_log.jsonl": "48804db3302cdbafb1a9091bad2b7947",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard10of16/summary.json": "f352d92079b17c1338371201aead08f4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard11of16/swebench-verified_1.0/verified_log.jsonl": "c143138f83b852d21f302dddce9bc2e8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard11of16/summary.json": "c34c1f02585e72da7285af671a621b42",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard12of16/swebench-verified_1.0/verified_log.jsonl": "5a2a4a9cecba4c5fbccd3b64cdff9adb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard12of16/summary.json": "6cc11dec805b24f01e79d4a2bb5f40eb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard13of16/swebench-verified_1.0/verified_log.jsonl": "2dd11cd4b1e2876391cff215531622c2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard13of16/summary.json": "af2f0b49354cdb1029030400daac0495",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard14of16/swebench-verified_1.0/verified_log.jsonl": "b68864ee423b1910800f634ce41b0798",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard14of16/summary.json": "059ada1364e14c060a11e9c915ea0dcc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard15of16/swebench-verified_1.0/verified_log.jsonl": "6fd4ba075a8b40ba01cd5159d3fdbc58",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard15of16/summary.json": "78de12cc5986093f7a6daef203537a30",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard1of16/swebench-verified_1.0/verified_log.jsonl": "03bee2fa0846ec3eec87d6c060e4c5cb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard1of16/summary.json": "57b934c89603e5a951cab167ae39ac57",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard2of16/swebench-verified_1.0/verified_log.jsonl": "0d7f6b3d5764556d8efe40de45dc5440",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard2of16/summary.json": "e31530bbf2bfcdeccbef3e7dcc9585c2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard3of16/swebench-verified_1.0/verified_log.jsonl": "73044af9a4eec755517336b69b6aa5d9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard3of16/summary.json": "9ab0c928c62781446809139494e75d3d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard4of16/swebench-verified_1.0/verified_log.jsonl": "35c1fc7444a926107114c6914ae663dd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard4of16/summary.json": "c5bd7d92c25d0399652bccb75907d488",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard5of16/swebench-verified_1.0/verified_log.jsonl": "5838f9ac8dc495d5891a032f8a99c6ed",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard5of16/summary.json": "e9bf8c00124255f8d38b1792bebcef5e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard6of16/swebench-verified_1.0/verified_log.jsonl": "d5d5f91ae211f43fe99baa5a78936551",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard6of16/summary.json": "3cbf48742ed9b1c419adb945ef490e6c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard7of16/swebench-verified_1.0/verified_log.jsonl": "86f4590af2010f78cad8d8f3802cf237",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard7of16/summary.json": "b864197662039672a59d8d155e0be400",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard8of16/swebench-verified_1.0/verified_log.jsonl": "80067dc03d54e83c543570de0d841b59",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard8of16/summary.json": "50b814e2467c017e18495b64e632df0f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard9of16/swebench-verified_1.0/verified_log.jsonl": "e4a9171eb38a48a4c881f5d73059149d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed43/shard9of16/summary.json": "8bab9381c8533c9fd61c9e2adeb46ff0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard0of16/swebench-verified_1.0/verified_log.jsonl": "c27bab27d83ff3d48f0e5f58affde021",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard0of16/summary.json": "850c9199b179c32d0d003364f78e03bc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard10of16/swebench-verified_1.0/verified_log.jsonl": "06f9adbf56d732817117ffe539f68dde",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard10of16/summary.json": "2271b410b6ef19bb5a6d5c209577881b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard11of16/swebench-verified_1.0/verified_log.jsonl": "3aa2ab0dfe2b0b75a8e7433a71a428ee",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard11of16/summary.json": "97ddefecac8da5a0c0da244769199fda",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard12of16/swebench-verified_1.0/verified_log.jsonl": "32d4b44cad771b4243f182e451006e65",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard12of16/summary.json": "4e5c482bd759eb6269ad4ca2ca731e04",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard13of16/swebench-verified_1.0/verified_log.jsonl": "a9cc6143814a056cb74c227747f5ba59",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard13of16/summary.json": "8797df70cf2a0b30bde033dbfa949715",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard14of16/swebench-verified_1.0/verified_log.jsonl": "e950cc406090b0381a9e8a8565dcac54",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard14of16/summary.json": "81ea1be87c564e4a2dd0d2440ac929f4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard15of16/swebench-verified_1.0/verified_log.jsonl": "7afe4a023443816cc1ef040f65fa0646",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard15of16/summary.json": "8e5c38c51285f8c3e0901ecc580a0543",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard1of16/swebench-verified_1.0/verified_log.jsonl": "596a390a3ab3ecc160d0dfe37903c4f1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard1of16/summary.json": "85f4f1012b9c76314ce9af1422ad51dd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard2of16/swebench-verified_1.0/verified_log.jsonl": "45aca00b0c886228bd10cbded06f4c02",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard2of16/summary.json": "05c03c8bf24013524451cb7588bd1f99",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard3of16/swebench-verified_1.0/verified_log.jsonl": "226af3b2cc008889f142c65fc1033dd3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard3of16/summary.json": "b9037f262e500a2e2ebfbd2dcca68792",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard4of16/swebench-verified_1.0/verified_log.jsonl": "c334f946e07bbd4b192a0d681ae0837d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard4of16/summary.json": "a94b1582827e758319b26df2c6851197",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard5of16/swebench-verified_1.0/verified_log.jsonl": "f73540a7a8a3e04218a1518262e613f9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard5of16/summary.json": "068705994408bb7139d407e828282089",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard6of16/swebench-verified_1.0/verified_log.jsonl": "8d251a008b6a518782106b648874b2e0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard6of16/summary.json": "9320e70e046f862817ce27d81293a387",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard7of16/swebench-verified_1.0/verified_log.jsonl": "cf63fb1329504fc4c47f15d69106ba79",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard7of16/summary.json": "9744b0511f3c6eb5de97d389f04f0be4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard8of16/swebench-verified_1.0/verified_log.jsonl": "d97004b4a80e8657289f4fbb6c20038f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard8of16/summary.json": "b698d4318165b0e6352963e3a370e201",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard9of16/swebench-verified_1.0/verified_log.jsonl": "16cff9be122667c89ee81a74c920618b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_quest_b2048_s1_sxs/swebench/seed44/shard9of16/summary.json": "6ebc039dad44f7a7e000f0992b4ad4ad",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "8b943226598b0423cde9f8bb6e03e9ff",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard0of8/summary.json": "54dcf15ebd3cc14c6b435d8daf5e7c9d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "37cb67462ef1cb8de103b772b94e7063",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard1of8/summary.json": "99bb08f3c935f9c0ee0f96dcdd13cea7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "bc67ce672c78452e0105d0217ba1f693",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard2of8/summary.json": "2f3bd8d57f62c790856442a59a652b3e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "2bb269b2970369f4dbfc5d55d7bed588",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard3of8/summary.json": "2297f08219b18b23e09f6775959e946f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "ca17fb6180010d37e22e91bd3870c9d6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard4of8/summary.json": "0c921439aaab544f02485cee959f75d3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "009bff2ca25b4b41a2743330cefbfb8f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard5of8/summary.json": "5edd5c1a4a15cd8bdf7aa47618acd1cf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "d334f9ff67436618da1bb712d3bc242a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard6of8/summary.json": "6690afbb4103e3b6f9b00ac5f59be3b8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "82901a493494a52e8e7d6047be7d42af",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed42/shard7of8/summary.json": "c484d17acdeacea62797507d69ef01d8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "f72527ff98fdc22e5ddd52c91c7288b2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard0of8/summary.json": "235fb1a5526bc684cc703239840aa5f5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "8c5b05793a331859f7135f59a54dae31",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard1of8/summary.json": "b9d6e0629cfb8a562bb7d2e63a73eedc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "74956bce262feae6316706f18128a580",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard2of8/summary.json": "bc2652ade312c7be2727f35961f42b55",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "d6090adcccd37b6df220036ef7e2552e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard3of8/summary.json": "a4c670caaeab24d6ee27117acf04644f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "058fb69556be9f8d685a16b4d60f5857",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard4of8/summary.json": "362f222377c4e7cf49a116301a515e09",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "9652be8c4a283d0ca6f0cccabf5092fc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard5of8/summary.json": "32bf53b2bb7d538b47939999b6e21e64",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "a8409fa612df00be891ba25b11c3dcac",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard6of8/summary.json": "44d89f2427517b33e4ab8baec2a6ee3d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "d92c8a87dd459de7ce8c74a6e4e00b20",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed43/shard7of8/summary.json": "6940aad8f3677f1439ccbe19c104e173",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "1719cf4c45f31c437af6d64d60f50da0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard0of8/summary.json": "fe074c17e447f2d24dc195cec61101b6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "7af3e1e50f9763e6ccd1bc049cb8a4d6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard1of8/summary.json": "0a343c4a99f34e3d56f1a1e3a0750fe2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "fba3ef06ff2f068faa1c5bfb5d4d053b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard2of8/summary.json": "a512923a8cdb079fc3e1c90e8b4cb430",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "3cc70fd585da04fce54764dec0521731",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard3of8/summary.json": "fabfcede20d83192b75c340d81939abd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "8d94736e868144a6528520467c1e5385",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard4of8/summary.json": "cd493fa5a6bd62c7835d547265642ea6",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "c641d7bc5e9992f8e1fff8716426475a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard5of8/summary.json": "fd9825ac6220342166de3fe3097e43d2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "7aae33852809e1686a0cf6232668584c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard6of8/summary.json": "56dd4ca34d469380707973eda7b48c70",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "fc8ba121dc0a206df87d9e4a8b184f33",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_sparq_c8_s1_sxs/swebench/seed44/shard7of8/summary.json": "ec94cfcb551638a2986e850c98597714",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "f94caf8b6499df3f73f833a5399a691e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard0of8/summary.json": "4a52e55349a5d40198be2bf70208c972",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "537a181f8fb66703ee117040e9eb085e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard1of8/summary.json": "6d2e4aa17d10e7dc472071dc28806406",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "39eae954abd6ae4465db3824e8b210c0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard2of8/summary.json": "a32dcf1d6f63f14871338028d435c0ef",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "40210e2893d4122f7d1e259db6919047",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard3of8/summary.json": "2553a86e74da2559d219dce53c7cb63b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "87b6df224826ab66709c43e626eae7d2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard4of8/summary.json": "00bbf9bf9bf7213d271efd51465d2eed",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "c264ca7c31cc41ca7c4da2a3ca7b8dfa",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard5of8/summary.json": "e53f15844e3895989e7bd3480f2f10b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "4a08ecab2b610fe4aa235247d5bd5357",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard6of8/summary.json": "7e1b01adf20cd47ce733b9211ece998c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "2072ec0a5be03295cffff669b421fd6b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed42/shard7of8/summary.json": "aa3bd99997d319428e98dbc7b7714a9a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "f89ddd106f230ae22553f909a68039c8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard0of8/summary.json": "9695c94df7d5683a5a6f45a5326e10eb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "b8dce69b72162d5810f9a88cab85eb03",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard1of8/summary.json": "93645a2a95984faba260c3551da700cb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "9c01c6c0ca43b97f85411ed9b49776c0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard2of8/summary.json": "830765d2b057ec9458d0fc12dce84d06",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "141ce718a57a3794e64ac0e373eebd4a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard3of8/summary.json": "bc19d0d13ce58834f9a392c21b76232d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "b05f16a95edb530e03cd3b617977af75",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard4of8/summary.json": "10d16e180c471854398d117e091db012",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "677f7046074b733894252a410d2901eb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard5of8/summary.json": "1d278a28cbb5229959e43d2fe27b5045",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "04b30233ad72e0ee0c1690f6e3ec4b8f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard6of8/summary.json": "fc1aae4d1490c2da9e256196288a1a9a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "a544e8a194fe0c4a6ce20dbe55cd4a2c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed43/shard7of8/summary.json": "536de3f4c4902bb403389339a465bacb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "ca0ee0373c0f3a146d862752b8512fc2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard0of8/summary.json": "762f93d79690140786467afa2876b708",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "04eee523751f0f2db63742f069215403",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard1of8/summary.json": "6a986e2601e5af922bca4d79ac8d296e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "029edf536381173a07897dc6fc8611de",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard2of8/summary.json": "173af1f55c41c5c4b0a1f3ff1f6c611c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "22bc1e4865a939ad6002d134cf2b9d47",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard3of8/summary.json": "c1ea0a235a1a692d0c5511494a24a435",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "861f66be1c78d9f52a87b8182152a653",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard4of8/summary.json": "722aeda9beba7a9584cd76d448d336d9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "e6c2904fc58624cb915145f64505f3af",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard5of8/summary.json": "4c6e410d94d5b91154e2da23bb1a4530",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "50c52dcb157d08161a11e4cbdfa6066a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard6of8/summary.json": "37c8f2a781b1266ca07144158ffb1ef5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "6a45112eb59fc6af84e309b7d96a88bc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_loki_k25_d25_s1_sxs/swebench/seed44/shard7of8/summary.json": "1c2014ea49a8c396cdf22936631fd893",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "fdd0760f32106da2d6ede86fc85be7c7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard0of8/summary.json": "63f25a6da408e7b005508c466f92a634",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "ae0f776582ebaaa016c3a23ff3f2a346",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard1of8/summary.json": "df38f787d39a148541446ddee80d86b9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "a6f6b50c11a51114cc67a7829d5d3c84",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard2of8/summary.json": "6978fa4eadc6a11d7456038ea678a350",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "8b3887d4da2360511a9993e3d890030e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard3of8/summary.json": "52c9caa1c827b27c28adc1f9844ccc14",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "47133e55019c70846a5532486d2cbb07",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard4of8/summary.json": "dd8bdf470929ce1eca1fef93d1e929ae",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "f73915ac933dc81ffe8278cbb2e82265",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard5of8/summary.json": "56c77b64ef1c44e9b7a10b94fec1a88d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "132e6871af766c0c63773174dba1d804",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard6of8/summary.json": "b3476bb55bf31c65f4ada68fba33160a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "d5de824ead519bb87126a325673eb8f9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed42/shard7of8/summary.json": "8bc8ff141850fe85c57a3e0ef5bd1b4c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "3c16ca96025a73f1ba8844b0e938ca94",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard0of8/summary.json": "8acd111f6323541d618f0f5ce2c7c849",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "ef9f2befab8ecaf3bbb231c9e4b91458",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard1of8/summary.json": "f9471ea2d53845dafd82a285dfa26db2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "174c294d4d20fa8ee4fcbb47a82756a3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard2of8/summary.json": "65ae5100d9812ea8b0c728b7f5029a5b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "e95419f911ec6470509010aa078bf20e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard3of8/summary.json": "861931c16f63f02591c57ced00ec3384",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "7af30130709597bb4fcd0f566933b217",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard4of8/summary.json": "5569bc617cc4da42afffb1fa0c4a6057",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "041d82b550c600dc979e4cf3356a01b0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard5of8/summary.json": "f81f432db8b280ad5fc1057adc034eeb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "9c2803f702e83b92f350f3991deb1f82",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard6of8/summary.json": "f796c69746de4b440cbecfe0040d2fcf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "e1eacff1a3d50dc2111f7a3f30bbaee9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed43/shard7of8/summary.json": "21e909e8d1b001196ac45086c8555d2a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "5cb3cb1f6cccfaee96b90790385fc003",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard0of8/summary.json": "df20bbef333a68638f3958d8ab7ebb2c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "a7a704fb09efb0a6b839ff45c29b8be3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard1of8/summary.json": "47811b5483320d3eb617dbdc646797a0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "38b314ca06d964d0cb0d235fa7bf24a4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard2of8/summary.json": "28c40aa883177bde66cb2187127d8501",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "459a1c771b0d1c5a4ab27f09c5516724",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard3of8/summary.json": "ee52089c92806505143f9c74164ed979",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "daef5c597476344a0f85747b3bb0d282",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard4of8/summary.json": "e987f76a4c73a59c8fb42920c0a3566a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "6af879ad7d44677e115bbce193a4ea21",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard5of8/summary.json": "4ccf0bd033f5c92d64ca962ddd1981ee",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "9135e6ac01611e30b434f46ba88e4402",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard6of8/summary.json": "ee0bc7b48d282565a5f807cedbb75dca",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "9495dc9e174db9162040908df2fbfb5d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_tri_b4096_s1_sxs/swebench/seed44/shard7of8/summary.json": "dc0266c437091ac069e67b2ec2fa99a7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "c6c985931847c9234348dcccc442b1cd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard0of8/summary.json": "f859080b50bebe4eabca39e9c0417ba7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "cbdfb52b43875f5af787e5ebc00291e7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard1of8/summary.json": "75ad2c1b74b3cfe7bf95f07db6a6be9b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "3f05ece99fa8083d9f929a415530bfe3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard2of8/summary.json": "15a87aaa1e7c1cdc2fa1ff3f10ad7ec7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "15ea20a785db9c4071189af271935d88",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard3of8/summary.json": "2e7d436f2e534e364f31e489a5cf0cd3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "d216c144b5c116114d1c3fc43f2c0471",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard4of8/summary.json": "7485f799ba684fdce055fd403aa578eb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "e1f31a0b0462944005d807301a6528e1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard5of8/summary.json": "0c57796899bb62f9ea9cfd81ff192a9f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "e8fc20464f375c124a8ba3c7f9d75c81",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard6of8/summary.json": "f406fe046c4b18e564244add1e669de1",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "b61ea23c40bca962ae375f74279307f3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed42/shard7of8/summary.json": "8d8aad01e93a3e0ffad7fe007889fe13",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "17858bf6116de990ba546f6d6e39fb29",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard0of8/summary.json": "1cb44bfa326193aafba399f6e96f229c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "3c4adf84f5b5d7516eaa457a49469716",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard1of8/summary.json": "bb5f077cca8733e66bbbdf806742fc79",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "e399f3d279340c027452ca0ff71a87ff",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard2of8/summary.json": "85533e809c5d138a464767f8be5c6134",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "110d0ffad34d61b2acdc43cc3331b321",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard3of8/summary.json": "7eee8deb52d5ac102d6975a4e2948f57",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "4884d652b9a0b47074cb42f6282a2dc5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard4of8/summary.json": "0866bc9c20862437ff15b6bfa80af3cd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "5dac29045bf18c26421415875f864394",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard5of8/summary.json": "c13932ea20a45c1fa51b4b91bbb5d223",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "45cab39a142ed9e030efc3283ee74e44",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard6of8/summary.json": "48ba774bf00ccd3aca6b7450fff5805e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "c0936dceae22efd05f0c2edd2cb09cb8",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed43/shard7of8/summary.json": "ea46bea8822700d5af45fac548be58d3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "7a523925d8a87f41330f6c2f787f425e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard0of8/summary.json": "024cfbf25c3c85db6a8d5e60421b9e85",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "5e8cebb039364425593c052402a4594e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard1of8/summary.json": "8e50487cfb593e7e29ddccdabfa604e2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "603f351406655e097c2256c5a8828279",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard2of8/summary.json": "777a5c444c3814bec6d2b28acd67b9d5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "c1f2c2f4c20e7f53cb6c119ced8381ad",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard3of8/summary.json": "4554b092ce6d2ed4f9768e1e0cbbf76c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "bdedd88b8b62821a94c68bf463037432",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard4of8/summary.json": "3bb215649e9975fb3272fd7f81524c08",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "3595ff005de9fbf910794939fd0c9689",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard5of8/summary.json": "52218ad3931958d436c8ad91dbe315bd",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "5af1b57b39877d378167b63b8dee34c9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard6of8/summary.json": "cbef7e5c9f4a24f42e1d1fa10a566124",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "8b5c1e24fa4599b0217b16e3893aa43c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1_sxs/swebench/seed44/shard7of8/summary.json": "20f6645e98aee221cdaa32984218ddc9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": "50b8b0fcc27439f4a94a84a98e416d34",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard0of8/summary.json": "c6ab867e5987ce1b34efd20592ab5495",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": "761c5e945fd9115278564e1da46e9b48",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard1of8/summary.json": "4b67192ecbc45fd2e086932be4e68930",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": "d7ecf7d2292f5348aeb8abf39e1faaa7",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard2of8/summary.json": "df78c54e01870a5bf62c99de39a80f63",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": "9bf294207ca51e24e6f0609d6d64f0a2",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard3of8/summary.json": "11c2985f006f39f4db807bedbc26a64a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": "18904cff1cc20a19f86c21c633055daf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard4of8/summary.json": "30ad302d21a67b90d58d59ee782d51e5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": "e584ee9d07f9a1f7235352a4aab004fb",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard5of8/summary.json": "e03b4cb5268aa1187cefdf4337828133",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": "b65a151992f7aa1e8beaebf53f76fb32",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard6of8/summary.json": "cf8f32e4eb6891d83dcc0e4fb381c1be",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": "fb5c7d191cfb51a39993c86402ea42d3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed42/shard7of8/summary.json": "3dd65252bc325f178dd51905a2053f9f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": "c4eced83d860c8e820e7f459f3b671cf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard0of8/summary.json": "c20b9039c869a471fc8687a400656786",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": "a11b7f1d9c0328f4a26ccd30608a5289",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard1of8/summary.json": "726891f893bf5fe165a3b17f9a282ab0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": "99f61e09319d24150321d52b99a0009a",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard2of8/summary.json": "516085dfb0e33d8d5de4c3e524ac752d",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": "cb342ec966f8a15dad5c6c54b5cbb0f3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard3of8/summary.json": "e2c9cc91daa18900d1a6d1a398f09a69",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": "517a59af91f4732b953c0d90d9aabfbc",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard4of8/summary.json": "c453064c7f8b8f5442747e46dd6b0678",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": "940a64e2c0c6e9eace40340b04a1e2f0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard5of8/summary.json": "e8a3fefe7e56c84550c424be515dabea",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": "6db8b1e0c011a127ee2905b8d70dafec",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard6of8/summary.json": "b4daebb65812b87acf0933194c6096c4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": "0972aed620b8c71a05791842fde181b4",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed43/shard7of8/summary.json": "00885a6cf67387457f9be610e833c3b5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": "8881609cfa8c141ec104ac99676fa3bf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard0of8/summary.json": "4709b8e5ade9f42b0fe45336928218f5",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": "bb5959793b79484a9a3f8ea1bf17f6f9",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard1of8/summary.json": "15dc86be7742554baf0509417eec6800",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": "29b903fe59de69ab6c3fca6c8f5c633c",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard2of8/summary.json": "a638691f4f8e29c37a06484702d702bf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": "7ce6e6db144aa529ce9a33e575852325",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard3of8/summary.json": "f90529d8133ab25ea1b7c89259d8945e",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": "0d6720a02b671c7fc42d38ebf24acaaf",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard4of8/summary.json": "6128152533844eaad2f1277be8ea730b",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": "9f2b82298bc52aca360168f19ac86e25",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard5of8/summary.json": "ff30af62463f1895ef77d2196a94c75f",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": "d1bf5bf35352c32dc57f48f626148841",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard6of8/summary.json": "07a8bbc506c1460ac9872818a58c50b0",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": "e3888a846734a04569f75855f75e05e3",
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1_sxs/swebench/seed44/shard7of8/summary.json": "69de8e4b7c55820160971540bc811871"
  },
  "score_free": {
   "status": "complete",
   "pairs": [
    {
     "arm": "dense_sxs",
     "ref": "dense_s1",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 70,
      "episodes": 1581,
      "timeouts": 82,
      "timeouts_per_100_episodes": 5.186590765338393,
      "instances": 1500,
      "first_timeouts": 58,
      "first_timeouts_per_100_instances": 3.8666666666666667,
      "zero_other": 0,
      "counted_zero": 4,
      "counted_timeouts": 4,
      "calls": 119511,
      "completion_per_call": 1616.4754792445883,
      "over_8k": 5559,
      "over_8k_per_1000_calls": 46.514546778120845,
      "cap_hits": 1372,
      "cap_hits_per_1000_calls": 11.480114801148012,
      "length_finish": 1372,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-24T10:19:16-07:00",
      "t_last_iso": "2026-10-28T09:21:44-07:00",
      "attempts_listed": 70,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 48,
      "episodes": 1532,
      "timeouts": 34,
      "timeouts_per_100_episodes": 2.2193211488250655,
      "instances": 1500,
      "first_timeouts": 24,
      "first_timeouts_per_100_instances": 1.6,
      "zero_other": 0,
      "counted_zero": 2,
      "counted_timeouts": 2,
      "calls": 113004,
      "completion_per_call": 1170.6080669710807,
      "over_8k": 2912,
      "over_8k_per_1000_calls": 25.768999327457436,
      "cap_hits": 566,
      "cap_hits_per_1000_calls": 5.008672259389048,
      "length_finish": 566,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-01T17:31:25-07:00",
      "t_last_iso": "2026-10-02T02:20:36-07:00",
      "attempts_listed": 48,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.380885306409325,
     "timeouts_per_100_episodes_diff": 2.967269616513328,
     "first_timeouts_per_100_instances_diff": 2.2666666666666666,
     "over_8k_per_1000_calls_diff": 20.74554745066341,
     "cap_hits_per_1000_calls_diff": 6.4714425417589645,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 27,
        "episodes": 544,
        "timeouts": 46,
        "timeouts_per_100_episodes": 8.455882352941176,
        "instances": 500,
        "first_timeouts": 33,
        "first_timeouts_per_100_instances": 6.6,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 41632,
        "completion_per_call": 1825.4623606840892,
        "over_8k": 2353,
        "over_8k_per_1000_calls": 56.51902382782475,
        "cap_hits": 596,
        "cap_hits_per_1000_calls": 14.315910837817064,
        "length_finish": 596,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:20:39-07:00",
        "t_last_iso": "2026-10-28T06:34:16-07:00",
        "attempts_listed": 27,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 19,
        "episodes": 513,
        "timeouts": 13,
        "timeouts_per_100_episodes": 2.53411306042885,
        "instances": 500,
        "first_timeouts": 9,
        "first_timeouts_per_100_instances": 1.8,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37198,
        "completion_per_call": 1334.229474702941,
        "over_8k": 1208,
        "over_8k_per_1000_calls": 32.474864240012906,
        "cap_hits": 268,
        "cap_hits_per_1000_calls": 7.204688424108823,
        "length_finish": 268,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-01T17:31:32-07:00",
        "t_last_iso": "2026-10-02T02:20:36-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.368177210363696,
       "timeouts_per_100_episodes_diff": 5.921769292512326,
       "first_timeouts_per_100_instances_diff": 4.8,
       "over_8k_per_1000_calls_diff": 24.044159587811848,
       "cap_hits_per_1000_calls_diff": 7.111222413708242
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 19,
        "episodes": 513,
        "timeouts": 12,
        "timeouts_per_100_episodes": 2.3391812865497075,
        "instances": 500,
        "first_timeouts": 8,
        "first_timeouts_per_100_instances": 1.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 38131,
        "completion_per_call": 1382.6528284073327,
        "over_8k": 1321,
        "over_8k_per_1000_calls": 34.643728200152104,
        "cap_hits": 348,
        "cap_hits_per_1000_calls": 9.126432561432955,
        "length_finish": 348,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:07:33-07:00",
        "t_last_iso": "2026-10-28T09:21:44-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 10,
        "episodes": 502,
        "timeouts": 2,
        "timeouts_per_100_episodes": 0.398406374501992,
        "instances": 500,
        "first_timeouts": 2,
        "first_timeouts_per_100_instances": 0.4,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37431,
        "completion_per_call": 844.0660949480377,
        "over_8k": 495,
        "over_8k_per_1000_calls": 13.224332772301034,
        "cap_hits": 72,
        "cap_hits_per_1000_calls": 1.9235393123346958,
        "length_finish": 72,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-01T17:31:38-07:00",
        "t_last_iso": "2026-10-01T22:11:14-07:00",
        "attempts_listed": 10,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.6380859706163784,
       "timeouts_per_100_episodes_diff": 1.9407749120477154,
       "first_timeouts_per_100_instances_diff": 1.2000000000000002,
       "over_8k_per_1000_calls_diff": 21.41939542785107,
       "cap_hits_per_1000_calls_diff": 7.202893249098259
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 524,
        "timeouts": 24,
        "timeouts_per_100_episodes": 4.580152671755725,
        "instances": 500,
        "first_timeouts": 17,
        "first_timeouts_per_100_instances": 3.4,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 39748,
        "completion_per_call": 1621.8933531246855,
        "over_8k": 1885,
        "over_8k_per_1000_calls": 47.42376974942135,
        "cap_hits": 428,
        "cap_hits_per_1000_calls": 10.767837375465433,
        "length_finish": 428,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-24T10:19:16-07:00",
        "t_last_iso": "2026-10-28T07:20:40-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 19,
        "episodes": 517,
        "timeouts": 19,
        "timeouts_per_100_episodes": 3.6750483558994196,
        "instances": 500,
        "first_timeouts": 13,
        "first_timeouts_per_100_instances": 2.6,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 38375,
        "completion_per_call": 1330.514345276873,
        "over_8k": 1209,
        "over_8k_per_1000_calls": 31.504885993485342,
        "cap_hits": 226,
        "cap_hits_per_1000_calls": 5.8892508143322475,
        "length_finish": 226,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-01T17:31:25-07:00",
        "t_last_iso": "2026-10-02T02:12:45-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.218997268899929,
       "timeouts_per_100_episodes_diff": 0.9051043158563052,
       "first_timeouts_per_100_instances_diff": 0.7999999999999998,
       "over_8k_per_1000_calls_diff": 15.918883755936012,
       "cap_hits_per_1000_calls_diff": 4.878586561133186
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": []
     }
    },
    {
     "arm": "jqs_f_dense_sxs",
     "ref": "jqs_f_dense",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 67,
      "episodes": 1557,
      "timeouts": 73,
      "timeouts_per_100_episodes": 4.688503532434169,
      "instances": 1483,
      "first_timeouts": 52,
      "first_timeouts_per_100_instances": 3.5064059339177343,
      "zero_other": 2,
      "counted_zero": 4,
      "counted_timeouts": 4,
      "calls": 119282,
      "completion_per_call": 1637.978001710233,
      "over_8k": 5706,
      "over_8k_per_1000_calls": 47.836220049965625,
      "cap_hits": 1368,
      "cap_hits_per_1000_calls": 11.468620579802485,
      "length_finish": 1368,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T05:30:51-07:00",
      "t_last_iso": "2026-10-28T07:31:57-07:00",
      "attempts_listed": 68,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 1
     },
     "published": {
      "units": 24,
      "attempts": 56,
      "episodes": 1550,
      "timeouts": 55,
      "timeouts_per_100_episodes": 3.5483870967741935,
      "instances": 1500,
      "first_timeouts": 35,
      "first_timeouts_per_100_instances": 2.3333333333333335,
      "zero_other": 0,
      "counted_zero": 6,
      "counted_timeouts": 6,
      "calls": 119018,
      "completion_per_call": 1255.9779445125948,
      "over_8k": 3606,
      "over_8k_per_1000_calls": 30.297938127006,
      "cap_hits": 781,
      "cap_hits_per_1000_calls": 6.562032633719269,
      "length_finish": 781,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-02T05:15:21-07:00",
      "t_last_iso": "2026-10-02T15:43:00-07:00",
      "attempts_listed": 56,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.3041455137541291,
     "timeouts_per_100_episodes_diff": 1.1401164356599751,
     "first_timeouts_per_100_instances_diff": 1.1730726005844008,
     "over_8k_per_1000_calls_diff": 17.538281922959627,
     "cap_hits_per_1000_calls_diff": 4.906587946083215,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 527,
        "timeouts": 28,
        "timeouts_per_100_episodes": 5.313092979127135,
        "instances": 500,
        "first_timeouts": 20,
        "first_timeouts_per_100_instances": 4.0,
        "zero_other": 1,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 39630,
        "completion_per_call": 1793.415114812011,
        "over_8k": 2180,
        "over_8k_per_1000_calls": 55.008831693161746,
        "cap_hits": 524,
        "cap_hits_per_1000_calls": 13.222306333585667,
        "length_finish": 524,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:12:20-07:00",
        "t_last_iso": "2026-10-28T07:31:57-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 20,
        "episodes": 516,
        "timeouts": 19,
        "timeouts_per_100_episodes": 3.682170542635659,
        "instances": 500,
        "first_timeouts": 10,
        "first_timeouts_per_100_instances": 2.0,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 38305,
        "completion_per_call": 1410.2612452682417,
        "over_8k": 1385,
        "over_8k_per_1000_calls": 36.15715963973371,
        "cap_hits": 322,
        "cap_hits_per_1000_calls": 8.406213288082496,
        "length_finish": 322,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:15:37-07:00",
        "t_last_iso": "2026-10-02T15:43:00-07:00",
        "attempts_listed": 20,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.271689994197416,
       "timeouts_per_100_episodes_diff": 1.6309224364914763,
       "first_timeouts_per_100_instances_diff": 2.0,
       "over_8k_per_1000_calls_diff": 18.851672053428032,
       "cap_hits_per_1000_calls_diff": 4.816093045503171
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 20,
        "episodes": 517,
        "timeouts": 16,
        "timeouts_per_100_episodes": 3.094777562862669,
        "instances": 500,
        "first_timeouts": 13,
        "first_timeouts_per_100_instances": 2.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 40112,
        "completion_per_call": 1407.772686477862,
        "over_8k": 1437,
        "over_8k_per_1000_calls": 35.824690865576386,
        "cap_hits": 367,
        "cap_hits_per_1000_calls": 9.149381731152772,
        "length_finish": 367,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:05:08-07:00",
        "t_last_iso": "2026-10-28T04:59:05-07:00",
        "attempts_listed": 20,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 507,
        "timeouts": 8,
        "timeouts_per_100_episodes": 1.5779092702169626,
        "instances": 500,
        "first_timeouts": 6,
        "first_timeouts_per_100_instances": 1.2,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 39663,
        "completion_per_call": 914.9367168393717,
        "over_8k": 651,
        "over_8k_per_1000_calls": 16.413281900007565,
        "cap_hits": 121,
        "cap_hits_per_1000_calls": 3.0507021657464137,
        "length_finish": 121,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:15:21-07:00",
        "t_last_iso": "2026-10-02T13:52:03-07:00",
        "attempts_listed": 14,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.538655800524632,
       "timeouts_per_100_episodes_diff": 1.5168682926457064,
       "first_timeouts_per_100_instances_diff": 1.4000000000000001,
       "over_8k_per_1000_calls_diff": 19.41140896556882,
       "cap_hits_per_1000_calls_diff": 6.098679565406359
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 23,
        "episodes": 513,
        "timeouts": 29,
        "timeouts_per_100_episodes": 5.653021442495127,
        "instances": 483,
        "first_timeouts": 19,
        "first_timeouts_per_100_instances": 3.9337474120082816,
        "zero_other": 1,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 39540,
        "completion_per_call": 1715.7226353060191,
        "over_8k": 2089,
        "over_8k_per_1000_calls": 52.83257460799191,
        "cap_hits": 477,
        "cap_hits_per_1000_calls": 12.063732928679817,
        "length_finish": 477,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T05:30:51-07:00",
        "t_last_iso": "2026-10-28T07:18:05-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "published": {
        "units": 8,
        "attempts": 22,
        "episodes": 527,
        "timeouts": 28,
        "timeouts_per_100_episodes": 5.313092979127135,
        "instances": 500,
        "first_timeouts": 19,
        "first_timeouts_per_100_instances": 3.8,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 41050,
        "completion_per_call": 1441.529622411693,
        "over_8k": 1570,
        "over_8k_per_1000_calls": 38.24604141291108,
        "cap_hits": 338,
        "cap_hits_per_1000_calls": 8.23386114494519,
        "length_finish": 338,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:15:44-07:00",
        "t_last_iso": "2026-10-02T13:51:02-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.1902097665087163,
       "timeouts_per_100_episodes_diff": 0.33992846336799154,
       "first_timeouts_per_100_instances_diff": 0.13374741200828177,
       "over_8k_per_1000_calls_diff": 14.586533195080825,
       "cap_hits_per_1000_calls_diff": 3.829871783734628
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [
       "jqs_f_dense_sxs s44 shard4of8 (290065_0)"
      ],
      "published": []
     }
    },
    {
     "arm": "jqs_f_r40_sxs",
     "ref": "jqs_f_r40",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 64,
      "episodes": 1557,
      "timeouts": 60,
      "timeouts_per_100_episodes": 3.8535645472061657,
      "instances": 1500,
      "first_timeouts": 42,
      "first_timeouts_per_100_instances": 2.8,
      "zero_other": 2,
      "counted_zero": 6,
      "counted_timeouts": 6,
      "calls": 115703,
      "completion_per_call": 1321.7585542293632,
      "over_8k": 3492,
      "over_8k_per_1000_calls": 30.18072132961116,
      "cap_hits": 915,
      "cap_hits_per_1000_calls": 7.908178698910141,
      "length_finish": 915,
      "non200": 1,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T15:44:36-07:00",
      "t_last_iso": "2026-10-28T06:31:46-07:00",
      "attempts_listed": 64,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 37,
      "episodes": 1503,
      "timeouts": 16,
      "timeouts_per_100_episodes": 1.0645375914836992,
      "instances": 1488,
      "first_timeouts": 12,
      "first_timeouts_per_100_instances": 0.8064516129032258,
      "zero_other": 0,
      "counted_zero": 2,
      "counted_timeouts": 2,
      "calls": 106315,
      "completion_per_call": 945.3164275972347,
      "over_8k": 1640,
      "over_8k_per_1000_calls": 15.425857122701407,
      "cap_hits": 371,
      "cap_hits_per_1000_calls": 3.4896298734891595,
      "length_finish": 371,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-02T05:15:21-07:00",
      "t_last_iso": "2026-10-02T14:02:21-07:00",
      "attempts_listed": 39,
      "attempts_without_snapshot": 2,
      "units_first_attempt_without_snapshot": 1
     },
     "completion_per_call_ratio": 1.3982181157995457,
     "timeouts_per_100_episodes_diff": 2.7890269557224663,
     "first_timeouts_per_100_instances_diff": 1.993548387096774,
     "over_8k_per_1000_calls_diff": 14.754864206909753,
     "cap_hits_per_1000_calls_diff": 4.418548825420981,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 525,
        "timeouts": 28,
        "timeouts_per_100_episodes": 5.333333333333333,
        "instances": 500,
        "first_timeouts": 19,
        "first_timeouts_per_100_instances": 3.8,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 39333,
        "completion_per_call": 1460.0410596699971,
        "over_8k": 1406,
        "over_8k_per_1000_calls": 35.74606564462411,
        "cap_hits": 393,
        "cap_hits_per_1000_calls": 9.991610098390664,
        "length_finish": 393,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:21:04-07:00",
        "t_last_iso": "2026-10-28T06:05:35-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 506,
        "timeouts": 7,
        "timeouts_per_100_episodes": 1.383399209486166,
        "instances": 500,
        "first_timeouts": 5,
        "first_timeouts_per_100_instances": 1.0,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 35050,
        "completion_per_call": 1066.1160912981454,
        "over_8k": 680,
        "over_8k_per_1000_calls": 19.40085592011412,
        "cap_hits": 149,
        "cap_hits_per_1000_calls": 4.251069900142653,
        "length_finish": 149,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:15:21-07:00",
        "t_last_iso": "2026-10-02T14:02:21-07:00",
        "attempts_listed": 14,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3694953782117603,
       "timeouts_per_100_episodes_diff": 3.949934123847167,
       "first_timeouts_per_100_instances_diff": 2.8,
       "over_8k_per_1000_calls_diff": 16.34520972450999,
       "cap_hits_per_1000_calls_diff": 5.740540198248011
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 19,
        "episodes": 514,
        "timeouts": 13,
        "timeouts_per_100_episodes": 2.529182879377432,
        "instances": 500,
        "first_timeouts": 10,
        "first_timeouts_per_100_instances": 2.0,
        "zero_other": 2,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 38164,
        "completion_per_call": 1147.7114034168326,
        "over_8k": 831,
        "over_8k_per_1000_calls": 21.774447122943087,
        "cap_hits": 230,
        "cap_hits_per_1000_calls": 6.02662194738497,
        "length_finish": 230,
        "non200": 1,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:07:31-07:00",
        "t_last_iso": "2026-10-28T06:04:18-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 9,
        "episodes": 501,
        "timeouts": 1,
        "timeouts_per_100_episodes": 0.1996007984031936,
        "instances": 500,
        "first_timeouts": 1,
        "first_timeouts_per_100_instances": 0.2,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35613,
        "completion_per_call": 712.795299469295,
        "over_8k": 291,
        "over_8k_per_1000_calls": 8.171173447898239,
        "cap_hits": 74,
        "cap_hits_per_1000_calls": 2.077892904276528,
        "length_finish": 74,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:25:39-07:00",
        "t_last_iso": "2026-10-02T10:50:42-07:00",
        "attempts_listed": 9,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.6101556846283223,
       "timeouts_per_100_episodes_diff": 2.3295820809742382,
       "first_timeouts_per_100_instances_diff": 1.8,
       "over_8k_per_1000_calls_diff": 13.603273675044848,
       "cap_hits_per_1000_calls_diff": 3.948729043108442
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 21,
        "episodes": 518,
        "timeouts": 19,
        "timeouts_per_100_episodes": 3.667953667953668,
        "instances": 500,
        "first_timeouts": 13,
        "first_timeouts_per_100_instances": 2.6,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 38206,
        "completion_per_call": 1353.2528136941842,
        "over_8k": 1255,
        "over_8k_per_1000_calls": 32.8482437313511,
        "cap_hits": 292,
        "cap_hits_per_1000_calls": 7.64277862115898,
        "length_finish": 292,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T15:44:36-07:00",
        "t_last_iso": "2026-10-28T06:31:46-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 496,
        "timeouts": 8,
        "timeouts_per_100_episodes": 1.6129032258064515,
        "instances": 488,
        "first_timeouts": 6,
        "first_timeouts_per_100_instances": 1.2295081967213115,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 35652,
        "completion_per_call": 1058.8232918209358,
        "over_8k": 669,
        "over_8k_per_1000_calls": 18.76472568158869,
        "cap_hits": 148,
        "cap_hits_per_1000_calls": 4.151239762145181,
        "length_finish": 148,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:25:46-07:00",
        "t_last_iso": "2026-10-02T12:48:07-07:00",
        "attempts_listed": 16,
        "attempts_without_snapshot": 2,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.2780723886106589,
       "timeouts_per_100_episodes_diff": 2.0550504421472167,
       "first_timeouts_per_100_instances_diff": 1.3704918032786886,
       "over_8k_per_1000_calls_diff": 14.083518049762407,
       "cap_hits_per_1000_calls_diff": 3.491538859013799
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": [
       "jqs_f_r40 s44 shard4of8 (113139_0, 113139_1)"
      ]
     }
    },
    {
     "arm": "jqs_f_r60_sxs",
     "ref": "jqs_f_r60",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 52,
      "episodes": 1530,
      "timeouts": 31,
      "timeouts_per_100_episodes": 2.026143790849673,
      "instances": 1500,
      "first_timeouts": 22,
      "first_timeouts_per_100_instances": 1.4666666666666666,
      "zero_other": 1,
      "counted_zero": 3,
      "counted_timeouts": 3,
      "calls": 109484,
      "completion_per_call": 1260.9388586460122,
      "over_8k": 2871,
      "over_8k_per_1000_calls": 26.223009754850025,
      "cap_hits": 642,
      "cap_hits_per_1000_calls": 5.863870519893318,
      "length_finish": 642,
      "non200": 1,
      "excluded_episodes": 1,
      "excluded_calls": 87,
      "t_first_iso": "2026-10-25T15:58:43-07:00",
      "t_last_iso": "2026-10-28T06:53:09-07:00",
      "attempts_listed": 52,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 39,
      "episodes": 1511,
      "timeouts": 19,
      "timeouts_per_100_episodes": 1.257445400397088,
      "instances": 1491,
      "first_timeouts": 13,
      "first_timeouts_per_100_instances": 0.8718980549966465,
      "zero_other": 3,
      "counted_zero": 2,
      "counted_timeouts": 2,
      "calls": 105481,
      "completion_per_call": 950.0515732691196,
      "over_8k": 1591,
      "over_8k_per_1000_calls": 15.083285141399873,
      "cap_hits": 331,
      "cap_hits_per_1000_calls": 3.1380058967965794,
      "length_finish": 331,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-02T05:45:51-07:00",
      "t_last_iso": "2026-10-02T15:40:44-07:00",
      "attempts_listed": 40,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 1
     },
     "completion_per_call_ratio": 1.3272320094235854,
     "timeouts_per_100_episodes_diff": 0.768698390452585,
     "first_timeouts_per_100_instances_diff": 0.59476861167002,
     "over_8k_per_1000_calls_diff": 11.139724613450152,
     "cap_hits_per_1000_calls_diff": 2.7258646230967387,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 23,
        "episodes": 517,
        "timeouts": 17,
        "timeouts_per_100_episodes": 3.288201160541586,
        "instances": 500,
        "first_timeouts": 12,
        "first_timeouts_per_100_instances": 2.4,
        "zero_other": 1,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 36785,
        "completion_per_call": 1437.015169226587,
        "over_8k": 1310,
        "over_8k_per_1000_calls": 35.612341987223054,
        "cap_hits": 310,
        "cap_hits_per_1000_calls": 8.427348103846677,
        "length_finish": 310,
        "non200": 1,
        "excluded_episodes": 1,
        "excluded_calls": 87,
        "t_first_iso": "2026-10-26T08:25:06-07:00",
        "t_last_iso": "2026-10-28T06:53:09-07:00",
        "attempts_listed": 23,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 509,
        "timeouts": 10,
        "timeouts_per_100_episodes": 1.9646365422396856,
        "instances": 500,
        "first_timeouts": 6,
        "first_timeouts_per_100_instances": 1.2,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 35712,
        "completion_per_call": 1099.3380656362008,
        "over_8k": 686,
        "over_8k_per_1000_calls": 19.209229390681003,
        "cap_hits": 157,
        "cap_hits_per_1000_calls": 4.396281362007168,
        "length_finish": 157,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T07:02:10-07:00",
        "t_last_iso": "2026-10-02T14:17:46-07:00",
        "attempts_listed": 14,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.307164023648147,
       "timeouts_per_100_episodes_diff": 1.3235646183019005,
       "first_timeouts_per_100_instances_diff": 1.2,
       "over_8k_per_1000_calls_diff": 16.40311259654205,
       "cap_hits_per_1000_calls_diff": 4.031066741839509
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 11,
        "episodes": 501,
        "timeouts": 1,
        "timeouts_per_100_episodes": 0.1996007984031936,
        "instances": 500,
        "first_timeouts": 1,
        "first_timeouts_per_100_instances": 0.2,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35307,
        "completion_per_call": 1025.1124706148921,
        "over_8k": 550,
        "over_8k_per_1000_calls": 15.577647491998754,
        "cap_hits": 125,
        "cap_hits_per_1000_calls": 3.5403744299997166,
        "length_finish": 125,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:05:05-07:00",
        "t_last_iso": "2026-10-28T05:10:36-07:00",
        "attempts_listed": 11,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 10,
        "episodes": 503,
        "timeouts": 3,
        "timeouts_per_100_episodes": 0.5964214711729622,
        "instances": 500,
        "first_timeouts": 3,
        "first_timeouts_per_100_instances": 0.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35870,
        "completion_per_call": 707.989350432116,
        "over_8k": 276,
        "over_8k_per_1000_calls": 7.694452188458322,
        "cap_hits": 55,
        "cap_hits_per_1000_calls": 1.533314747700028,
        "length_finish": 55,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T07:02:28-07:00",
        "t_last_iso": "2026-10-02T11:13:13-07:00",
        "attempts_listed": 10,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.4479207490751413,
       "timeouts_per_100_episodes_diff": -0.39682067276976857,
       "first_timeouts_per_100_instances_diff": -0.39999999999999997,
       "over_8k_per_1000_calls_diff": 7.883195303540432,
       "cap_hits_per_1000_calls_diff": 2.0070596822996887
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 18,
        "episodes": 512,
        "timeouts": 13,
        "timeouts_per_100_episodes": 2.5390625,
        "instances": 500,
        "first_timeouts": 9,
        "first_timeouts_per_100_instances": 1.8,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 37392,
        "completion_per_call": 1310.3974379546428,
        "over_8k": 1011,
        "over_8k_per_1000_calls": 27.037869062901155,
        "cap_hits": 207,
        "cap_hits_per_1000_calls": 5.53594351732991,
        "length_finish": 207,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T15:58:43-07:00",
        "t_last_iso": "2026-10-28T05:53:34-07:00",
        "attempts_listed": 18,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 15,
        "episodes": 499,
        "timeouts": 6,
        "timeouts_per_100_episodes": 1.2024048096192386,
        "instances": 491,
        "first_timeouts": 4,
        "first_timeouts_per_100_instances": 0.814663951120163,
        "zero_other": 3,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 33899,
        "completion_per_call": 1048.9174016932652,
        "over_8k": 629,
        "over_8k_per_1000_calls": 18.55511962004779,
        "cap_hits": 119,
        "cap_hits_per_1000_calls": 3.5104280362252576,
        "length_finish": 119,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:45:51-07:00",
        "t_last_iso": "2026-10-02T15:40:44-07:00",
        "attempts_listed": 16,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.2492856309174305,
       "timeouts_per_100_episodes_diff": 1.3366576903807614,
       "first_timeouts_per_100_instances_diff": 0.9853360488798371,
       "over_8k_per_1000_calls_diff": 8.482749442853365,
       "cap_hits_per_1000_calls_diff": 2.0255154811046525
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": [
       "jqs_f_r60 s44 shard4of8 (113151_0)"
      ]
     }
    },
    {
     "arm": "jqs_f_u32_sxs",
     "ref": "jqs_f_u32",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 50,
      "episodes": 1543,
      "timeouts": 29,
      "timeouts_per_100_episodes": 1.8794556059624108,
      "instances": 1500,
      "first_timeouts": 23,
      "first_timeouts_per_100_instances": 1.5333333333333334,
      "zero_other": 11,
      "counted_zero": 1,
      "counted_timeouts": 1,
      "calls": 110836,
      "completion_per_call": 1288.1440867588149,
      "over_8k": 2951,
      "over_8k_per_1000_calls": 26.624923310115847,
      "cap_hits": 577,
      "cap_hits_per_1000_calls": 5.205889783102963,
      "length_finish": 577,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T15:44:08-07:00",
      "t_last_iso": "2026-10-28T07:29:22-07:00",
      "attempts_listed": 50,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 36,
      "episodes": 1507,
      "timeouts": 15,
      "timeouts_per_100_episodes": 0.9953550099535501,
      "instances": 1488,
      "first_timeouts": 15,
      "first_timeouts_per_100_instances": 1.0080645161290323,
      "zero_other": 3,
      "counted_zero": 0,
      "counted_timeouts": 0,
      "calls": 105665,
      "completion_per_call": 965.5349832016278,
      "over_8k": 1528,
      "over_8k_per_1000_calls": 14.46079591160744,
      "cap_hits": 209,
      "cap_hits_per_1000_calls": 1.9779491790091326,
      "length_finish": 209,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-02T05:45:35-07:00",
      "t_last_iso": "2026-10-02T12:00:09-07:00",
      "attempts_listed": 38,
      "attempts_without_snapshot": 2,
      "units_first_attempt_without_snapshot": 1
     },
     "completion_per_call_ratio": 1.3341247175606668,
     "timeouts_per_100_episodes_diff": 0.8841005960088607,
     "first_timeouts_per_100_instances_diff": 0.5252688172043012,
     "over_8k_per_1000_calls_diff": 12.164127398508407,
     "cap_hits_per_1000_calls_diff": 3.2279406040938303,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 20,
        "episodes": 513,
        "timeouts": 12,
        "timeouts_per_100_episodes": 2.3391812865497075,
        "instances": 500,
        "first_timeouts": 10,
        "first_timeouts_per_100_instances": 2.0,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 36746,
        "completion_per_call": 1409.1400696674468,
        "over_8k": 1122,
        "over_8k_per_1000_calls": 30.533935666467098,
        "cap_hits": 231,
        "cap_hits_per_1000_calls": 6.286398519566756,
        "length_finish": 231,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:21:57-07:00",
        "t_last_iso": "2026-10-28T05:53:25-07:00",
        "attempts_listed": 20,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 12,
        "episodes": 507,
        "timeouts": 6,
        "timeouts_per_100_episodes": 1.183431952662722,
        "instances": 500,
        "first_timeouts": 6,
        "first_timeouts_per_100_instances": 1.2,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35349,
        "completion_per_call": 1102.7223966731733,
        "over_8k": 659,
        "over_8k_per_1000_calls": 18.642677303459788,
        "cap_hits": 83,
        "cap_hits_per_1000_calls": 2.3480155025601857,
        "length_finish": 83,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:45:35-07:00",
        "t_last_iso": "2026-10-02T12:00:09-07:00",
        "attempts_listed": 12,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.277873809327453,
       "timeouts_per_100_episodes_diff": 1.1557493338869855,
       "first_timeouts_per_100_instances_diff": 0.8,
       "over_8k_per_1000_calls_diff": 11.89125836300731,
       "cap_hits_per_1000_calls_diff": 3.9383830170065703
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 12,
        "episodes": 511,
        "timeouts": 3,
        "timeouts_per_100_episodes": 0.5870841487279843,
        "instances": 500,
        "first_timeouts": 3,
        "first_timeouts_per_100_instances": 0.6,
        "zero_other": 8,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 36597,
        "completion_per_call": 1090.9579746973795,
        "over_8k": 684,
        "over_8k_per_1000_calls": 18.69005656201328,
        "cap_hits": 140,
        "cap_hits_per_1000_calls": 3.82545017351149,
        "length_finish": 140,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:05:23-07:00",
        "t_last_iso": "2026-10-28T04:49:11-07:00",
        "attempts_listed": 12,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 12,
        "episodes": 494,
        "timeouts": 4,
        "timeouts_per_100_episodes": 0.8097165991902834,
        "instances": 488,
        "first_timeouts": 4,
        "first_timeouts_per_100_instances": 0.819672131147541,
        "zero_other": 2,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35260,
        "completion_per_call": 750.6863584798639,
        "over_8k": 317,
        "over_8k_per_1000_calls": 8.99035734543392,
        "cap_hits": 45,
        "cap_hits_per_1000_calls": 1.276233692569484,
        "length_finish": 45,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:46:04-07:00",
        "t_last_iso": "2026-10-02T11:06:26-07:00",
        "attempts_listed": 14,
        "attempts_without_snapshot": 2,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.453280670913701,
       "timeouts_per_100_episodes_diff": -0.22263245046229907,
       "first_timeouts_per_100_instances_diff": -0.21967213114754103,
       "over_8k_per_1000_calls_diff": 9.69969921657936,
       "cap_hits_per_1000_calls_diff": 2.549216480942006
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 18,
        "episodes": 519,
        "timeouts": 14,
        "timeouts_per_100_episodes": 2.697495183044316,
        "instances": 500,
        "first_timeouts": 10,
        "first_timeouts_per_100_instances": 2.0,
        "zero_other": 3,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37493,
        "completion_per_call": 1362.0325927506467,
        "over_8k": 1145,
        "over_8k_per_1000_calls": 30.539033953004562,
        "cap_hits": 206,
        "cap_hits_per_1000_calls": 5.494358947003441,
        "length_finish": 206,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T15:44:08-07:00",
        "t_last_iso": "2026-10-28T07:29:22-07:00",
        "attempts_listed": 18,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 12,
        "episodes": 506,
        "timeouts": 5,
        "timeouts_per_100_episodes": 0.9881422924901185,
        "instances": 500,
        "first_timeouts": 5,
        "first_timeouts_per_100_instances": 1.0,
        "zero_other": 1,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35056,
        "completion_per_call": 1043.2998345504336,
        "over_8k": 552,
        "over_8k_per_1000_calls": 15.746234596074851,
        "cap_hits": 81,
        "cap_hits_per_1000_calls": 2.310588772250114,
        "length_finish": 81,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:47:06-07:00",
        "t_last_iso": "2026-10-02T10:39:40-07:00",
        "attempts_listed": 12,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3055044653942245,
       "timeouts_per_100_episodes_diff": 1.7093528905541975,
       "first_timeouts_per_100_instances_diff": 1.0,
       "over_8k_per_1000_calls_diff": 14.792799356929711,
       "cap_hits_per_1000_calls_diff": 3.183770174753327
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": [
       "jqs_f_u32 s43 shard4of8 (113250_0, 113250_1)"
      ]
     }
    },
    {
     "arm": "jqs_f_u64_sxs",
     "ref": "jqs_f_u64",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 54,
      "episodes": 1537,
      "timeouts": 35,
      "timeouts_per_100_episodes": 2.277163305139883,
      "instances": 1500,
      "first_timeouts": 27,
      "first_timeouts_per_100_instances": 1.8,
      "zero_other": 0,
      "counted_zero": 1,
      "counted_timeouts": 1,
      "calls": 112296,
      "completion_per_call": 1397.466899978628,
      "over_8k": 3679,
      "over_8k_per_1000_calls": 32.76162997791551,
      "cap_hits": 681,
      "cap_hits_per_1000_calls": 6.064329985039539,
      "length_finish": 681,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T15:35:03-07:00",
      "t_last_iso": "2026-10-28T06:52:13-07:00",
      "attempts_listed": 54,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 35,
      "episodes": 1508,
      "timeouts": 8,
      "timeouts_per_100_episodes": 0.5305039787798409,
      "instances": 1491,
      "first_timeouts": 7,
      "first_timeouts_per_100_instances": 0.4694835680751174,
      "zero_other": 9,
      "counted_zero": 0,
      "counted_timeouts": 0,
      "calls": 107751,
      "completion_per_call": 991.172759417546,
      "over_8k": 1793,
      "over_8k_per_1000_calls": 16.640216796131824,
      "cap_hits": 252,
      "cap_hits_per_1000_calls": 2.3387253946599103,
      "length_finish": 252,
      "non200": 6,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-02T05:36:23-07:00",
      "t_last_iso": "2026-10-02T14:23:42-07:00",
      "attempts_listed": 36,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 1
     },
     "completion_per_call_ratio": 1.409912537144218,
     "timeouts_per_100_episodes_diff": 1.746659326360042,
     "first_timeouts_per_100_instances_diff": 1.3305164319248828,
     "over_8k_per_1000_calls_diff": 16.121413181783687,
     "cap_hits_per_1000_calls_diff": 3.7256045903796284,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 22,
        "episodes": 520,
        "timeouts": 20,
        "timeouts_per_100_episodes": 3.8461538461538463,
        "instances": 500,
        "first_timeouts": 13,
        "first_timeouts_per_100_instances": 2.6,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 38508,
        "completion_per_call": 1530.457385478342,
        "over_8k": 1429,
        "over_8k_per_1000_calls": 37.109172120078945,
        "cap_hits": 273,
        "cap_hits_per_1000_calls": 7.089435961358679,
        "length_finish": 273,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:41:44-07:00",
        "t_last_iso": "2026-10-28T06:02:34-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 12,
        "episodes": 503,
        "timeouts": 3,
        "timeouts_per_100_episodes": 0.5964214711729622,
        "instances": 500,
        "first_timeouts": 3,
        "first_timeouts_per_100_instances": 0.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35843,
        "completion_per_call": 1129.1522752001786,
        "over_8k": 714,
        "over_8k_per_1000_calls": 19.920207571910833,
        "cap_hits": 106,
        "cap_hits_per_1000_calls": 2.9573417403677147,
        "length_finish": 106,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:46:46-07:00",
        "t_last_iso": "2026-10-02T12:46:15-07:00",
        "attempts_listed": 12,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3554038893532045,
       "timeouts_per_100_episodes_diff": 3.249732374980884,
       "first_timeouts_per_100_instances_diff": 2.0,
       "over_8k_per_1000_calls_diff": 17.188964548168112,
       "cap_hits_per_1000_calls_diff": 4.132094220990965
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 12,
        "episodes": 503,
        "timeouts": 2,
        "timeouts_per_100_episodes": 0.3976143141153082,
        "instances": 500,
        "first_timeouts": 2,
        "first_timeouts_per_100_instances": 0.4,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35930,
        "completion_per_call": 1195.2588087948789,
        "over_8k": 870,
        "over_8k_per_1000_calls": 24.213748956303924,
        "cap_hits": 171,
        "cap_hits_per_1000_calls": 4.7592541052045645,
        "length_finish": 171,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:08:23-07:00",
        "t_last_iso": "2026-10-27T19:39:57-07:00",
        "attempts_listed": 12,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 10,
        "episodes": 493,
        "timeouts": 2,
        "timeouts_per_100_episodes": 0.4056795131845842,
        "instances": 491,
        "first_timeouts": 2,
        "first_timeouts_per_100_instances": 0.4073319755600815,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 35607,
        "completion_per_call": 731.5757575757576,
        "over_8k": 307,
        "over_8k_per_1000_calls": 8.621900188165249,
        "cap_hits": 47,
        "cap_hits_per_1000_calls": 1.3199651753868622,
        "length_finish": 47,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:46:59-07:00",
        "t_last_iso": "2026-10-02T11:07:03-07:00",
        "attempts_listed": 11,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.6338141284993373,
       "timeouts_per_100_episodes_diff": -0.008065199069275997,
       "first_timeouts_per_100_instances_diff": -0.007331975560081472,
       "over_8k_per_1000_calls_diff": 15.591848768138675,
       "cap_hits_per_1000_calls_diff": 3.4392889298177023
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 20,
        "episodes": 514,
        "timeouts": 13,
        "timeouts_per_100_episodes": 2.529182879377432,
        "instances": 500,
        "first_timeouts": 12,
        "first_timeouts_per_100_instances": 2.4,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37858,
        "completion_per_call": 1454.1032542659411,
        "over_8k": 1380,
        "over_8k_per_1000_calls": 36.452004860267316,
        "cap_hits": 237,
        "cap_hits_per_1000_calls": 6.260235617306778,
        "length_finish": 237,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T15:35:03-07:00",
        "t_last_iso": "2026-10-28T06:52:13-07:00",
        "attempts_listed": 20,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 13,
        "episodes": 512,
        "timeouts": 3,
        "timeouts_per_100_episodes": 0.5859375,
        "instances": 500,
        "first_timeouts": 2,
        "first_timeouts_per_100_instances": 0.4,
        "zero_other": 9,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 36301,
        "completion_per_call": 1109.568138618771,
        "over_8k": 772,
        "over_8k_per_1000_calls": 21.26663177322939,
        "cap_hits": 99,
        "cap_hits_per_1000_calls": 2.7271975978623177,
        "length_finish": 99,
        "non200": 6,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:36:23-07:00",
        "t_last_iso": "2026-10-02T14:23:42-07:00",
        "attempts_listed": 13,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3105128055281576,
       "timeouts_per_100_episodes_diff": 1.9432453793774318,
       "first_timeouts_per_100_instances_diff": 2.0,
       "over_8k_per_1000_calls_diff": 15.185373087037927,
       "cap_hits_per_1000_calls_diff": 3.53303801944446
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": [
       "jqs_f_u64 s43 shard4of8 (113265_0)"
      ]
     }
    },
    {
     "arm": "jqs_f_u128_sxs",
     "ref": "jqs_f_u128",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 60,
      "episodes": 1557,
      "timeouts": 51,
      "timeouts_per_100_episodes": 3.275529865125241,
      "instances": 1500,
      "first_timeouts": 41,
      "first_timeouts_per_100_instances": 2.7333333333333334,
      "zero_other": 3,
      "counted_zero": 1,
      "counted_timeouts": 1,
      "calls": 117330,
      "completion_per_call": 1478.1296087957044,
      "over_8k": 4473,
      "over_8k_per_1000_calls": 38.12324213756072,
      "cap_hits": 914,
      "cap_hits_per_1000_calls": 7.789994033921419,
      "length_finish": 914,
      "non200": 0,
      "excluded_episodes": 1,
      "excluded_calls": 67,
      "t_first_iso": "2026-10-25T15:43:21-07:00",
      "t_last_iso": "2026-10-28T06:26:49-07:00",
      "attempts_listed": 60,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 42,
      "episodes": 1527,
      "timeouts": 22,
      "timeouts_per_100_episodes": 1.4407334643091028,
      "instances": 1500,
      "first_timeouts": 18,
      "first_timeouts_per_100_instances": 1.2,
      "zero_other": 6,
      "counted_zero": 1,
      "counted_timeouts": 1,
      "calls": 113479,
      "completion_per_call": 1097.8747521567868,
      "over_8k": 2489,
      "over_8k_per_1000_calls": 21.933573612738922,
      "cap_hits": 376,
      "cap_hits_per_1000_calls": 3.313388380228941,
      "length_finish": 376,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-02T05:36:10-07:00",
      "t_last_iso": "2026-10-02T14:31:31-07:00",
      "attempts_listed": 42,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.3463554070187904,
     "timeouts_per_100_episodes_diff": 1.8347964008161382,
     "first_timeouts_per_100_instances_diff": 1.5333333333333334,
     "over_8k_per_1000_calls_diff": 16.1896685248218,
     "cap_hits_per_1000_calls_diff": 4.476605653692477,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 524,
        "timeouts": 24,
        "timeouts_per_100_episodes": 4.580152671755725,
        "instances": 500,
        "first_timeouts": 17,
        "first_timeouts_per_100_instances": 3.4,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 39449,
        "completion_per_call": 1661.6211310806357,
        "over_8k": 1841,
        "over_8k_per_1000_calls": 46.66784962863444,
        "cap_hits": 372,
        "cap_hits_per_1000_calls": 9.429896828816954,
        "length_finish": 372,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:10:16-07:00",
        "t_last_iso": "2026-10-28T06:06:02-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 507,
        "timeouts": 7,
        "timeouts_per_100_episodes": 1.3806706114398422,
        "instances": 500,
        "first_timeouts": 7,
        "first_timeouts_per_100_instances": 1.4,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 36692,
        "completion_per_call": 1241.8337784803227,
        "over_8k": 966,
        "over_8k_per_1000_calls": 26.32726479886624,
        "cap_hits": 137,
        "cap_hits_per_1000_calls": 3.7337839311021477,
        "length_finish": 137,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:36:14-07:00",
        "t_last_iso": "2026-10-02T13:54:16-07:00",
        "attempts_listed": 14,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.338038278451422,
       "timeouts_per_100_episodes_diff": 3.1994820603158827,
       "first_timeouts_per_100_instances_diff": 2.0,
       "over_8k_per_1000_calls_diff": 20.340584829768204,
       "cap_hits_per_1000_calls_diff": 5.696112897714807
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 15,
        "episodes": 511,
        "timeouts": 10,
        "timeouts_per_100_episodes": 1.9569471624266144,
        "instances": 500,
        "first_timeouts": 10,
        "first_timeouts_per_100_instances": 2.0,
        "zero_other": 1,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 38537,
        "completion_per_call": 1247.9512676129434,
        "over_8k": 1076,
        "over_8k_per_1000_calls": 27.921218569167294,
        "cap_hits": 247,
        "cap_hits_per_1000_calls": 6.409424708721488,
        "length_finish": 247,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:05:09-07:00",
        "t_last_iso": "2026-10-27T20:20:16-07:00",
        "attempts_listed": 15,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 9,
        "episodes": 500,
        "timeouts": 0,
        "timeouts_per_100_episodes": 0.0,
        "instances": 500,
        "first_timeouts": 0,
        "first_timeouts_per_100_instances": 0.0,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37051,
        "completion_per_call": 787.6668106123991,
        "over_8k": 391,
        "over_8k_per_1000_calls": 10.553021510890394,
        "cap_hits": 50,
        "cap_hits_per_1000_calls": 1.3494912418018408,
        "length_finish": 50,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:36:10-07:00",
        "t_last_iso": "2026-10-02T12:11:59-07:00",
        "attempts_listed": 9,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.5843644175418286,
       "timeouts_per_100_episodes_diff": 1.9569471624266144,
       "first_timeouts_per_100_instances_diff": 2.0,
       "over_8k_per_1000_calls_diff": 17.3681970582769,
       "cap_hits_per_1000_calls_diff": 5.059933466919647
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 21,
        "episodes": 522,
        "timeouts": 17,
        "timeouts_per_100_episodes": 3.256704980842912,
        "instances": 500,
        "first_timeouts": 14,
        "first_timeouts_per_100_instances": 2.8,
        "zero_other": 2,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 39344,
        "completion_per_call": 1519.6054544530298,
        "over_8k": 1556,
        "over_8k_per_1000_calls": 39.5485969906466,
        "cap_hits": 295,
        "cap_hits_per_1000_calls": 7.497966653111021,
        "length_finish": 295,
        "non200": 0,
        "excluded_episodes": 1,
        "excluded_calls": 67,
        "t_first_iso": "2026-10-25T15:43:21-07:00",
        "t_last_iso": "2026-10-28T06:26:49-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 19,
        "episodes": 520,
        "timeouts": 15,
        "timeouts_per_100_episodes": 2.8846153846153846,
        "instances": 500,
        "first_timeouts": 11,
        "first_timeouts_per_100_instances": 2.2,
        "zero_other": 6,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 39736,
        "completion_per_call": 1254.1906835111738,
        "over_8k": 1132,
        "over_8k_per_1000_calls": 28.48802093819207,
        "cap_hits": 189,
        "cap_hits_per_1000_calls": 4.756392188443729,
        "length_finish": 189,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-02T05:36:31-07:00",
        "t_last_iso": "2026-10-02T14:31:31-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.2116223429429511,
       "timeouts_per_100_episodes_diff": 0.37208959622752724,
       "first_timeouts_per_100_instances_diff": 0.5999999999999996,
       "over_8k_per_1000_calls_diff": 11.060576052454532,
       "cap_hits_per_1000_calls_diff": 2.741574464667292
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": []
     }
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "ref": "quest_b2048_s1",
     "units_compared": 48,
     "units_rerun": 48,
     "rerun": {
      "units": 48,
      "attempts": 164,
      "episodes": 1990,
      "timeouts": 298,
      "timeouts_per_100_episodes": 14.974874371859297,
      "instances": 1500,
      "first_timeouts": 186,
      "first_timeouts_per_100_instances": 12.4,
      "zero_other": 266,
      "counted_zero": 83,
      "counted_timeouts": 26,
      "calls": 371412,
      "completion_per_call": 830.8853106523214,
      "over_8k": 4481,
      "over_8k_per_1000_calls": 12.064769043541943,
      "cap_hits": 1170,
      "cap_hits_per_1000_calls": 3.150140544731996,
      "length_finish": 1170,
      "non200": 266,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T16:03:28-07:00",
      "t_last_iso": "2026-10-28T10:20:52-07:00",
      "attempts_listed": 164,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 48,
      "attempts": 126,
      "episodes": 1685,
      "timeouts": 106,
      "timeouts_per_100_episodes": 6.29080118694362,
      "instances": 1489,
      "first_timeouts": 69,
      "first_timeouts_per_100_instances": 4.633982538616521,
      "zero_other": 110,
      "counted_zero": 25,
      "counted_timeouts": 9,
      "calls": 325774,
      "completion_per_call": 617.2733152430826,
      "over_8k": 2170,
      "over_8k_per_1000_calls": 6.661059507511342,
      "cap_hits": 678,
      "cap_hits_per_1000_calls": 2.08119739451276,
      "length_finish": 678,
      "non200": 109,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-03T16:01:31-07:00",
      "t_last_iso": "2026-10-04T00:30:03-07:00",
      "attempts_listed": 127,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 1
     },
     "completion_per_call_ratio": 1.3460573948917884,
     "timeouts_per_100_episodes_diff": 8.684073184915677,
     "first_timeouts_per_100_instances_diff": 7.76601746138348,
     "over_8k_per_1000_calls_diff": 5.403709536030601,
     "cap_hits_per_1000_calls_diff": 1.0689431502192357,
     "seeds": {
      "42": {
       "rerun": {
        "units": 16,
        "attempts": 61,
        "episodes": 697,
        "timeouts": 134,
        "timeouts_per_100_episodes": 19.225251076040173,
        "instances": 500,
        "first_timeouts": 76,
        "first_timeouts_per_100_instances": 15.2,
        "zero_other": 95,
        "counted_zero": 36,
        "counted_timeouts": 13,
        "calls": 128179,
        "completion_per_call": 890.0615233384564,
        "over_8k": 1774,
        "over_8k_per_1000_calls": 13.840020596197505,
        "cap_hits": 463,
        "cap_hits_per_1000_calls": 3.6121361533480525,
        "length_finish": 463,
        "non200": 95,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:20:57-07:00",
        "t_last_iso": "2026-10-28T10:20:52-07:00",
        "attempts_listed": 61,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 16,
        "attempts": 44,
        "episodes": 562,
        "timeouts": 38,
        "timeouts_per_100_episodes": 6.761565836298932,
        "instances": 489,
        "first_timeouts": 22,
        "first_timeouts_per_100_instances": 4.4989775051124745,
        "zero_other": 41,
        "counted_zero": 9,
        "counted_timeouts": 3,
        "calls": 107972,
        "completion_per_call": 635.4219797725336,
        "over_8k": 750,
        "over_8k_per_1000_calls": 6.946245322861483,
        "cap_hits": 239,
        "cap_hits_per_1000_calls": 2.2135368428851923,
        "length_finish": 239,
        "non200": 40,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T16:01:31-07:00",
        "t_last_iso": "2026-10-04T00:29:27-07:00",
        "attempts_listed": 45,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.4007408488719226,
       "timeouts_per_100_episodes_diff": 12.463685239741242,
       "first_timeouts_per_100_instances_diff": 10.701022494887525,
       "over_8k_per_1000_calls_diff": 6.893775273336022,
       "cap_hits_per_1000_calls_diff": 1.3985993104628602
      },
      "43": {
       "rerun": {
        "units": 16,
        "attempts": 53,
        "episodes": 636,
        "timeouts": 86,
        "timeouts_per_100_episodes": 13.522012578616351,
        "instances": 500,
        "first_timeouts": 59,
        "first_timeouts_per_100_instances": 11.8,
        "zero_other": 68,
        "counted_zero": 19,
        "counted_timeouts": 6,
        "calls": 120426,
        "completion_per_call": 821.1145018517595,
        "over_8k": 1285,
        "over_8k_per_1000_calls": 10.67045322438676,
        "cap_hits": 295,
        "cap_hits_per_1000_calls": 2.4496371215518242,
        "length_finish": 295,
        "non200": 68,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:05:42-07:00",
        "t_last_iso": "2026-10-28T07:43:11-07:00",
        "attempts_listed": 53,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 16,
        "attempts": 38,
        "episodes": 556,
        "timeouts": 37,
        "timeouts_per_100_episodes": 6.654676258992806,
        "instances": 500,
        "first_timeouts": 25,
        "first_timeouts_per_100_instances": 5.0,
        "zero_other": 23,
        "counted_zero": 5,
        "counted_timeouts": 4,
        "calls": 108592,
        "completion_per_call": 605.573440032415,
        "over_8k": 688,
        "over_8k_per_1000_calls": 6.335641667894504,
        "cap_hits": 224,
        "cap_hits_per_1000_calls": 2.0627670546633268,
        "length_finish": 224,
        "non200": 23,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T16:12:05-07:00",
        "t_last_iso": "2026-10-03T23:56:07-07:00",
        "attempts_listed": 38,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3559288561397396,
       "timeouts_per_100_episodes_diff": 6.867336319623545,
       "first_timeouts_per_100_instances_diff": 6.800000000000001,
       "over_8k_per_1000_calls_diff": 4.334811556492256,
       "cap_hits_per_1000_calls_diff": 0.38687006688849745
      },
      "44": {
       "rerun": {
        "units": 16,
        "attempts": 50,
        "episodes": 657,
        "timeouts": 78,
        "timeouts_per_100_episodes": 11.872146118721462,
        "instances": 500,
        "first_timeouts": 51,
        "first_timeouts_per_100_instances": 10.2,
        "zero_other": 103,
        "counted_zero": 28,
        "counted_timeouts": 7,
        "calls": 122807,
        "completion_per_call": 778.7018981002711,
        "over_8k": 1422,
        "over_8k_per_1000_calls": 11.579144511306358,
        "cap_hits": 412,
        "cap_hits_per_1000_calls": 3.3548576221225175,
        "length_finish": 412,
        "non200": 103,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T16:03:28-07:00",
        "t_last_iso": "2026-10-28T07:44:11-07:00",
        "attempts_listed": 50,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 16,
        "attempts": 44,
        "episodes": 567,
        "timeouts": 31,
        "timeouts_per_100_episodes": 5.467372134038801,
        "instances": 500,
        "first_timeouts": 22,
        "first_timeouts_per_100_instances": 4.4,
        "zero_other": 46,
        "counted_zero": 11,
        "counted_timeouts": 2,
        "calls": 109210,
        "completion_per_call": 610.9640509110887,
        "over_8k": 732,
        "over_8k_per_1000_calls": 6.7026829044959255,
        "cap_hits": 215,
        "cap_hits_per_1000_calls": 1.9686841864298141,
        "length_finish": 215,
        "non200": 46,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T16:14:05-07:00",
        "t_last_iso": "2026-10-04T00:30:03-07:00",
        "attempts_listed": 44,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.2745461814636172,
       "timeouts_per_100_episodes_diff": 6.404773984682661,
       "first_timeouts_per_100_instances_diff": 5.799999999999999,
       "over_8k_per_1000_calls_diff": 4.876461606810433,
       "cap_hits_per_1000_calls_diff": 1.3861734356927033
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": [
       "quest_b2048_s1 s42 shard8of16 (127328_0)"
      ]
     }
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "ref": "sparq_c8_s1",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 68,
      "episodes": 1571,
      "timeouts": 73,
      "timeouts_per_100_episodes": 4.646721833227244,
      "instances": 1500,
      "first_timeouts": 54,
      "first_timeouts_per_100_instances": 3.6,
      "zero_other": 1,
      "counted_zero": 5,
      "counted_timeouts": 5,
      "calls": 118518,
      "completion_per_call": 1441.3584940684116,
      "over_8k": 4135,
      "over_8k_per_1000_calls": 34.88921514031624,
      "cap_hits": 904,
      "cap_hits_per_1000_calls": 7.6275333704584956,
      "length_finish": 904,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T15:29:09-07:00",
      "t_last_iso": "2026-10-28T06:53:38-07:00",
      "attempts_listed": 68,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 61,
      "episodes": 1567,
      "timeouts": 72,
      "timeouts_per_100_episodes": 4.594767070835992,
      "instances": 1500,
      "first_timeouts": 46,
      "first_timeouts_per_100_instances": 3.066666666666667,
      "zero_other": 4,
      "counted_zero": 9,
      "counted_timeouts": 9,
      "calls": 121004,
      "completion_per_call": 1193.4469108459225,
      "over_8k": 2890,
      "over_8k_per_1000_calls": 23.883507983207167,
      "cap_hits": 456,
      "cap_hits_per_1000_calls": 3.768470463786321,
      "length_finish": 456,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-03T13:44:05-07:00",
      "t_last_iso": "2026-10-03T22:25:14-07:00",
      "attempts_listed": 61,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.2077273659762275,
     "timeouts_per_100_episodes_diff": 0.05195476239125174,
     "first_timeouts_per_100_instances_diff": 0.5333333333333332,
     "over_8k_per_1000_calls_diff": 11.005707157109072,
     "cap_hits_per_1000_calls_diff": 3.8590629066721744,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 26,
        "episodes": 530,
        "timeouts": 30,
        "timeouts_per_100_episodes": 5.660377358490566,
        "instances": 500,
        "first_timeouts": 22,
        "first_timeouts_per_100_instances": 4.4,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 40094,
        "completion_per_call": 1562.9890257893949,
        "over_8k": 1570,
        "over_8k_per_1000_calls": 39.15797874993765,
        "cap_hits": 343,
        "cap_hits_per_1000_calls": 8.55489599441313,
        "length_finish": 343,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:00:48-07:00",
        "t_last_iso": "2026-10-28T06:04:28-07:00",
        "attempts_listed": 26,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 24,
        "episodes": 537,
        "timeouts": 40,
        "timeouts_per_100_episodes": 7.4487895716946,
        "instances": 500,
        "first_timeouts": 20,
        "first_timeouts_per_100_instances": 4.0,
        "zero_other": 4,
        "counted_zero": 7,
        "counted_timeouts": 7,
        "calls": 40942,
        "completion_per_call": 1395.4404523472228,
        "over_8k": 1306,
        "over_8k_per_1000_calls": 31.898783645156563,
        "cap_hits": 189,
        "cap_hits_per_1000_calls": 4.616286454008109,
        "length_finish": 189,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:44:26-07:00",
        "t_last_iso": "2026-10-03T22:25:14-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.120068594227969,
       "timeouts_per_100_episodes_diff": -1.788412213204034,
       "first_timeouts_per_100_instances_diff": 0.40000000000000036,
       "over_8k_per_1000_calls_diff": 7.259195104781085,
       "cap_hits_per_1000_calls_diff": 3.9386095404050208
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 20,
        "episodes": 512,
        "timeouts": 13,
        "timeouts_per_100_episodes": 2.5390625,
        "instances": 500,
        "first_timeouts": 11,
        "first_timeouts_per_100_instances": 2.2,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 38289,
        "completion_per_call": 1240.8521768654182,
        "over_8k": 953,
        "over_8k_per_1000_calls": 24.889654992295437,
        "cap_hits": 209,
        "cap_hits_per_1000_calls": 5.458486771657657,
        "length_finish": 209,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:10:06-07:00",
        "t_last_iso": "2026-10-28T05:52:37-07:00",
        "attempts_listed": 20,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 16,
        "episodes": 509,
        "timeouts": 9,
        "timeouts_per_100_episodes": 1.768172888015717,
        "instances": 500,
        "first_timeouts": 8,
        "first_timeouts_per_100_instances": 1.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 40193,
        "completion_per_call": 920.5375811708507,
        "over_8k": 564,
        "over_8k_per_1000_calls": 14.032294180578708,
        "cap_hits": 80,
        "cap_hits_per_1000_calls": 1.9903963376707388,
        "length_finish": 80,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:44:05-07:00",
        "t_last_iso": "2026-10-03T19:50:47-07:00",
        "attempts_listed": 16,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3479647134961648,
       "timeouts_per_100_episodes_diff": 0.770889611984283,
       "first_timeouts_per_100_instances_diff": 0.6000000000000001,
       "over_8k_per_1000_calls_diff": 10.85736081171673,
       "cap_hits_per_1000_calls_diff": 3.4680904339869176
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 22,
        "episodes": 529,
        "timeouts": 30,
        "timeouts_per_100_episodes": 5.671077504725898,
        "instances": 500,
        "first_timeouts": 21,
        "first_timeouts_per_100_instances": 4.2,
        "zero_other": 1,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 40135,
        "completion_per_call": 1511.1362900211784,
        "over_8k": 1612,
        "over_8k_per_1000_calls": 40.16444499813131,
        "cap_hits": 352,
        "cap_hits_per_1000_calls": 8.770399900336365,
        "length_finish": 352,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T15:29:09-07:00",
        "t_last_iso": "2026-10-28T06:53:38-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 21,
        "episodes": 521,
        "timeouts": 23,
        "timeouts_per_100_episodes": 4.414587332053743,
        "instances": 500,
        "first_timeouts": 18,
        "first_timeouts_per_100_instances": 3.6,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 39869,
        "completion_per_call": 1261.1442474102687,
        "over_8k": 1020,
        "over_8k_per_1000_calls": 25.583786902104393,
        "cap_hits": 187,
        "cap_hits_per_1000_calls": 4.690360932052472,
        "length_finish": 187,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:44:46-07:00",
        "t_last_iso": "2026-10-03T22:24:11-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.198226367145759,
       "timeouts_per_100_episodes_diff": 1.2564901726721551,
       "first_timeouts_per_100_instances_diff": 0.6000000000000001,
       "over_8k_per_1000_calls_diff": 14.580658096026916,
       "cap_hits_per_1000_calls_diff": 4.080038968283893
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": []
     }
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "ref": "loki_k25_d25_s1",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 70,
      "episodes": 1579,
      "timeouts": 75,
      "timeouts_per_100_episodes": 4.749841671944268,
      "instances": 1500,
      "first_timeouts": 54,
      "first_timeouts_per_100_instances": 3.6,
      "zero_other": 0,
      "counted_zero": 3,
      "counted_timeouts": 3,
      "calls": 118496,
      "completion_per_call": 1521.2032473669997,
      "over_8k": 4824,
      "over_8k_per_1000_calls": 40.71023494463948,
      "cap_hits": 999,
      "cap_hits_per_1000_calls": 8.430664326221983,
      "length_finish": 998,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T16:05:54-07:00",
      "t_last_iso": "2026-10-28T08:39:13-07:00",
      "attempts_listed": 70,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 55,
      "episodes": 1536,
      "timeouts": 53,
      "timeouts_per_100_episodes": 3.4505208333333335,
      "instances": 1488,
      "first_timeouts": 34,
      "first_timeouts_per_100_instances": 2.28494623655914,
      "zero_other": 0,
      "counted_zero": 5,
      "counted_timeouts": 5,
      "calls": 115762,
      "completion_per_call": 1223.3552720236346,
      "over_8k": 3160,
      "over_8k_per_1000_calls": 27.297386016136556,
      "cap_hits": 575,
      "cap_hits_per_1000_calls": 4.967087645341303,
      "length_finish": 575,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-03T13:44:57-07:00",
      "t_last_iso": "2026-10-03T22:25:27-07:00",
      "attempts_listed": 56,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 1
     },
     "completion_per_call_ratio": 1.2434680931653441,
     "timeouts_per_100_episodes_diff": 1.2993208386109347,
     "first_timeouts_per_100_instances_diff": 1.3150537634408601,
     "over_8k_per_1000_calls_diff": 13.412848928502925,
     "cap_hits_per_1000_calls_diff": 3.4635766808806796,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 537,
        "timeouts": 37,
        "timeouts_per_100_episodes": 6.890130353817504,
        "instances": 500,
        "first_timeouts": 25,
        "first_timeouts_per_100_instances": 5.0,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 39755,
        "completion_per_call": 1704.1450383599547,
        "over_8k": 2000,
        "over_8k_per_1000_calls": 50.308137341214945,
        "cap_hits": 418,
        "cap_hits_per_1000_calls": 10.514400704313923,
        "length_finish": 417,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:21:10-07:00",
        "t_last_iso": "2026-10-28T05:50:54-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 20,
        "episodes": 519,
        "timeouts": 22,
        "timeouts_per_100_episodes": 4.238921001926783,
        "instances": 500,
        "first_timeouts": 13,
        "first_timeouts_per_100_instances": 2.6,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 38215,
        "completion_per_call": 1382.7162109119456,
        "over_8k": 1295,
        "over_8k_per_1000_calls": 33.88721706136334,
        "cap_hits": 255,
        "cap_hits_per_1000_calls": 6.672772471542588,
        "length_finish": 255,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:44:57-07:00",
        "t_last_iso": "2026-10-03T22:25:27-07:00",
        "attempts_listed": 20,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.2324618926945368,
       "timeouts_per_100_episodes_diff": 2.6512093518907216,
       "first_timeouts_per_100_instances_diff": 2.4,
       "over_8k_per_1000_calls_diff": 16.420920279851607,
       "cap_hits_per_1000_calls_diff": 3.8416282327713347
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 22,
        "episodes": 517,
        "timeouts": 17,
        "timeouts_per_100_episodes": 3.288201160541586,
        "instances": 500,
        "first_timeouts": 14,
        "first_timeouts_per_100_instances": 2.8,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 39290,
        "completion_per_call": 1321.5525069992364,
        "over_8k": 1231,
        "over_8k_per_1000_calls": 31.33112751336218,
        "cap_hits": 264,
        "cap_hits_per_1000_calls": 6.71926698905574,
        "length_finish": 264,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:07:51-07:00",
        "t_last_iso": "2026-10-28T05:39:39-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 495,
        "timeouts": 7,
        "timeouts_per_100_episodes": 1.4141414141414141,
        "instances": 488,
        "first_timeouts": 5,
        "first_timeouts_per_100_instances": 1.0245901639344261,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 38404,
        "completion_per_call": 937.7395583793354,
        "over_8k": 617,
        "over_8k_per_1000_calls": 16.066034788042913,
        "cap_hits": 100,
        "cap_hits_per_1000_calls": 2.603895427559629,
        "length_finish": 100,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:46:20-07:00",
        "t_last_iso": "2026-10-03T20:46:04-07:00",
        "attempts_listed": 15,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.4092958915834075,
       "timeouts_per_100_episodes_diff": 1.874059746400172,
       "first_timeouts_per_100_instances_diff": 1.7754098360655737,
       "over_8k_per_1000_calls_diff": 15.265092725319267,
       "cap_hits_per_1000_calls_diff": 4.115371561496111
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 525,
        "timeouts": 21,
        "timeouts_per_100_episodes": 4.0,
        "instances": 500,
        "first_timeouts": 15,
        "first_timeouts_per_100_instances": 3.0,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 39451,
        "completion_per_call": 1535.6877138729055,
        "over_8k": 1593,
        "over_8k_per_1000_calls": 40.37920458290031,
        "cap_hits": 317,
        "cap_hits_per_1000_calls": 8.035284276697675,
        "length_finish": 317,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T16:05:54-07:00",
        "t_last_iso": "2026-10-28T08:39:13-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 21,
        "episodes": 522,
        "timeouts": 24,
        "timeouts_per_100_episodes": 4.597701149425287,
        "instances": 500,
        "first_timeouts": 16,
        "first_timeouts_per_100_instances": 3.2,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 39143,
        "completion_per_call": 1347.9958868763254,
        "over_8k": 1248,
        "over_8k_per_1000_calls": 31.883095317170376,
        "cap_hits": 220,
        "cap_hits_per_1000_calls": 5.620417443731958,
        "length_finish": 220,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:47:16-07:00",
        "t_last_iso": "2026-10-03T22:19:50-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.1392376852362016,
       "timeouts_per_100_episodes_diff": -0.5977011494252871,
       "first_timeouts_per_100_instances_diff": -0.20000000000000018,
       "over_8k_per_1000_calls_diff": 8.496109265729931,
       "cap_hits_per_1000_calls_diff": 2.4148668329657177
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": [
       "loki_k25_d25_s1 s43 shard5of8 (126014_0)"
      ]
     }
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "ref": "tri_b4096_s1",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 69,
      "episodes": 1558,
      "timeouts": 95,
      "timeouts_per_100_episodes": 6.097560975609756,
      "instances": 1468,
      "first_timeouts": 64,
      "first_timeouts_per_100_instances": 4.359673024523161,
      "zero_other": 1,
      "counted_zero": 9,
      "counted_timeouts": 9,
      "calls": 117275,
      "completion_per_call": 1705.1919846514602,
      "over_8k": 6413,
      "over_8k_per_1000_calls": 54.68343636751226,
      "cap_hits": 2315,
      "cap_hits_per_1000_calls": 19.73992752078448,
      "length_finish": 2314,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T16:07:56-07:00",
      "t_last_iso": "2026-10-28T07:33:01-07:00",
      "attempts_listed": 70,
      "attempts_without_snapshot": 1,
      "units_first_attempt_without_snapshot": 1
     },
     "published": {
      "units": 24,
      "attempts": 60,
      "episodes": 1532,
      "timeouts": 59,
      "timeouts_per_100_episodes": 3.8511749347258486,
      "instances": 1477,
      "first_timeouts": 42,
      "first_timeouts_per_100_instances": 2.843601895734597,
      "zero_other": 0,
      "counted_zero": 5,
      "counted_timeouts": 5,
      "calls": 116473,
      "completion_per_call": 1386.2370334755694,
      "over_8k": 4409,
      "over_8k_per_1000_calls": 37.85426665407434,
      "cap_hits": 1616,
      "cap_hits_per_1000_calls": 13.874460175319602,
      "length_finish": 1616,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-03T13:29:57-07:00",
      "t_last_iso": "2026-10-03T22:54:13-07:00",
      "attempts_listed": 62,
      "attempts_without_snapshot": 2,
      "units_first_attempt_without_snapshot": 2
     },
     "completion_per_call_ratio": 1.2300868779823375,
     "timeouts_per_100_episodes_diff": 2.2463860408839076,
     "first_timeouts_per_100_instances_diff": 1.516071128788564,
     "over_8k_per_1000_calls_diff": 16.82916971343792,
     "cap_hits_per_1000_calls_diff": 5.865467345464879,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 26,
        "episodes": 542,
        "timeouts": 48,
        "timeouts_per_100_episodes": 8.85608856088561,
        "instances": 500,
        "first_timeouts": 30,
        "first_timeouts_per_100_instances": 6.0,
        "zero_other": 0,
        "counted_zero": 6,
        "counted_timeouts": 6,
        "calls": 41267,
        "completion_per_call": 1885.9604284294958,
        "over_8k": 2606,
        "over_8k_per_1000_calls": 63.149732231565174,
        "cap_hits": 968,
        "cap_hits_per_1000_calls": 23.456999539583688,
        "length_finish": 968,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:20:44-07:00",
        "t_last_iso": "2026-10-28T07:33:01-07:00",
        "attempts_listed": 26,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 23,
        "episodes": 512,
        "timeouts": 29,
        "timeouts_per_100_episodes": 5.6640625,
        "instances": 487,
        "first_timeouts": 17,
        "first_timeouts_per_100_instances": 3.490759753593429,
        "zero_other": 0,
        "counted_zero": 4,
        "counted_timeouts": 4,
        "calls": 38169,
        "completion_per_call": 1580.512641148576,
        "over_8k": 1779,
        "over_8k_per_1000_calls": 46.60850428358091,
        "cap_hits": 671,
        "cap_hits_per_1000_calls": 17.579711284026303,
        "length_finish": 671,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:29:57-07:00",
        "t_last_iso": "2026-10-03T22:51:27-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.1932586803348486,
       "timeouts_per_100_episodes_diff": 3.1920260608856097,
       "first_timeouts_per_100_instances_diff": 2.509240246406571,
       "over_8k_per_1000_calls_diff": 16.54122794798426,
       "cap_hits_per_1000_calls_diff": 5.877288255557385
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 21,
        "episodes": 516,
        "timeouts": 16,
        "timeouts_per_100_episodes": 3.10077519379845,
        "instances": 500,
        "first_timeouts": 11,
        "first_timeouts_per_100_instances": 2.2,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 38557,
        "completion_per_call": 1426.2886894727287,
        "over_8k": 1543,
        "over_8k_per_1000_calls": 40.01867365199575,
        "cap_hits": 547,
        "cap_hits_per_1000_calls": 14.186788391213009,
        "length_finish": 547,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:07:40-07:00",
        "t_last_iso": "2026-10-28T05:50:36-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 16,
        "episodes": 500,
        "timeouts": 10,
        "timeouts_per_100_episodes": 2.0,
        "instances": 490,
        "first_timeouts": 9,
        "first_timeouts_per_100_instances": 1.836734693877551,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 38696,
        "completion_per_call": 1087.6376886499897,
        "over_8k": 983,
        "over_8k_per_1000_calls": 25.403142443663427,
        "cap_hits": 317,
        "cap_hits_per_1000_calls": 8.192061194955551,
        "length_finish": 317,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T13:49:52-07:00",
        "t_last_iso": "2026-10-03T20:16:26-07:00",
        "attempts_listed": 17,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "completion_per_call_ratio": 1.3113637972982375,
       "timeouts_per_100_episodes_diff": 1.1007751937984498,
       "first_timeouts_per_100_instances_diff": 0.3632653061224491,
       "over_8k_per_1000_calls_diff": 14.615531208332321,
       "cap_hits_per_1000_calls_diff": 5.9947271962574575
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 22,
        "episodes": 500,
        "timeouts": 31,
        "timeouts_per_100_episodes": 6.2,
        "instances": 468,
        "first_timeouts": 23,
        "first_timeouts_per_100_instances": 4.914529914529915,
        "zero_other": 1,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 37451,
        "completion_per_call": 1793.1443219139676,
        "over_8k": 2264,
        "over_8k_per_1000_calls": 60.4523243705108,
        "cap_hits": 800,
        "cap_hits_per_1000_calls": 21.361245360604524,
        "length_finish": 799,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T16:07:56-07:00",
        "t_last_iso": "2026-10-28T06:53:58-07:00",
        "attempts_listed": 23,
        "attempts_without_snapshot": 1,
        "units_first_attempt_without_snapshot": 1
       },
       "published": {
        "units": 8,
        "attempts": 21,
        "episodes": 520,
        "timeouts": 20,
        "timeouts_per_100_episodes": 3.8461538461538463,
        "instances": 500,
        "first_timeouts": 16,
        "first_timeouts_per_100_instances": 3.2,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 39608,
        "completion_per_call": 1490.7435619066855,
        "over_8k": 1647,
        "over_8k_per_1000_calls": 41.58250858412442,
        "cap_hits": 628,
        "cap_hits_per_1000_calls": 15.855382750959402,
        "length_finish": 628,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-03T14:06:38-07:00",
        "t_last_iso": "2026-10-03T22:54:13-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.2028522998419033,
       "timeouts_per_100_episodes_diff": 2.353846153846154,
       "first_timeouts_per_100_instances_diff": 1.7145299145299147,
       "over_8k_per_1000_calls_diff": 18.869815786386383,
       "cap_hits_per_1000_calls_diff": 5.505862609645122
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [
       "tri_b4096_s1_sxs s44 shard7of8 (293724_0)"
      ],
      "published": [
       "tri_b4096_s1 s42 shard4of8 (126471_0)",
       "tri_b4096_s1 s43 shard4of8 (126475_0)"
      ]
     }
    },
    {
     "arm": "fp8kv_s1_sxs",
     "ref": "fp8kv_s1",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 66,
      "episodes": 1593,
      "timeouts": 90,
      "timeouts_per_100_episodes": 5.649717514124294,
      "instances": 1500,
      "first_timeouts": 63,
      "first_timeouts_per_100_instances": 4.2,
      "zero_other": 1,
      "counted_zero": 8,
      "counted_timeouts": 8,
      "calls": 120178,
      "completion_per_call": 1654.2703240193712,
      "over_8k": 5973,
      "over_8k_per_1000_calls": 49.701276439947414,
      "cap_hits": 1442,
      "cap_hits_per_1000_calls": 11.998868345287823,
      "length_finish": 1441,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T16:06:16-07:00",
      "t_last_iso": "2026-10-28T07:00:58-07:00",
      "attempts_listed": 66,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 55,
      "episodes": 1541,
      "timeouts": 39,
      "timeouts_per_100_episodes": 2.5308241401687215,
      "instances": 1500,
      "first_timeouts": 30,
      "first_timeouts_per_100_instances": 2.0,
      "zero_other": 0,
      "counted_zero": 3,
      "counted_timeouts": 3,
      "calls": 110428,
      "completion_per_call": 1364.1642699315391,
      "over_8k": 3731,
      "over_8k_per_1000_calls": 33.786720759227734,
      "cap_hits": 795,
      "cap_hits_per_1000_calls": 7.199261056978303,
      "length_finish": 795,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-22T07:17:21-07:00",
      "t_last_iso": "2026-10-22T19:10:20-07:00",
      "attempts_listed": 55,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.2126621115083092,
     "timeouts_per_100_episodes_diff": 3.1188933739555726,
     "first_timeouts_per_100_instances_diff": 2.2,
     "over_8k_per_1000_calls_diff": 15.91455568071968,
     "cap_hits_per_1000_calls_diff": 4.79960728830952,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 26,
        "episodes": 551,
        "timeouts": 44,
        "timeouts_per_100_episodes": 7.985480943738657,
        "instances": 500,
        "first_timeouts": 31,
        "first_timeouts_per_100_instances": 6.2,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 41768,
        "completion_per_call": 1869.2262258188086,
        "over_8k": 2569,
        "over_8k_per_1000_calls": 61.50641639532657,
        "cap_hits": 638,
        "cap_hits_per_1000_calls": 15.27485156100364,
        "length_finish": 637,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T07:55:12-07:00",
        "t_last_iso": "2026-10-28T06:58:37-07:00",
        "attempts_listed": 26,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 22,
        "episodes": 523,
        "timeouts": 23,
        "timeouts_per_100_episodes": 4.397705544933078,
        "instances": 500,
        "first_timeouts": 16,
        "first_timeouts_per_100_instances": 3.2,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 36744,
        "completion_per_call": 1582.548769867189,
        "over_8k": 1625,
        "over_8k_per_1000_calls": 44.22490746788591,
        "cap_hits": 342,
        "cap_hits_per_1000_calls": 9.30764206401045,
        "length_finish": 342,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T07:17:21-07:00",
        "t_last_iso": "2026-10-22T16:57:17-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.18114920779072,
       "timeouts_per_100_episodes_diff": 3.5877753988055785,
       "first_timeouts_per_100_instances_diff": 3.0,
       "over_8k_per_1000_calls_diff": 17.281508927440655,
       "cap_hits_per_1000_calls_diff": 5.96720949699319
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 19,
        "episodes": 510,
        "timeouts": 10,
        "timeouts_per_100_episodes": 1.9607843137254901,
        "instances": 500,
        "first_timeouts": 8,
        "first_timeouts_per_100_instances": 1.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37968,
        "completion_per_call": 1352.2614833544037,
        "over_8k": 1299,
        "over_8k_per_1000_calls": 34.213021491782555,
        "cap_hits": 295,
        "cap_hits_per_1000_calls": 7.769700800674252,
        "length_finish": 295,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:03:27-07:00",
        "t_last_iso": "2026-10-28T06:17:05-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 14,
        "episodes": 506,
        "timeouts": 6,
        "timeouts_per_100_episodes": 1.1857707509881423,
        "instances": 500,
        "first_timeouts": 6,
        "first_timeouts_per_100_instances": 1.2,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37072,
        "completion_per_call": 1038.5438605955978,
        "over_8k": 676,
        "over_8k_per_1000_calls": 18.23478636167458,
        "cap_hits": 141,
        "cap_hits_per_1000_calls": 3.8034095813552007,
        "length_finish": 141,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T08:53:35-07:00",
        "t_last_iso": "2026-10-22T14:30:50-07:00",
        "attempts_listed": 14,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.3020745051430866,
       "timeouts_per_100_episodes_diff": 0.7750135627373478,
       "first_timeouts_per_100_instances_diff": 0.40000000000000013,
       "over_8k_per_1000_calls_diff": 15.978235130107976,
       "cap_hits_per_1000_calls_diff": 3.966291219319051
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 21,
        "episodes": 532,
        "timeouts": 36,
        "timeouts_per_100_episodes": 6.7669172932330826,
        "instances": 500,
        "first_timeouts": 24,
        "first_timeouts_per_100_instances": 4.8,
        "zero_other": 1,
        "counted_zero": 5,
        "counted_timeouts": 5,
        "calls": 40442,
        "completion_per_call": 1715.8002571583997,
        "over_8k": 2105,
        "over_8k_per_1000_calls": 52.04984916670788,
        "cap_hits": 509,
        "cap_hits_per_1000_calls": 12.585925522971168,
        "length_finish": 509,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T16:06:16-07:00",
        "t_last_iso": "2026-10-28T07:00:58-07:00",
        "attempts_listed": 21,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 19,
        "episodes": 512,
        "timeouts": 10,
        "timeouts_per_100_episodes": 1.953125,
        "instances": 500,
        "first_timeouts": 8,
        "first_timeouts_per_100_instances": 1.6,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 36612,
        "completion_per_call": 1474.703976838195,
        "over_8k": 1430,
        "over_8k_per_1000_calls": 39.058232273571505,
        "cap_hits": 312,
        "cap_hits_per_1000_calls": 8.521796132415602,
        "length_finish": 312,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T08:53:39-07:00",
        "t_last_iso": "2026-10-22T19:10:20-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.1634879162915948,
       "timeouts_per_100_episodes_diff": 4.8137922932330826,
       "first_timeouts_per_100_instances_diff": 3.1999999999999997,
       "over_8k_per_1000_calls_diff": 12.991616893136374,
       "cap_hits_per_1000_calls_diff": 4.064129390555566
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": []
     }
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "ref": "blasst_t50_s1",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 67,
      "episodes": 1583,
      "timeouts": 75,
      "timeouts_per_100_episodes": 4.737839545167404,
      "instances": 1500,
      "first_timeouts": 52,
      "first_timeouts_per_100_instances": 3.466666666666667,
      "zero_other": 9,
      "counted_zero": 7,
      "counted_timeouts": 7,
      "calls": 119325,
      "completion_per_call": 1602.1100020951183,
      "over_8k": 5472,
      "over_8k_per_1000_calls": 45.85795097423004,
      "cap_hits": 1348,
      "cap_hits_per_1000_calls": 11.29687827362246,
      "length_finish": 1348,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-25T15:54:47-07:00",
      "t_last_iso": "2026-10-28T07:41:37-07:00",
      "attempts_listed": 67,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 62,
      "episodes": 1571,
      "timeouts": 62,
      "timeouts_per_100_episodes": 3.9465308720560155,
      "instances": 1500,
      "first_timeouts": 46,
      "first_timeouts_per_100_instances": 3.066666666666667,
      "zero_other": 3,
      "counted_zero": 4,
      "counted_timeouts": 4,
      "calls": 113660,
      "completion_per_call": 1425.2803800809431,
      "over_8k": 4239,
      "over_8k_per_1000_calls": 37.295442547950024,
      "cap_hits": 936,
      "cap_hits_per_1000_calls": 8.235087101882808,
      "length_finish": 936,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-22T07:19:05-07:00",
      "t_last_iso": "2026-10-22T17:06:22-07:00",
      "attempts_listed": 62,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.1240665517363908,
     "timeouts_per_100_episodes_diff": 0.7913086731113883,
     "first_timeouts_per_100_instances_diff": 0.3999999999999999,
     "over_8k_per_1000_calls_diff": 8.562508426280019,
     "cap_hits_per_1000_calls_diff": 3.0617911717396513,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 545,
        "timeouts": 39,
        "timeouts_per_100_episodes": 7.155963302752293,
        "instances": 500,
        "first_timeouts": 27,
        "first_timeouts_per_100_instances": 5.4,
        "zero_other": 8,
        "counted_zero": 4,
        "counted_timeouts": 4,
        "calls": 41040,
        "completion_per_call": 1765.5846003898635,
        "over_8k": 2223,
        "over_8k_per_1000_calls": 54.166666666666664,
        "cap_hits": 506,
        "cap_hits_per_1000_calls": 12.329434697855751,
        "length_finish": 506,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:22:15-07:00",
        "t_last_iso": "2026-10-28T06:02:39-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 22,
        "episodes": 532,
        "timeouts": 26,
        "timeouts_per_100_episodes": 4.887218045112782,
        "instances": 500,
        "first_timeouts": 19,
        "first_timeouts_per_100_instances": 3.8,
        "zero_other": 3,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 37795,
        "completion_per_call": 1629.013837809234,
        "over_8k": 1755,
        "over_8k_per_1000_calls": 46.434713586453235,
        "cap_hits": 396,
        "cap_hits_per_1000_calls": 10.477576398994575,
        "length_finish": 396,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T07:19:05-07:00",
        "t_last_iso": "2026-10-22T16:31:39-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.0838364656031994,
       "timeouts_per_100_episodes_diff": 2.2687452576395115,
       "first_timeouts_per_100_instances_diff": 1.6000000000000005,
       "over_8k_per_1000_calls_diff": 7.7319530802134295,
       "cap_hits_per_1000_calls_diff": 1.8518582988611758
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 19,
        "episodes": 512,
        "timeouts": 13,
        "timeouts_per_100_episodes": 2.5390625,
        "instances": 500,
        "first_timeouts": 9,
        "first_timeouts_per_100_instances": 1.8,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 38433,
        "completion_per_call": 1354.250279707543,
        "over_8k": 1311,
        "over_8k_per_1000_calls": 34.1113105924596,
        "cap_hits": 349,
        "cap_hits_per_1000_calls": 9.080737907527386,
        "length_finish": 349,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:07:59-07:00",
        "t_last_iso": "2026-10-28T07:41:37-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 18,
        "episodes": 512,
        "timeouts": 10,
        "timeouts_per_100_episodes": 1.953125,
        "instances": 500,
        "first_timeouts": 9,
        "first_timeouts_per_100_instances": 1.8,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 37403,
        "completion_per_call": 1112.6135604095928,
        "over_8k": 874,
        "over_8k_per_1000_calls": 23.36710959013983,
        "cap_hits": 192,
        "cap_hits_per_1000_calls": 5.133278079298452,
        "length_finish": 192,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T07:50:31-07:00",
        "t_last_iso": "2026-10-22T14:54:54-07:00",
        "attempts_listed": 18,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.2171793764665202,
       "timeouts_per_100_episodes_diff": 0.5859375,
       "first_timeouts_per_100_instances_diff": 0.0,
       "over_8k_per_1000_calls_diff": 10.744201002319773,
       "cap_hits_per_1000_calls_diff": 3.9474598282289337
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 526,
        "timeouts": 23,
        "timeouts_per_100_episodes": 4.3726235741444865,
        "instances": 500,
        "first_timeouts": 16,
        "first_timeouts_per_100_instances": 3.2,
        "zero_other": 1,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 39852,
        "completion_per_call": 1672.7964217605138,
        "over_8k": 1938,
        "over_8k_per_1000_calls": 48.629930743751885,
        "cap_hits": 493,
        "cap_hits_per_1000_calls": 12.370771855866707,
        "length_finish": 493,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T15:54:47-07:00",
        "t_last_iso": "2026-10-28T06:56:39-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 22,
        "episodes": 527,
        "timeouts": 26,
        "timeouts_per_100_episodes": 4.933586337760911,
        "instances": 500,
        "first_timeouts": 18,
        "first_timeouts_per_100_instances": 3.6,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 38462,
        "completion_per_call": 1529.1379803442358,
        "over_8k": 1610,
        "over_8k_per_1000_calls": 41.859497686027765,
        "cap_hits": 348,
        "cap_hits_per_1000_calls": 9.047891425302897,
        "length_finish": 348,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T07:50:34-07:00",
        "t_last_iso": "2026-10-22T17:06:22-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.0939473371683162,
       "timeouts_per_100_episodes_diff": -0.5609627636164243,
       "first_timeouts_per_100_instances_diff": -0.3999999999999999,
       "over_8k_per_1000_calls_diff": 6.770433057724119,
       "cap_hits_per_1000_calls_diff": 3.32288043056381
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": []
     }
    },
    {
     "arm": "dense_sxs",
     "ref": "dense_s1d",
     "units_compared": 24,
     "units_rerun": 24,
     "rerun": {
      "units": 24,
      "attempts": 70,
      "episodes": 1581,
      "timeouts": 82,
      "timeouts_per_100_episodes": 5.186590765338393,
      "instances": 1500,
      "first_timeouts": 58,
      "first_timeouts_per_100_instances": 3.8666666666666667,
      "zero_other": 0,
      "counted_zero": 4,
      "counted_timeouts": 4,
      "calls": 119511,
      "completion_per_call": 1616.4754792445883,
      "over_8k": 5559,
      "over_8k_per_1000_calls": 46.514546778120845,
      "cap_hits": 1372,
      "cap_hits_per_1000_calls": 11.480114801148012,
      "length_finish": 1372,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-24T10:19:16-07:00",
      "t_last_iso": "2026-10-28T09:21:44-07:00",
      "attempts_listed": 70,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "published": {
      "units": 24,
      "attempts": 61,
      "episodes": 1553,
      "timeouts": 49,
      "timeouts_per_100_episodes": 3.1551835157759176,
      "instances": 1500,
      "first_timeouts": 32,
      "first_timeouts_per_100_instances": 2.1333333333333333,
      "zero_other": 1,
      "counted_zero": 6,
      "counted_timeouts": 6,
      "calls": 112111,
      "completion_per_call": 1378.556591235472,
      "over_8k": 3963,
      "over_8k_per_1000_calls": 35.34889529127383,
      "cap_hits": 960,
      "cap_hits_per_1000_calls": 8.562942084184424,
      "length_finish": 959,
      "non200": 0,
      "excluded_episodes": 0,
      "excluded_calls": 0,
      "t_first_iso": "2026-10-22T07:51:26-07:00",
      "t_last_iso": "2026-10-22T16:57:16-07:00",
      "attempts_listed": 61,
      "attempts_without_snapshot": 0,
      "units_first_attempt_without_snapshot": 0
     },
     "completion_per_call_ratio": 1.172585506842263,
     "timeouts_per_100_episodes_diff": 2.0314072495624758,
     "first_timeouts_per_100_instances_diff": 1.7333333333333334,
     "over_8k_per_1000_calls_diff": 11.165651486847018,
     "cap_hits_per_1000_calls_diff": 2.917172716963588,
     "seeds": {
      "42": {
       "rerun": {
        "units": 8,
        "attempts": 27,
        "episodes": 544,
        "timeouts": 46,
        "timeouts_per_100_episodes": 8.455882352941176,
        "instances": 500,
        "first_timeouts": 33,
        "first_timeouts_per_100_instances": 6.6,
        "zero_other": 0,
        "counted_zero": 3,
        "counted_timeouts": 3,
        "calls": 41632,
        "completion_per_call": 1825.4623606840892,
        "over_8k": 2353,
        "over_8k_per_1000_calls": 56.51902382782475,
        "cap_hits": 596,
        "cap_hits_per_1000_calls": 14.315910837817064,
        "length_finish": 596,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-26T08:20:39-07:00",
        "t_last_iso": "2026-10-28T06:34:16-07:00",
        "attempts_listed": 27,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 24,
        "episodes": 519,
        "timeouts": 22,
        "timeouts_per_100_episodes": 4.238921001926783,
        "instances": 500,
        "first_timeouts": 13,
        "first_timeouts_per_100_instances": 2.6,
        "zero_other": 0,
        "counted_zero": 4,
        "counted_timeouts": 4,
        "calls": 37139,
        "completion_per_call": 1548.3308382024288,
        "over_8k": 1567,
        "over_8k_per_1000_calls": 42.192843102937616,
        "cap_hits": 390,
        "cap_hits_per_1000_calls": 10.501090497859392,
        "length_finish": 390,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T07:51:26-07:00",
        "t_last_iso": "2026-10-22T16:42:58-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.1789872781991495,
       "timeouts_per_100_episodes_diff": 4.216961351014393,
       "first_timeouts_per_100_instances_diff": 3.9999999999999996,
       "over_8k_per_1000_calls_diff": 14.326180724887138,
       "cap_hits_per_1000_calls_diff": 3.814820339957672
      },
      "43": {
       "rerun": {
        "units": 8,
        "attempts": 19,
        "episodes": 513,
        "timeouts": 12,
        "timeouts_per_100_episodes": 2.3391812865497075,
        "instances": 500,
        "first_timeouts": 8,
        "first_timeouts_per_100_instances": 1.6,
        "zero_other": 0,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 38131,
        "completion_per_call": 1382.6528284073327,
        "over_8k": 1321,
        "over_8k_per_1000_calls": 34.643728200152104,
        "cap_hits": 348,
        "cap_hits_per_1000_calls": 9.126432561432955,
        "length_finish": 348,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-25T21:07:33-07:00",
        "t_last_iso": "2026-10-28T09:21:44-07:00",
        "attempts_listed": 19,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 15,
        "episodes": 508,
        "timeouts": 5,
        "timeouts_per_100_episodes": 0.984251968503937,
        "instances": 500,
        "first_timeouts": 5,
        "first_timeouts_per_100_instances": 1.0,
        "zero_other": 1,
        "counted_zero": 0,
        "counted_timeouts": 0,
        "calls": 36939,
        "completion_per_call": 1077.5509894691247,
        "over_8k": 782,
        "over_8k_per_1000_calls": 21.170037088172393,
        "cap_hits": 153,
        "cap_hits_per_1000_calls": 4.141963778120686,
        "length_finish": 153,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T07:53:38-07:00",
        "t_last_iso": "2026-10-22T14:48:07-07:00",
        "attempts_listed": 15,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.283143760174655,
       "timeouts_per_100_episodes_diff": 1.3549293180457704,
       "first_timeouts_per_100_instances_diff": 0.6000000000000001,
       "over_8k_per_1000_calls_diff": 13.473691111979711,
       "cap_hits_per_1000_calls_diff": 4.984468783312269
      },
      "44": {
       "rerun": {
        "units": 8,
        "attempts": 24,
        "episodes": 524,
        "timeouts": 24,
        "timeouts_per_100_episodes": 4.580152671755725,
        "instances": 500,
        "first_timeouts": 17,
        "first_timeouts_per_100_instances": 3.4,
        "zero_other": 0,
        "counted_zero": 1,
        "counted_timeouts": 1,
        "calls": 39748,
        "completion_per_call": 1621.8933531246855,
        "over_8k": 1885,
        "over_8k_per_1000_calls": 47.42376974942135,
        "cap_hits": 428,
        "cap_hits_per_1000_calls": 10.767837375465433,
        "length_finish": 428,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-24T10:19:16-07:00",
        "t_last_iso": "2026-10-28T07:20:40-07:00",
        "attempts_listed": 24,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "published": {
        "units": 8,
        "attempts": 22,
        "episodes": 526,
        "timeouts": 22,
        "timeouts_per_100_episodes": 4.182509505703422,
        "instances": 500,
        "first_timeouts": 14,
        "first_timeouts_per_100_instances": 2.8,
        "zero_other": 0,
        "counted_zero": 2,
        "counted_timeouts": 2,
        "calls": 38033,
        "completion_per_call": 1505.1203691531039,
        "over_8k": 1614,
        "over_8k_per_1000_calls": 42.43683117292877,
        "cap_hits": 417,
        "cap_hits_per_1000_calls": 10.964162700812452,
        "length_finish": 416,
        "non200": 0,
        "excluded_episodes": 0,
        "excluded_calls": 0,
        "t_first_iso": "2026-10-22T08:02:08-07:00",
        "t_last_iso": "2026-10-22T16:57:16-07:00",
        "attempts_listed": 22,
        "attempts_without_snapshot": 0,
        "units_first_attempt_without_snapshot": 0
       },
       "completion_per_call_ratio": 1.0775838174572623,
       "timeouts_per_100_episodes_diff": 0.397643166052303,
       "first_timeouts_per_100_instances_diff": 0.6000000000000001,
       "over_8k_per_1000_calls_diff": 4.986938576492584,
       "cap_hits_per_1000_calls_diff": -0.19632532534701852
      }
     },
     "first_attempt_without_snapshot": {
      "rerun": [],
      "published": []
     }
    }
   ],
   "arms": {
    "dense_sxs": {
     "units": 24,
     "attempts": 70,
     "episodes": 1581,
     "timeouts": 82,
     "zero_other": 0,
     "instances": 1500,
     "first_timeouts": 58,
     "counted_zero": 4,
     "counted_timeouts": 4,
     "calls": 119511,
     "completion_sum": 193186601,
     "over_8k": 5559,
     "cap_hits": 1372,
     "length_finish": 1372,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 70,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792862356.851,
     "t_last": 1793204504.124,
     "timeouts_per_100_episodes": 5.186590765338393,
     "first_timeouts_per_100_instances": 3.8666666666666667,
     "completion_per_call": 1616.4754792445883,
     "over_8k_per_1000_calls": 46.514546778120845,
     "cap_hits_per_1000_calls": 11.480114801148012,
     "t_first_iso": "2026-10-24T10:19:16-07:00",
     "t_last_iso": "2026-10-28T09:21:44-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 27,
       "episodes": 544,
       "timeouts": 46,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 33,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 41632,
       "completion_sum": 75997649,
       "over_8k": 2353,
       "cap_hits": 596,
       "length_finish": 596,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 27,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028039.34,
       "t_last": 1793194456.586,
       "timeouts_per_100_episodes": 8.455882352941176,
       "first_timeouts_per_100_instances": 6.6,
       "completion_per_call": 1825.4623606840892,
       "over_8k_per_1000_calls": 56.51902382782475,
       "cap_hits_per_1000_calls": 14.315910837817064,
       "t_first_iso": "2026-10-26T08:20:39-07:00",
       "t_last_iso": "2026-10-28T06:34:16-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 19,
       "episodes": 513,
       "timeouts": 12,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 8,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 38131,
       "completion_sum": 52721935,
       "over_8k": 1321,
       "cap_hits": 348,
       "length_finish": 348,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987653.625,
       "t_last": 1793204504.124,
       "timeouts_per_100_episodes": 2.3391812865497075,
       "first_timeouts_per_100_instances": 1.6,
       "completion_per_call": 1382.6528284073327,
       "over_8k_per_1000_calls": 34.643728200152104,
       "cap_hits_per_1000_calls": 9.126432561432955,
       "t_first_iso": "2026-10-25T21:07:33-07:00",
       "t_last_iso": "2026-10-28T09:21:44-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 24,
       "episodes": 524,
       "timeouts": 24,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 17,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 39748,
       "completion_sum": 64467017,
       "over_8k": 1885,
       "cap_hits": 428,
       "length_finish": 428,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792862356.851,
       "t_last": 1793197240.563,
       "timeouts_per_100_episodes": 4.580152671755725,
       "first_timeouts_per_100_instances": 3.4,
       "completion_per_call": 1621.8933531246855,
       "over_8k_per_1000_calls": 47.42376974942135,
       "cap_hits_per_1000_calls": 10.767837375465433,
       "t_first_iso": "2026-10-24T10:19:16-07:00",
       "t_last_iso": "2026-10-28T07:20:40-07:00"
      }
     }
    },
    "dense_s1": {
     "units": 24,
     "attempts": 48,
     "episodes": 1532,
     "timeouts": 34,
     "zero_other": 0,
     "instances": 1500,
     "first_timeouts": 24,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 113004,
     "completion_sum": 132283394,
     "over_8k": 2912,
     "cap_hits": 566,
     "length_finish": 566,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 48,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1790901085.968,
     "t_last": 1790932836.404,
     "timeouts_per_100_episodes": 2.2193211488250655,
     "first_timeouts_per_100_instances": 1.6,
     "completion_per_call": 1170.6080669710807,
     "over_8k_per_1000_calls": 25.768999327457436,
     "cap_hits_per_1000_calls": 5.008672259389048,
     "t_first_iso": "2026-10-01T17:31:25-07:00",
     "t_last_iso": "2026-10-02T02:20:36-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 19,
       "episodes": 513,
       "timeouts": 13,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 9,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37198,
       "completion_sum": 49630668,
       "over_8k": 1208,
       "cap_hits": 268,
       "length_finish": 268,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790901092.126,
       "t_last": 1790932836.404,
       "timeouts_per_100_episodes": 2.53411306042885,
       "first_timeouts_per_100_instances": 1.8,
       "completion_per_call": 1334.229474702941,
       "over_8k_per_1000_calls": 32.474864240012906,
       "cap_hits_per_1000_calls": 7.204688424108823,
       "t_first_iso": "2026-10-01T17:31:32-07:00",
       "t_last_iso": "2026-10-02T02:20:36-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 10,
       "episodes": 502,
       "timeouts": 2,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 2,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37431,
       "completion_sum": 31594238,
       "over_8k": 495,
       "cap_hits": 72,
       "length_finish": 72,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 10,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790901098.982,
       "t_last": 1790917874.129,
       "timeouts_per_100_episodes": 0.398406374501992,
       "first_timeouts_per_100_instances": 0.4,
       "completion_per_call": 844.0660949480377,
       "over_8k_per_1000_calls": 13.224332772301034,
       "cap_hits_per_1000_calls": 1.9235393123346958,
       "t_first_iso": "2026-10-01T17:31:38-07:00",
       "t_last_iso": "2026-10-01T22:11:14-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 19,
       "episodes": 517,
       "timeouts": 19,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 13,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 38375,
       "completion_sum": 51058488,
       "over_8k": 1209,
       "cap_hits": 226,
       "length_finish": 226,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790901085.968,
       "t_last": 1790932365.598,
       "timeouts_per_100_episodes": 3.6750483558994196,
       "first_timeouts_per_100_instances": 2.6,
       "completion_per_call": 1330.514345276873,
       "over_8k_per_1000_calls": 31.504885993485342,
       "cap_hits_per_1000_calls": 5.8892508143322475,
       "t_first_iso": "2026-10-01T17:31:25-07:00",
       "t_last_iso": "2026-10-02T02:12:45-07:00"
      }
     }
    },
    "jqs_f_dense_sxs": {
     "units": 24,
     "attempts": 67,
     "episodes": 1557,
     "timeouts": 73,
     "zero_other": 2,
     "instances": 1483,
     "first_timeouts": 52,
     "counted_zero": 4,
     "counted_timeouts": 4,
     "calls": 119282,
     "completion_sum": 195381292,
     "over_8k": 5706,
     "cap_hits": 1368,
     "length_finish": 1368,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 68,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1792931451.015,
     "t_last": 1793197917.903,
     "timeouts_per_100_episodes": 4.688503532434169,
     "first_timeouts_per_100_instances": 3.5064059339177343,
     "completion_per_call": 1637.978001710233,
     "over_8k_per_1000_calls": 47.836220049965625,
     "cap_hits_per_1000_calls": 11.468620579802485,
     "t_first_iso": "2026-10-25T05:30:51-07:00",
     "t_last_iso": "2026-10-28T07:31:57-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 527,
       "timeouts": 28,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 20,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 39630,
       "completion_sum": 71073041,
       "over_8k": 2180,
       "cap_hits": 524,
       "length_finish": 524,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793027540.031,
       "t_last": 1793197917.903,
       "timeouts_per_100_episodes": 5.313092979127135,
       "first_timeouts_per_100_instances": 4.0,
       "completion_per_call": 1793.415114812011,
       "over_8k_per_1000_calls": 55.008831693161746,
       "cap_hits_per_1000_calls": 13.222306333585667,
       "t_first_iso": "2026-10-26T08:12:20-07:00",
       "t_last_iso": "2026-10-28T07:31:57-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 20,
       "episodes": 517,
       "timeouts": 16,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 13,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 40112,
       "completion_sum": 56468578,
       "over_8k": 1437,
       "cap_hits": 367,
       "length_finish": 367,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 20,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987508.763,
       "t_last": 1793188745.338,
       "timeouts_per_100_episodes": 3.094777562862669,
       "first_timeouts_per_100_instances": 2.6,
       "completion_per_call": 1407.772686477862,
       "over_8k_per_1000_calls": 35.824690865576386,
       "cap_hits_per_1000_calls": 9.149381731152772,
       "t_first_iso": "2026-10-25T21:05:08-07:00",
       "t_last_iso": "2026-10-28T04:59:05-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 23,
       "episodes": 513,
       "timeouts": 29,
       "zero_other": 1,
       "instances": 483,
       "first_timeouts": 19,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 39540,
       "completion_sum": 67839673,
       "over_8k": 2089,
       "cap_hits": 477,
       "length_finish": 477,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1792931451.015,
       "t_last": 1793197085.341,
       "timeouts_per_100_episodes": 5.653021442495127,
       "first_timeouts_per_100_instances": 3.9337474120082816,
       "completion_per_call": 1715.7226353060191,
       "over_8k_per_1000_calls": 52.83257460799191,
       "cap_hits_per_1000_calls": 12.063732928679817,
       "t_first_iso": "2026-10-25T05:30:51-07:00",
       "t_last_iso": "2026-10-28T07:18:05-07:00"
      }
     }
    },
    "jqs_f_dense": {
     "units": 24,
     "attempts": 56,
     "episodes": 1550,
     "timeouts": 55,
     "zero_other": 0,
     "instances": 1500,
     "first_timeouts": 35,
     "counted_zero": 6,
     "counted_timeouts": 6,
     "calls": 119018,
     "completion_sum": 149483983,
     "over_8k": 3606,
     "cap_hits": 781,
     "length_finish": 781,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 56,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1790943321.911,
     "t_last": 1790980980.838,
     "timeouts_per_100_episodes": 3.5483870967741935,
     "first_timeouts_per_100_instances": 2.3333333333333335,
     "completion_per_call": 1255.9779445125948,
     "over_8k_per_1000_calls": 30.297938127006,
     "cap_hits_per_1000_calls": 6.562032633719269,
     "t_first_iso": "2026-10-02T05:15:21-07:00",
     "t_last_iso": "2026-10-02T15:43:00-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 20,
       "episodes": 516,
       "timeouts": 19,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 10,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 38305,
       "completion_sum": 54020057,
       "over_8k": 1385,
       "cap_hits": 322,
       "length_finish": 322,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 20,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790943337.825,
       "t_last": 1790980980.838,
       "timeouts_per_100_episodes": 3.682170542635659,
       "first_timeouts_per_100_instances": 2.0,
       "completion_per_call": 1410.2612452682417,
       "over_8k_per_1000_calls": 36.15715963973371,
       "cap_hits_per_1000_calls": 8.406213288082496,
       "t_first_iso": "2026-10-02T05:15:37-07:00",
       "t_last_iso": "2026-10-02T15:43:00-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 14,
       "episodes": 507,
       "timeouts": 8,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 6,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 39663,
       "completion_sum": 36289135,
       "over_8k": 651,
       "cap_hits": 121,
       "length_finish": 121,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 14,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790943321.911,
       "t_last": 1790974323.593,
       "timeouts_per_100_episodes": 1.5779092702169626,
       "first_timeouts_per_100_instances": 1.2,
       "completion_per_call": 914.9367168393717,
       "over_8k_per_1000_calls": 16.413281900007565,
       "cap_hits_per_1000_calls": 3.0507021657464137,
       "t_first_iso": "2026-10-02T05:15:21-07:00",
       "t_last_iso": "2026-10-02T13:52:03-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 22,
       "episodes": 527,
       "timeouts": 28,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 19,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 41050,
       "completion_sum": 59174791,
       "over_8k": 1570,
       "cap_hits": 338,
       "length_finish": 338,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790943344.436,
       "t_last": 1790974262.758,
       "timeouts_per_100_episodes": 5.313092979127135,
       "first_timeouts_per_100_instances": 3.8,
       "completion_per_call": 1441.529622411693,
       "over_8k_per_1000_calls": 38.24604141291108,
       "cap_hits_per_1000_calls": 8.23386114494519,
       "t_first_iso": "2026-10-02T05:15:44-07:00",
       "t_last_iso": "2026-10-02T13:51:02-07:00"
      }
     }
    },
    "jqs_f_r40_sxs": {
     "units": 24,
     "attempts": 64,
     "episodes": 1557,
     "timeouts": 60,
     "zero_other": 2,
     "instances": 1500,
     "first_timeouts": 42,
     "counted_zero": 6,
     "counted_timeouts": 6,
     "calls": 115703,
     "completion_sum": 152931430,
     "over_8k": 3492,
     "cap_hits": 915,
     "length_finish": 915,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 64,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792968276.451,
     "t_last": 1793194306.631,
     "timeouts_per_100_episodes": 3.8535645472061657,
     "first_timeouts_per_100_instances": 2.8,
     "completion_per_call": 1321.7585542293632,
     "over_8k_per_1000_calls": 30.18072132961116,
     "cap_hits_per_1000_calls": 7.908178698910141,
     "t_first_iso": "2026-10-25T15:44:36-07:00",
     "t_last_iso": "2026-10-28T06:31:46-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 525,
       "timeouts": 28,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 19,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 39333,
       "completion_sum": 57427795,
       "over_8k": 1406,
       "cap_hits": 393,
       "length_finish": 393,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028064.466,
       "t_last": 1793192735.313,
       "timeouts_per_100_episodes": 5.333333333333333,
       "first_timeouts_per_100_instances": 3.8,
       "completion_per_call": 1460.0410596699971,
       "over_8k_per_1000_calls": 35.74606564462411,
       "cap_hits_per_1000_calls": 9.991610098390664,
       "t_first_iso": "2026-10-26T08:21:04-07:00",
       "t_last_iso": "2026-10-28T06:05:35-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 19,
       "episodes": 514,
       "timeouts": 13,
       "zero_other": 2,
       "instances": 500,
       "first_timeouts": 10,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 38164,
       "completion_sum": 43801258,
       "over_8k": 831,
       "cap_hits": 230,
       "length_finish": 230,
       "non200": 1,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987651.795,
       "t_last": 1793192658.997,
       "timeouts_per_100_episodes": 2.529182879377432,
       "first_timeouts_per_100_instances": 2.0,
       "completion_per_call": 1147.7114034168326,
       "over_8k_per_1000_calls": 21.774447122943087,
       "cap_hits_per_1000_calls": 6.02662194738497,
       "t_first_iso": "2026-10-25T21:07:31-07:00",
       "t_last_iso": "2026-10-28T06:04:18-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 21,
       "episodes": 518,
       "timeouts": 19,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 13,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 38206,
       "completion_sum": 51702377,
       "over_8k": 1255,
       "cap_hits": 292,
       "length_finish": 292,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792968276.451,
       "t_last": 1793194306.631,
       "timeouts_per_100_episodes": 3.667953667953668,
       "first_timeouts_per_100_instances": 2.6,
       "completion_per_call": 1353.2528136941842,
       "over_8k_per_1000_calls": 32.8482437313511,
       "cap_hits_per_1000_calls": 7.64277862115898,
       "t_first_iso": "2026-10-25T15:44:36-07:00",
       "t_last_iso": "2026-10-28T06:31:46-07:00"
      }
     }
    },
    "jqs_f_r40": {
     "units": 24,
     "attempts": 37,
     "episodes": 1503,
     "timeouts": 16,
     "zero_other": 0,
     "instances": 1488,
     "first_timeouts": 12,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 106315,
     "completion_sum": 100501316,
     "over_8k": 1640,
     "cap_hits": 371,
     "length_finish": 371,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 39,
     "attempts_without_snapshot": 2,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1790943321.16,
     "t_last": 1790974941.008,
     "timeouts_per_100_episodes": 1.0645375914836992,
     "first_timeouts_per_100_instances": 0.8064516129032258,
     "completion_per_call": 945.3164275972347,
     "over_8k_per_1000_calls": 15.425857122701407,
     "cap_hits_per_1000_calls": 3.4896298734891595,
     "t_first_iso": "2026-10-02T05:15:21-07:00",
     "t_last_iso": "2026-10-02T14:02:21-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 14,
       "episodes": 506,
       "timeouts": 7,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 5,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 35050,
       "completion_sum": 37367369,
       "over_8k": 680,
       "cap_hits": 149,
       "length_finish": 149,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 14,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790943321.16,
       "t_last": 1790974941.008,
       "timeouts_per_100_episodes": 1.383399209486166,
       "first_timeouts_per_100_instances": 1.0,
       "completion_per_call": 1066.1160912981454,
       "over_8k_per_1000_calls": 19.40085592011412,
       "cap_hits_per_1000_calls": 4.251069900142653,
       "t_first_iso": "2026-10-02T05:15:21-07:00",
       "t_last_iso": "2026-10-02T14:02:21-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 9,
       "episodes": 501,
       "timeouts": 1,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 1,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35613,
       "completion_sum": 25384779,
       "over_8k": 291,
       "cap_hits": 74,
       "length_finish": 74,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 9,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790943939.766,
       "t_last": 1790963442.868,
       "timeouts_per_100_episodes": 0.1996007984031936,
       "first_timeouts_per_100_instances": 0.2,
       "completion_per_call": 712.795299469295,
       "over_8k_per_1000_calls": 8.171173447898239,
       "cap_hits_per_1000_calls": 2.077892904276528,
       "t_first_iso": "2026-10-02T05:25:39-07:00",
       "t_last_iso": "2026-10-02T10:50:42-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 14,
       "episodes": 496,
       "timeouts": 8,
       "zero_other": 0,
       "instances": 488,
       "first_timeouts": 6,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 35652,
       "completion_sum": 37749168,
       "over_8k": 669,
       "cap_hits": 148,
       "length_finish": 148,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 16,
       "attempts_without_snapshot": 2,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1790943946.6,
       "t_last": 1790970487.572,
       "timeouts_per_100_episodes": 1.6129032258064515,
       "first_timeouts_per_100_instances": 1.2295081967213115,
       "completion_per_call": 1058.8232918209358,
       "over_8k_per_1000_calls": 18.76472568158869,
       "cap_hits_per_1000_calls": 4.151239762145181,
       "t_first_iso": "2026-10-02T05:25:46-07:00",
       "t_last_iso": "2026-10-02T12:48:07-07:00"
      }
     }
    },
    "jqs_f_r60_sxs": {
     "units": 24,
     "attempts": 52,
     "episodes": 1530,
     "timeouts": 31,
     "zero_other": 1,
     "instances": 1500,
     "first_timeouts": 22,
     "counted_zero": 3,
     "counted_timeouts": 3,
     "calls": 109484,
     "completion_sum": 138052630,
     "over_8k": 2871,
     "cap_hits": 642,
     "length_finish": 642,
     "non200": 1,
     "excluded_episodes": 1,
     "excluded_calls": 87,
     "bad_lines": 0,
     "attempts_listed": 52,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792969123.865,
     "t_last": 1793195589.04,
     "timeouts_per_100_episodes": 2.026143790849673,
     "first_timeouts_per_100_instances": 1.4666666666666666,
     "completion_per_call": 1260.9388586460122,
     "over_8k_per_1000_calls": 26.223009754850025,
     "cap_hits_per_1000_calls": 5.863870519893318,
     "t_first_iso": "2026-10-25T15:58:43-07:00",
     "t_last_iso": "2026-10-28T06:53:09-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 23,
       "episodes": 517,
       "timeouts": 17,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 12,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 36785,
       "completion_sum": 52860603,
       "over_8k": 1310,
       "cap_hits": 310,
       "length_finish": 310,
       "non200": 1,
       "excluded_episodes": 1,
       "excluded_calls": 87,
       "bad_lines": 0,
       "attempts_listed": 23,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028306.508,
       "t_last": 1793195589.04,
       "timeouts_per_100_episodes": 3.288201160541586,
       "first_timeouts_per_100_instances": 2.4,
       "completion_per_call": 1437.015169226587,
       "over_8k_per_1000_calls": 35.612341987223054,
       "cap_hits_per_1000_calls": 8.427348103846677,
       "t_first_iso": "2026-10-26T08:25:06-07:00",
       "t_last_iso": "2026-10-28T06:53:09-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 11,
       "episodes": 501,
       "timeouts": 1,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 1,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35307,
       "completion_sum": 36193646,
       "over_8k": 550,
       "cap_hits": 125,
       "length_finish": 125,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 11,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987505.671,
       "t_last": 1793189436.745,
       "timeouts_per_100_episodes": 0.1996007984031936,
       "first_timeouts_per_100_instances": 0.2,
       "completion_per_call": 1025.1124706148921,
       "over_8k_per_1000_calls": 15.577647491998754,
       "cap_hits_per_1000_calls": 3.5403744299997166,
       "t_first_iso": "2026-10-25T21:05:05-07:00",
       "t_last_iso": "2026-10-28T05:10:36-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 18,
       "episodes": 512,
       "timeouts": 13,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 9,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 37392,
       "completion_sum": 48998381,
       "over_8k": 1011,
       "cap_hits": 207,
       "length_finish": 207,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 18,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792969123.865,
       "t_last": 1793192014.293,
       "timeouts_per_100_episodes": 2.5390625,
       "first_timeouts_per_100_instances": 1.8,
       "completion_per_call": 1310.3974379546428,
       "over_8k_per_1000_calls": 27.037869062901155,
       "cap_hits_per_1000_calls": 5.53594351732991,
       "t_first_iso": "2026-10-25T15:58:43-07:00",
       "t_last_iso": "2026-10-28T05:53:34-07:00"
      }
     }
    },
    "jqs_f_r60": {
     "units": 24,
     "attempts": 39,
     "episodes": 1511,
     "timeouts": 19,
     "zero_other": 3,
     "instances": 1491,
     "first_timeouts": 13,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 105481,
     "completion_sum": 100212390,
     "over_8k": 1591,
     "cap_hits": 331,
     "length_finish": 331,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 40,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1790945151.229,
     "t_last": 1790980844.401,
     "timeouts_per_100_episodes": 1.257445400397088,
     "first_timeouts_per_100_instances": 0.8718980549966465,
     "completion_per_call": 950.0515732691196,
     "over_8k_per_1000_calls": 15.083285141399873,
     "cap_hits_per_1000_calls": 3.1380058967965794,
     "t_first_iso": "2026-10-02T05:45:51-07:00",
     "t_last_iso": "2026-10-02T15:40:44-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 14,
       "episodes": 509,
       "timeouts": 10,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 6,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 35712,
       "completion_sum": 39259561,
       "over_8k": 686,
       "cap_hits": 157,
       "length_finish": 157,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 14,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790949730.168,
       "t_last": 1790975866.253,
       "timeouts_per_100_episodes": 1.9646365422396856,
       "first_timeouts_per_100_instances": 1.2,
       "completion_per_call": 1099.3380656362008,
       "over_8k_per_1000_calls": 19.209229390681003,
       "cap_hits_per_1000_calls": 4.396281362007168,
       "t_first_iso": "2026-10-02T07:02:10-07:00",
       "t_last_iso": "2026-10-02T14:17:46-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 10,
       "episodes": 503,
       "timeouts": 3,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 3,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35870,
       "completion_sum": 25395578,
       "over_8k": 276,
       "cap_hits": 55,
       "length_finish": 55,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 10,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790949748.881,
       "t_last": 1790964793.498,
       "timeouts_per_100_episodes": 0.5964214711729622,
       "first_timeouts_per_100_instances": 0.6,
       "completion_per_call": 707.989350432116,
       "over_8k_per_1000_calls": 7.694452188458322,
       "cap_hits_per_1000_calls": 1.533314747700028,
       "t_first_iso": "2026-10-02T07:02:28-07:00",
       "t_last_iso": "2026-10-02T11:13:13-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 15,
       "episodes": 499,
       "timeouts": 6,
       "zero_other": 3,
       "instances": 491,
       "first_timeouts": 4,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 33899,
       "completion_sum": 35557251,
       "over_8k": 629,
       "cap_hits": 119,
       "length_finish": 119,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 16,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1790945151.229,
       "t_last": 1790980844.401,
       "timeouts_per_100_episodes": 1.2024048096192386,
       "first_timeouts_per_100_instances": 0.814663951120163,
       "completion_per_call": 1048.9174016932652,
       "over_8k_per_1000_calls": 18.55511962004779,
       "cap_hits_per_1000_calls": 3.5104280362252576,
       "t_first_iso": "2026-10-02T05:45:51-07:00",
       "t_last_iso": "2026-10-02T15:40:44-07:00"
      }
     }
    },
    "jqs_f_u32_sxs": {
     "units": 24,
     "attempts": 50,
     "episodes": 1543,
     "timeouts": 29,
     "zero_other": 11,
     "instances": 1500,
     "first_timeouts": 23,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 110836,
     "completion_sum": 142772738,
     "over_8k": 2951,
     "cap_hits": 577,
     "length_finish": 577,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 50,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792968248.266,
     "t_last": 1793197762.337,
     "timeouts_per_100_episodes": 1.8794556059624108,
     "first_timeouts_per_100_instances": 1.5333333333333334,
     "completion_per_call": 1288.1440867588149,
     "over_8k_per_1000_calls": 26.624923310115847,
     "cap_hits_per_1000_calls": 5.205889783102963,
     "t_first_iso": "2026-10-25T15:44:08-07:00",
     "t_last_iso": "2026-10-28T07:29:22-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 20,
       "episodes": 513,
       "timeouts": 12,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 10,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 36746,
       "completion_sum": 51780261,
       "over_8k": 1122,
       "cap_hits": 231,
       "length_finish": 231,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 20,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028117.605,
       "t_last": 1793192005.678,
       "timeouts_per_100_episodes": 2.3391812865497075,
       "first_timeouts_per_100_instances": 2.0,
       "completion_per_call": 1409.1400696674468,
       "over_8k_per_1000_calls": 30.533935666467098,
       "cap_hits_per_1000_calls": 6.286398519566756,
       "t_first_iso": "2026-10-26T08:21:57-07:00",
       "t_last_iso": "2026-10-28T05:53:25-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 12,
       "episodes": 511,
       "timeouts": 3,
       "zero_other": 8,
       "instances": 500,
       "first_timeouts": 3,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 36597,
       "completion_sum": 39925789,
       "over_8k": 684,
       "cap_hits": 140,
       "length_finish": 140,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 12,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987523.154,
       "t_last": 1793188151.284,
       "timeouts_per_100_episodes": 0.5870841487279843,
       "first_timeouts_per_100_instances": 0.6,
       "completion_per_call": 1090.9579746973795,
       "over_8k_per_1000_calls": 18.69005656201328,
       "cap_hits_per_1000_calls": 3.82545017351149,
       "t_first_iso": "2026-10-25T21:05:23-07:00",
       "t_last_iso": "2026-10-28T04:49:11-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 18,
       "episodes": 519,
       "timeouts": 14,
       "zero_other": 3,
       "instances": 500,
       "first_timeouts": 10,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37493,
       "completion_sum": 51066688,
       "over_8k": 1145,
       "cap_hits": 206,
       "length_finish": 206,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 18,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792968248.266,
       "t_last": 1793197762.337,
       "timeouts_per_100_episodes": 2.697495183044316,
       "first_timeouts_per_100_instances": 2.0,
       "completion_per_call": 1362.0325927506467,
       "over_8k_per_1000_calls": 30.539033953004562,
       "cap_hits_per_1000_calls": 5.494358947003441,
       "t_first_iso": "2026-10-25T15:44:08-07:00",
       "t_last_iso": "2026-10-28T07:29:22-07:00"
      }
     }
    },
    "jqs_f_u32": {
     "units": 24,
     "attempts": 36,
     "episodes": 1507,
     "timeouts": 15,
     "zero_other": 3,
     "instances": 1488,
     "first_timeouts": 15,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 105665,
     "completion_sum": 102023254,
     "over_8k": 1528,
     "cap_hits": 209,
     "length_finish": 209,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 38,
     "attempts_without_snapshot": 2,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1790945135.059,
     "t_last": 1790967609.869,
     "timeouts_per_100_episodes": 0.9953550099535501,
     "first_timeouts_per_100_instances": 1.0080645161290323,
     "completion_per_call": 965.5349832016278,
     "over_8k_per_1000_calls": 14.46079591160744,
     "cap_hits_per_1000_calls": 1.9779491790091326,
     "t_first_iso": "2026-10-02T05:45:35-07:00",
     "t_last_iso": "2026-10-02T12:00:09-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 12,
       "episodes": 507,
       "timeouts": 6,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 6,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35349,
       "completion_sum": 38980134,
       "over_8k": 659,
       "cap_hits": 83,
       "length_finish": 83,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 12,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790945135.059,
       "t_last": 1790967609.869,
       "timeouts_per_100_episodes": 1.183431952662722,
       "first_timeouts_per_100_instances": 1.2,
       "completion_per_call": 1102.7223966731733,
       "over_8k_per_1000_calls": 18.642677303459788,
       "cap_hits_per_1000_calls": 2.3480155025601857,
       "t_first_iso": "2026-10-02T05:45:35-07:00",
       "t_last_iso": "2026-10-02T12:00:09-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 12,
       "episodes": 494,
       "timeouts": 4,
       "zero_other": 2,
       "instances": 488,
       "first_timeouts": 4,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35260,
       "completion_sum": 26469201,
       "over_8k": 317,
       "cap_hits": 45,
       "length_finish": 45,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 14,
       "attempts_without_snapshot": 2,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1790945164.581,
       "t_last": 1790964386.121,
       "timeouts_per_100_episodes": 0.8097165991902834,
       "first_timeouts_per_100_instances": 0.819672131147541,
       "completion_per_call": 750.6863584798639,
       "over_8k_per_1000_calls": 8.99035734543392,
       "cap_hits_per_1000_calls": 1.276233692569484,
       "t_first_iso": "2026-10-02T05:46:04-07:00",
       "t_last_iso": "2026-10-02T11:06:26-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 12,
       "episodes": 506,
       "timeouts": 5,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 5,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35056,
       "completion_sum": 36573919,
       "over_8k": 552,
       "cap_hits": 81,
       "length_finish": 81,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 12,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790945226.672,
       "t_last": 1790962780.02,
       "timeouts_per_100_episodes": 0.9881422924901185,
       "first_timeouts_per_100_instances": 1.0,
       "completion_per_call": 1043.2998345504336,
       "over_8k_per_1000_calls": 15.746234596074851,
       "cap_hits_per_1000_calls": 2.310588772250114,
       "t_first_iso": "2026-10-02T05:47:06-07:00",
       "t_last_iso": "2026-10-02T10:39:40-07:00"
      }
     }
    },
    "jqs_f_u64_sxs": {
     "units": 24,
     "attempts": 54,
     "episodes": 1537,
     "timeouts": 35,
     "zero_other": 0,
     "instances": 1500,
     "first_timeouts": 27,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 112296,
     "completion_sum": 156929943,
     "over_8k": 3679,
     "cap_hits": 681,
     "length_finish": 681,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 54,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792967703.473,
     "t_last": 1793195533.366,
     "timeouts_per_100_episodes": 2.277163305139883,
     "first_timeouts_per_100_instances": 1.8,
     "completion_per_call": 1397.466899978628,
     "over_8k_per_1000_calls": 32.76162997791551,
     "cap_hits_per_1000_calls": 6.064329985039539,
     "t_first_iso": "2026-10-25T15:35:03-07:00",
     "t_last_iso": "2026-10-28T06:52:13-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 22,
       "episodes": 520,
       "timeouts": 20,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 13,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 38508,
       "completion_sum": 58934853,
       "over_8k": 1429,
       "cap_hits": 273,
       "length_finish": 273,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793029304.949,
       "t_last": 1793192554.849,
       "timeouts_per_100_episodes": 3.8461538461538463,
       "first_timeouts_per_100_instances": 2.6,
       "completion_per_call": 1530.457385478342,
       "over_8k_per_1000_calls": 37.109172120078945,
       "cap_hits_per_1000_calls": 7.089435961358679,
       "t_first_iso": "2026-10-26T08:41:44-07:00",
       "t_last_iso": "2026-10-28T06:02:34-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 12,
       "episodes": 503,
       "timeouts": 2,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 2,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35930,
       "completion_sum": 42945649,
       "over_8k": 870,
       "cap_hits": 171,
       "length_finish": 171,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 12,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987703.69,
       "t_last": 1793155197.661,
       "timeouts_per_100_episodes": 0.3976143141153082,
       "first_timeouts_per_100_instances": 0.4,
       "completion_per_call": 1195.2588087948789,
       "over_8k_per_1000_calls": 24.213748956303924,
       "cap_hits_per_1000_calls": 4.7592541052045645,
       "t_first_iso": "2026-10-25T21:08:23-07:00",
       "t_last_iso": "2026-10-27T19:39:57-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 20,
       "episodes": 514,
       "timeouts": 13,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 12,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37858,
       "completion_sum": 55049441,
       "over_8k": 1380,
       "cap_hits": 237,
       "length_finish": 237,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 20,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792967703.473,
       "t_last": 1793195533.366,
       "timeouts_per_100_episodes": 2.529182879377432,
       "first_timeouts_per_100_instances": 2.4,
       "completion_per_call": 1454.1032542659411,
       "over_8k_per_1000_calls": 36.452004860267316,
       "cap_hits_per_1000_calls": 6.260235617306778,
       "t_first_iso": "2026-10-25T15:35:03-07:00",
       "t_last_iso": "2026-10-28T06:52:13-07:00"
      }
     }
    },
    "jqs_f_u64": {
     "units": 24,
     "attempts": 35,
     "episodes": 1508,
     "timeouts": 8,
     "zero_other": 9,
     "instances": 1491,
     "first_timeouts": 7,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 107751,
     "completion_sum": 106799856,
     "over_8k": 1793,
     "cap_hits": 252,
     "length_finish": 252,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 36,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1790944583.024,
     "t_last": 1790976222.5,
     "timeouts_per_100_episodes": 0.5305039787798409,
     "first_timeouts_per_100_instances": 0.4694835680751174,
     "completion_per_call": 991.172759417546,
     "over_8k_per_1000_calls": 16.640216796131824,
     "cap_hits_per_1000_calls": 2.3387253946599103,
     "t_first_iso": "2026-10-02T05:36:23-07:00",
     "t_last_iso": "2026-10-02T14:23:42-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 12,
       "episodes": 503,
       "timeouts": 3,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 3,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35843,
       "completion_sum": 40472205,
       "over_8k": 714,
       "cap_hits": 106,
       "length_finish": 106,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 12,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790945206.395,
       "t_last": 1790970375.538,
       "timeouts_per_100_episodes": 0.5964214711729622,
       "first_timeouts_per_100_instances": 0.6,
       "completion_per_call": 1129.1522752001786,
       "over_8k_per_1000_calls": 19.920207571910833,
       "cap_hits_per_1000_calls": 2.9573417403677147,
       "t_first_iso": "2026-10-02T05:46:46-07:00",
       "t_last_iso": "2026-10-02T12:46:15-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 10,
       "episodes": 493,
       "timeouts": 2,
       "zero_other": 0,
       "instances": 491,
       "first_timeouts": 2,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 35607,
       "completion_sum": 26049218,
       "over_8k": 307,
       "cap_hits": 47,
       "length_finish": 47,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 11,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1790945219.692,
       "t_last": 1790964423.568,
       "timeouts_per_100_episodes": 0.4056795131845842,
       "first_timeouts_per_100_instances": 0.4073319755600815,
       "completion_per_call": 731.5757575757576,
       "over_8k_per_1000_calls": 8.621900188165249,
       "cap_hits_per_1000_calls": 1.3199651753868622,
       "t_first_iso": "2026-10-02T05:46:59-07:00",
       "t_last_iso": "2026-10-02T11:07:03-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 13,
       "episodes": 512,
       "timeouts": 3,
       "zero_other": 9,
       "instances": 500,
       "first_timeouts": 2,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 36301,
       "completion_sum": 40278433,
       "over_8k": 772,
       "cap_hits": 99,
       "length_finish": 99,
       "non200": 6,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 13,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790944583.024,
       "t_last": 1790976222.5,
       "timeouts_per_100_episodes": 0.5859375,
       "first_timeouts_per_100_instances": 0.4,
       "completion_per_call": 1109.568138618771,
       "over_8k_per_1000_calls": 21.26663177322939,
       "cap_hits_per_1000_calls": 2.7271975978623177,
       "t_first_iso": "2026-10-02T05:36:23-07:00",
       "t_last_iso": "2026-10-02T14:23:42-07:00"
      }
     }
    },
    "jqs_f_u128_sxs": {
     "units": 24,
     "attempts": 60,
     "episodes": 1557,
     "timeouts": 51,
     "zero_other": 3,
     "instances": 1500,
     "first_timeouts": 41,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 117330,
     "completion_sum": 173428947,
     "over_8k": 4473,
     "cap_hits": 914,
     "length_finish": 914,
     "non200": 0,
     "excluded_episodes": 1,
     "excluded_calls": 67,
     "bad_lines": 0,
     "attempts_listed": 60,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792968201.591,
     "t_last": 1793194009.321,
     "timeouts_per_100_episodes": 3.275529865125241,
     "first_timeouts_per_100_instances": 2.7333333333333334,
     "completion_per_call": 1478.1296087957044,
     "over_8k_per_1000_calls": 38.12324213756072,
     "cap_hits_per_1000_calls": 7.789994033921419,
     "t_first_iso": "2026-10-25T15:43:21-07:00",
     "t_last_iso": "2026-10-28T06:26:49-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 524,
       "timeouts": 24,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 17,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 39449,
       "completion_sum": 65549292,
       "over_8k": 1841,
       "cap_hits": 372,
       "length_finish": 372,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793027416.804,
       "t_last": 1793192762.628,
       "timeouts_per_100_episodes": 4.580152671755725,
       "first_timeouts_per_100_instances": 3.4,
       "completion_per_call": 1661.6211310806357,
       "over_8k_per_1000_calls": 46.66784962863444,
       "cap_hits_per_1000_calls": 9.429896828816954,
       "t_first_iso": "2026-10-26T08:10:16-07:00",
       "t_last_iso": "2026-10-28T06:06:02-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 15,
       "episodes": 511,
       "timeouts": 10,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 10,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 38537,
       "completion_sum": 48092298,
       "over_8k": 1076,
       "cap_hits": 247,
       "length_finish": 247,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 15,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987509.081,
       "t_last": 1793157616.628,
       "timeouts_per_100_episodes": 1.9569471624266144,
       "first_timeouts_per_100_instances": 2.0,
       "completion_per_call": 1247.9512676129434,
       "over_8k_per_1000_calls": 27.921218569167294,
       "cap_hits_per_1000_calls": 6.409424708721488,
       "t_first_iso": "2026-10-25T21:05:09-07:00",
       "t_last_iso": "2026-10-27T20:20:16-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 21,
       "episodes": 522,
       "timeouts": 17,
       "zero_other": 2,
       "instances": 500,
       "first_timeouts": 14,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 39344,
       "completion_sum": 59787357,
       "over_8k": 1556,
       "cap_hits": 295,
       "length_finish": 295,
       "non200": 0,
       "excluded_episodes": 1,
       "excluded_calls": 67,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792968201.591,
       "t_last": 1793194009.321,
       "timeouts_per_100_episodes": 3.256704980842912,
       "first_timeouts_per_100_instances": 2.8,
       "completion_per_call": 1519.6054544530298,
       "over_8k_per_1000_calls": 39.5485969906466,
       "cap_hits_per_1000_calls": 7.497966653111021,
       "t_first_iso": "2026-10-25T15:43:21-07:00",
       "t_last_iso": "2026-10-28T06:26:49-07:00"
      }
     }
    },
    "jqs_f_u128": {
     "units": 24,
     "attempts": 42,
     "episodes": 1527,
     "timeouts": 22,
     "zero_other": 6,
     "instances": 1500,
     "first_timeouts": 18,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 113479,
     "completion_sum": 124585729,
     "over_8k": 2489,
     "cap_hits": 376,
     "length_finish": 376,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 42,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1790944570.513,
     "t_last": 1790976691.031,
     "timeouts_per_100_episodes": 1.4407334643091028,
     "first_timeouts_per_100_instances": 1.2,
     "completion_per_call": 1097.8747521567868,
     "over_8k_per_1000_calls": 21.933573612738922,
     "cap_hits_per_1000_calls": 3.313388380228941,
     "t_first_iso": "2026-10-02T05:36:10-07:00",
     "t_last_iso": "2026-10-02T14:31:31-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 14,
       "episodes": 507,
       "timeouts": 7,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 7,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 36692,
       "completion_sum": 45565365,
       "over_8k": 966,
       "cap_hits": 137,
       "length_finish": 137,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 14,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790944574.448,
       "t_last": 1790974456.017,
       "timeouts_per_100_episodes": 1.3806706114398422,
       "first_timeouts_per_100_instances": 1.4,
       "completion_per_call": 1241.8337784803227,
       "over_8k_per_1000_calls": 26.32726479886624,
       "cap_hits_per_1000_calls": 3.7337839311021477,
       "t_first_iso": "2026-10-02T05:36:14-07:00",
       "t_last_iso": "2026-10-02T13:54:16-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 9,
       "episodes": 500,
       "timeouts": 0,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 0,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37051,
       "completion_sum": 29183843,
       "over_8k": 391,
       "cap_hits": 50,
       "length_finish": 50,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 9,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790944570.513,
       "t_last": 1790968319.478,
       "timeouts_per_100_episodes": 0.0,
       "first_timeouts_per_100_instances": 0.0,
       "completion_per_call": 787.6668106123991,
       "over_8k_per_1000_calls": 10.553021510890394,
       "cap_hits_per_1000_calls": 1.3494912418018408,
       "t_first_iso": "2026-10-02T05:36:10-07:00",
       "t_last_iso": "2026-10-02T12:11:59-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 19,
       "episodes": 520,
       "timeouts": 15,
       "zero_other": 6,
       "instances": 500,
       "first_timeouts": 11,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 39736,
       "completion_sum": 49836521,
       "over_8k": 1132,
       "cap_hits": 189,
       "length_finish": 189,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1790944591.943,
       "t_last": 1790976691.031,
       "timeouts_per_100_episodes": 2.8846153846153846,
       "first_timeouts_per_100_instances": 2.2,
       "completion_per_call": 1254.1906835111738,
       "over_8k_per_1000_calls": 28.48802093819207,
       "cap_hits_per_1000_calls": 4.756392188443729,
       "t_first_iso": "2026-10-02T05:36:31-07:00",
       "t_last_iso": "2026-10-02T14:31:31-07:00"
      }
     }
    },
    "quest_b2048_s1_sxs": {
     "units": 48,
     "attempts": 164,
     "episodes": 1990,
     "timeouts": 298,
     "zero_other": 266,
     "instances": 1500,
     "first_timeouts": 186,
     "counted_zero": 83,
     "counted_timeouts": 26,
     "calls": 371412,
     "completion_sum": 308600775,
     "over_8k": 4481,
     "cap_hits": 1170,
     "length_finish": 1170,
     "non200": 266,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 164,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792969408.862,
     "t_last": 1793208052.613,
     "timeouts_per_100_episodes": 14.974874371859297,
     "first_timeouts_per_100_instances": 12.4,
     "completion_per_call": 830.8853106523214,
     "over_8k_per_1000_calls": 12.064769043541943,
     "cap_hits_per_1000_calls": 3.150140544731996,
     "t_first_iso": "2026-10-25T16:03:28-07:00",
     "t_last_iso": "2026-10-28T10:20:52-07:00",
     "seeds": {
      "42": {
       "units": 16,
       "attempts": 61,
       "episodes": 697,
       "timeouts": 134,
       "zero_other": 95,
       "instances": 500,
       "first_timeouts": 76,
       "counted_zero": 36,
       "counted_timeouts": 13,
       "calls": 128179,
       "completion_sum": 114087196,
       "over_8k": 1774,
       "cap_hits": 463,
       "length_finish": 463,
       "non200": 95,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 61,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028057.05,
       "t_last": 1793208052.613,
       "timeouts_per_100_episodes": 19.225251076040173,
       "first_timeouts_per_100_instances": 15.2,
       "completion_per_call": 890.0615233384564,
       "over_8k_per_1000_calls": 13.840020596197505,
       "cap_hits_per_1000_calls": 3.6121361533480525,
       "t_first_iso": "2026-10-26T08:20:57-07:00",
       "t_last_iso": "2026-10-28T10:20:52-07:00"
      },
      "43": {
       "units": 16,
       "attempts": 53,
       "episodes": 636,
       "timeouts": 86,
       "zero_other": 68,
       "instances": 500,
       "first_timeouts": 59,
       "counted_zero": 19,
       "counted_timeouts": 6,
       "calls": 120426,
       "completion_sum": 98883535,
       "over_8k": 1285,
       "cap_hits": 295,
       "length_finish": 295,
       "non200": 68,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 53,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987542.489,
       "t_last": 1793198591.596,
       "timeouts_per_100_episodes": 13.522012578616351,
       "first_timeouts_per_100_instances": 11.8,
       "completion_per_call": 821.1145018517595,
       "over_8k_per_1000_calls": 10.67045322438676,
       "cap_hits_per_1000_calls": 2.4496371215518242,
       "t_first_iso": "2026-10-25T21:05:42-07:00",
       "t_last_iso": "2026-10-28T07:43:11-07:00"
      },
      "44": {
       "units": 16,
       "attempts": 50,
       "episodes": 657,
       "timeouts": 78,
       "zero_other": 103,
       "instances": 500,
       "first_timeouts": 51,
       "counted_zero": 28,
       "counted_timeouts": 7,
       "calls": 122807,
       "completion_sum": 95630044,
       "over_8k": 1422,
       "cap_hits": 412,
       "length_finish": 412,
       "non200": 103,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 50,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792969408.862,
       "t_last": 1793198651.113,
       "timeouts_per_100_episodes": 11.872146118721462,
       "first_timeouts_per_100_instances": 10.2,
       "completion_per_call": 778.7018981002711,
       "over_8k_per_1000_calls": 11.579144511306358,
       "cap_hits_per_1000_calls": 3.3548576221225175,
       "t_first_iso": "2026-10-25T16:03:28-07:00",
       "t_last_iso": "2026-10-28T07:44:11-07:00"
      }
     }
    },
    "quest_b2048_s1": {
     "units": 48,
     "attempts": 126,
     "episodes": 1685,
     "timeouts": 106,
     "zero_other": 110,
     "instances": 1489,
     "first_timeouts": 69,
     "counted_zero": 25,
     "counted_timeouts": 9,
     "calls": 325774,
     "completion_sum": 201091597,
     "over_8k": 2170,
     "cap_hits": 678,
     "length_finish": 678,
     "non200": 109,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 127,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1791068491.452,
     "t_last": 1791099003.334,
     "timeouts_per_100_episodes": 6.29080118694362,
     "first_timeouts_per_100_instances": 4.633982538616521,
     "completion_per_call": 617.2733152430826,
     "over_8k_per_1000_calls": 6.661059507511342,
     "cap_hits_per_1000_calls": 2.08119739451276,
     "t_first_iso": "2026-10-03T16:01:31-07:00",
     "t_last_iso": "2026-10-04T00:30:03-07:00",
     "seeds": {
      "42": {
       "units": 16,
       "attempts": 44,
       "episodes": 562,
       "timeouts": 38,
       "zero_other": 41,
       "instances": 489,
       "first_timeouts": 22,
       "counted_zero": 9,
       "counted_timeouts": 3,
       "calls": 107972,
       "completion_sum": 68607782,
       "over_8k": 750,
       "cap_hits": 239,
       "length_finish": 239,
       "non200": 40,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 45,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1791068491.452,
       "t_last": 1791098967.826,
       "timeouts_per_100_episodes": 6.761565836298932,
       "first_timeouts_per_100_instances": 4.4989775051124745,
       "completion_per_call": 635.4219797725336,
       "over_8k_per_1000_calls": 6.946245322861483,
       "cap_hits_per_1000_calls": 2.2135368428851923,
       "t_first_iso": "2026-10-03T16:01:31-07:00",
       "t_last_iso": "2026-10-04T00:29:27-07:00"
      },
      "43": {
       "units": 16,
       "attempts": 38,
       "episodes": 556,
       "timeouts": 37,
       "zero_other": 23,
       "instances": 500,
       "first_timeouts": 25,
       "counted_zero": 5,
       "counted_timeouts": 4,
       "calls": 108592,
       "completion_sum": 65760431,
       "over_8k": 688,
       "cap_hits": 224,
       "length_finish": 224,
       "non200": 23,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 38,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791069125.331,
       "t_last": 1791096967.534,
       "timeouts_per_100_episodes": 6.654676258992806,
       "first_timeouts_per_100_instances": 5.0,
       "completion_per_call": 605.573440032415,
       "over_8k_per_1000_calls": 6.335641667894504,
       "cap_hits_per_1000_calls": 2.0627670546633268,
       "t_first_iso": "2026-10-03T16:12:05-07:00",
       "t_last_iso": "2026-10-03T23:56:07-07:00"
      },
      "44": {
       "units": 16,
       "attempts": 44,
       "episodes": 567,
       "timeouts": 31,
       "zero_other": 46,
       "instances": 500,
       "first_timeouts": 22,
       "counted_zero": 11,
       "counted_timeouts": 2,
       "calls": 109210,
       "completion_sum": 66723384,
       "over_8k": 732,
       "cap_hits": 215,
       "length_finish": 215,
       "non200": 46,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 44,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791069245.232,
       "t_last": 1791099003.334,
       "timeouts_per_100_episodes": 5.467372134038801,
       "first_timeouts_per_100_instances": 4.4,
       "completion_per_call": 610.9640509110887,
       "over_8k_per_1000_calls": 6.7026829044959255,
       "cap_hits_per_1000_calls": 1.9686841864298141,
       "t_first_iso": "2026-10-03T16:14:05-07:00",
       "t_last_iso": "2026-10-04T00:30:03-07:00"
      }
     }
    },
    "sparq_c8_s1_sxs": {
     "units": 24,
     "attempts": 68,
     "episodes": 1571,
     "timeouts": 73,
     "zero_other": 1,
     "instances": 1500,
     "first_timeouts": 54,
     "counted_zero": 5,
     "counted_timeouts": 5,
     "calls": 118518,
     "completion_sum": 170826926,
     "over_8k": 4135,
     "cap_hits": 904,
     "length_finish": 904,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 68,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792967349.264,
     "t_last": 1793195618.942,
     "timeouts_per_100_episodes": 4.646721833227244,
     "first_timeouts_per_100_instances": 3.6,
     "completion_per_call": 1441.3584940684116,
     "over_8k_per_1000_calls": 34.88921514031624,
     "cap_hits_per_1000_calls": 7.6275333704584956,
     "t_first_iso": "2026-10-25T15:29:09-07:00",
     "t_last_iso": "2026-10-28T06:53:38-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 26,
       "episodes": 530,
       "timeouts": 30,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 22,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 40094,
       "completion_sum": 62666482,
       "over_8k": 1570,
       "cap_hits": 343,
       "length_finish": 343,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 26,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793026848.637,
       "t_last": 1793192668.653,
       "timeouts_per_100_episodes": 5.660377358490566,
       "first_timeouts_per_100_instances": 4.4,
       "completion_per_call": 1562.9890257893949,
       "over_8k_per_1000_calls": 39.15797874993765,
       "cap_hits_per_1000_calls": 8.55489599441313,
       "t_first_iso": "2026-10-26T08:00:48-07:00",
       "t_last_iso": "2026-10-28T06:04:28-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 20,
       "episodes": 512,
       "timeouts": 13,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 11,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 38289,
       "completion_sum": 47510989,
       "over_8k": 953,
       "cap_hits": 209,
       "length_finish": 209,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 20,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987806.377,
       "t_last": 1793191957.795,
       "timeouts_per_100_episodes": 2.5390625,
       "first_timeouts_per_100_instances": 2.2,
       "completion_per_call": 1240.8521768654182,
       "over_8k_per_1000_calls": 24.889654992295437,
       "cap_hits_per_1000_calls": 5.458486771657657,
       "t_first_iso": "2026-10-25T21:10:06-07:00",
       "t_last_iso": "2026-10-28T05:52:37-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 22,
       "episodes": 529,
       "timeouts": 30,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 21,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 40135,
       "completion_sum": 60649455,
       "over_8k": 1612,
       "cap_hits": 352,
       "length_finish": 352,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792967349.264,
       "t_last": 1793195618.942,
       "timeouts_per_100_episodes": 5.671077504725898,
       "first_timeouts_per_100_instances": 4.2,
       "completion_per_call": 1511.1362900211784,
       "over_8k_per_1000_calls": 40.16444499813131,
       "cap_hits_per_1000_calls": 8.770399900336365,
       "t_first_iso": "2026-10-25T15:29:09-07:00",
       "t_last_iso": "2026-10-28T06:53:38-07:00"
      }
     }
    },
    "sparq_c8_s1": {
     "units": 24,
     "attempts": 61,
     "episodes": 1567,
     "timeouts": 72,
     "zero_other": 4,
     "instances": 1500,
     "first_timeouts": 46,
     "counted_zero": 9,
     "counted_timeouts": 9,
     "calls": 121004,
     "completion_sum": 144411850,
     "over_8k": 2890,
     "cap_hits": 456,
     "length_finish": 456,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 61,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1791060245.814,
     "t_last": 1791091514.601,
     "timeouts_per_100_episodes": 4.594767070835992,
     "first_timeouts_per_100_instances": 3.066666666666667,
     "completion_per_call": 1193.4469108459225,
     "over_8k_per_1000_calls": 23.883507983207167,
     "cap_hits_per_1000_calls": 3.768470463786321,
     "t_first_iso": "2026-10-03T13:44:05-07:00",
     "t_last_iso": "2026-10-03T22:25:14-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 537,
       "timeouts": 40,
       "zero_other": 4,
       "instances": 500,
       "first_timeouts": 20,
       "counted_zero": 7,
       "counted_timeouts": 7,
       "calls": 40942,
       "completion_sum": 57132123,
       "over_8k": 1306,
       "cap_hits": 189,
       "length_finish": 189,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791060266.33,
       "t_last": 1791091514.601,
       "timeouts_per_100_episodes": 7.4487895716946,
       "first_timeouts_per_100_instances": 4.0,
       "completion_per_call": 1395.4404523472228,
       "over_8k_per_1000_calls": 31.898783645156563,
       "cap_hits_per_1000_calls": 4.616286454008109,
       "t_first_iso": "2026-10-03T13:44:26-07:00",
       "t_last_iso": "2026-10-03T22:25:14-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 16,
       "episodes": 509,
       "timeouts": 9,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 8,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 40193,
       "completion_sum": 36999167,
       "over_8k": 564,
       "cap_hits": 80,
       "length_finish": 80,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 16,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791060245.814,
       "t_last": 1791082247.255,
       "timeouts_per_100_episodes": 1.768172888015717,
       "first_timeouts_per_100_instances": 1.6,
       "completion_per_call": 920.5375811708507,
       "over_8k_per_1000_calls": 14.032294180578708,
       "cap_hits_per_1000_calls": 1.9903963376707388,
       "t_first_iso": "2026-10-03T13:44:05-07:00",
       "t_last_iso": "2026-10-03T19:50:47-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 21,
       "episodes": 521,
       "timeouts": 23,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 18,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 39869,
       "completion_sum": 50280560,
       "over_8k": 1020,
       "cap_hits": 187,
       "length_finish": 187,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791060286.477,
       "t_last": 1791091451.527,
       "timeouts_per_100_episodes": 4.414587332053743,
       "first_timeouts_per_100_instances": 3.6,
       "completion_per_call": 1261.1442474102687,
       "over_8k_per_1000_calls": 25.583786902104393,
       "cap_hits_per_1000_calls": 4.690360932052472,
       "t_first_iso": "2026-10-03T13:44:46-07:00",
       "t_last_iso": "2026-10-03T22:24:11-07:00"
      }
     }
    },
    "loki_k25_d25_s1_sxs": {
     "units": 24,
     "attempts": 70,
     "episodes": 1579,
     "timeouts": 75,
     "zero_other": 0,
     "instances": 1500,
     "first_timeouts": 54,
     "counted_zero": 3,
     "counted_timeouts": 3,
     "calls": 118496,
     "completion_sum": 180256500,
     "over_8k": 4824,
     "cap_hits": 999,
     "length_finish": 998,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 70,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792969554.785,
     "t_last": 1793201953.532,
     "timeouts_per_100_episodes": 4.749841671944268,
     "first_timeouts_per_100_instances": 3.6,
     "completion_per_call": 1521.2032473669997,
     "over_8k_per_1000_calls": 40.71023494463948,
     "cap_hits_per_1000_calls": 8.430664326221983,
     "t_first_iso": "2026-10-25T16:05:54-07:00",
     "t_last_iso": "2026-10-28T08:39:13-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 537,
       "timeouts": 37,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 25,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 39755,
       "completion_sum": 67748286,
       "over_8k": 2000,
       "cap_hits": 418,
       "length_finish": 417,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028070.422,
       "t_last": 1793191854.503,
       "timeouts_per_100_episodes": 6.890130353817504,
       "first_timeouts_per_100_instances": 5.0,
       "completion_per_call": 1704.1450383599547,
       "over_8k_per_1000_calls": 50.308137341214945,
       "cap_hits_per_1000_calls": 10.514400704313923,
       "t_first_iso": "2026-10-26T08:21:10-07:00",
       "t_last_iso": "2026-10-28T05:50:54-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 22,
       "episodes": 517,
       "timeouts": 17,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 14,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 39290,
       "completion_sum": 51923798,
       "over_8k": 1231,
       "cap_hits": 264,
       "length_finish": 264,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987671.147,
       "t_last": 1793191179.042,
       "timeouts_per_100_episodes": 3.288201160541586,
       "first_timeouts_per_100_instances": 2.8,
       "completion_per_call": 1321.5525069992364,
       "over_8k_per_1000_calls": 31.33112751336218,
       "cap_hits_per_1000_calls": 6.71926698905574,
       "t_first_iso": "2026-10-25T21:07:51-07:00",
       "t_last_iso": "2026-10-28T05:39:39-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 24,
       "episodes": 525,
       "timeouts": 21,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 15,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 39451,
       "completion_sum": 60584416,
       "over_8k": 1593,
       "cap_hits": 317,
       "length_finish": 317,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792969554.785,
       "t_last": 1793201953.532,
       "timeouts_per_100_episodes": 4.0,
       "first_timeouts_per_100_instances": 3.0,
       "completion_per_call": 1535.6877138729055,
       "over_8k_per_1000_calls": 40.37920458290031,
       "cap_hits_per_1000_calls": 8.035284276697675,
       "t_first_iso": "2026-10-25T16:05:54-07:00",
       "t_last_iso": "2026-10-28T08:39:13-07:00"
      }
     }
    },
    "loki_k25_d25_s1": {
     "units": 24,
     "attempts": 55,
     "episodes": 1536,
     "timeouts": 53,
     "zero_other": 0,
     "instances": 1488,
     "first_timeouts": 34,
     "counted_zero": 5,
     "counted_timeouts": 5,
     "calls": 115762,
     "completion_sum": 141618053,
     "over_8k": 3160,
     "cap_hits": 575,
     "length_finish": 575,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 56,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1791060297.189,
     "t_last": 1791091527.549,
     "timeouts_per_100_episodes": 3.4505208333333335,
     "first_timeouts_per_100_instances": 2.28494623655914,
     "completion_per_call": 1223.3552720236346,
     "over_8k_per_1000_calls": 27.297386016136556,
     "cap_hits_per_1000_calls": 4.967087645341303,
     "t_first_iso": "2026-10-03T13:44:57-07:00",
     "t_last_iso": "2026-10-03T22:25:27-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 20,
       "episodes": 519,
       "timeouts": 22,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 13,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 38215,
       "completion_sum": 52840500,
       "over_8k": 1295,
       "cap_hits": 255,
       "length_finish": 255,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 20,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791060297.189,
       "t_last": 1791091527.549,
       "timeouts_per_100_episodes": 4.238921001926783,
       "first_timeouts_per_100_instances": 2.6,
       "completion_per_call": 1382.7162109119456,
       "over_8k_per_1000_calls": 33.88721706136334,
       "cap_hits_per_1000_calls": 6.672772471542588,
       "t_first_iso": "2026-10-03T13:44:57-07:00",
       "t_last_iso": "2026-10-03T22:25:27-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 14,
       "episodes": 495,
       "timeouts": 7,
       "zero_other": 0,
       "instances": 488,
       "first_timeouts": 5,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 38404,
       "completion_sum": 36012950,
       "over_8k": 617,
       "cap_hits": 100,
       "length_finish": 100,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 15,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1791060380.788,
       "t_last": 1791085564.901,
       "timeouts_per_100_episodes": 1.4141414141414141,
       "first_timeouts_per_100_instances": 1.0245901639344261,
       "completion_per_call": 937.7395583793354,
       "over_8k_per_1000_calls": 16.066034788042913,
       "cap_hits_per_1000_calls": 2.603895427559629,
       "t_first_iso": "2026-10-03T13:46:20-07:00",
       "t_last_iso": "2026-10-03T20:46:04-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 21,
       "episodes": 522,
       "timeouts": 24,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 16,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 39143,
       "completion_sum": 52764603,
       "over_8k": 1248,
       "cap_hits": 220,
       "length_finish": 220,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791060436.578,
       "t_last": 1791091190.766,
       "timeouts_per_100_episodes": 4.597701149425287,
       "first_timeouts_per_100_instances": 3.2,
       "completion_per_call": 1347.9958868763254,
       "over_8k_per_1000_calls": 31.883095317170376,
       "cap_hits_per_1000_calls": 5.620417443731958,
       "t_first_iso": "2026-10-03T13:47:16-07:00",
       "t_last_iso": "2026-10-03T22:19:50-07:00"
      }
     }
    },
    "tri_b4096_s1_sxs": {
     "units": 24,
     "attempts": 69,
     "episodes": 1558,
     "timeouts": 95,
     "zero_other": 1,
     "instances": 1468,
     "first_timeouts": 64,
     "counted_zero": 9,
     "counted_timeouts": 9,
     "calls": 117275,
     "completion_sum": 199976390,
     "over_8k": 6413,
     "cap_hits": 2315,
     "length_finish": 2314,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 70,
     "attempts_without_snapshot": 1,
     "units_first_attempt_without_snapshot": 1,
     "t_first": 1792969676.808,
     "t_last": 1793197981.81,
     "timeouts_per_100_episodes": 6.097560975609756,
     "first_timeouts_per_100_instances": 4.359673024523161,
     "completion_per_call": 1705.1919846514602,
     "over_8k_per_1000_calls": 54.68343636751226,
     "cap_hits_per_1000_calls": 19.73992752078448,
     "t_first_iso": "2026-10-25T16:07:56-07:00",
     "t_last_iso": "2026-10-28T07:33:01-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 26,
       "episodes": 542,
       "timeouts": 48,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 30,
       "counted_zero": 6,
       "counted_timeouts": 6,
       "calls": 41267,
       "completion_sum": 77827929,
       "over_8k": 2606,
       "cap_hits": 968,
       "length_finish": 968,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 26,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028044.258,
       "t_last": 1793197981.81,
       "timeouts_per_100_episodes": 8.85608856088561,
       "first_timeouts_per_100_instances": 6.0,
       "completion_per_call": 1885.9604284294958,
       "over_8k_per_1000_calls": 63.149732231565174,
       "cap_hits_per_1000_calls": 23.456999539583688,
       "t_first_iso": "2026-10-26T08:20:44-07:00",
       "t_last_iso": "2026-10-28T07:33:01-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 21,
       "episodes": 516,
       "timeouts": 16,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 11,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 38557,
       "completion_sum": 54993413,
       "over_8k": 1543,
       "cap_hits": 547,
       "length_finish": 547,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987660.488,
       "t_last": 1793191836.625,
       "timeouts_per_100_episodes": 3.10077519379845,
       "first_timeouts_per_100_instances": 2.2,
       "completion_per_call": 1426.2886894727287,
       "over_8k_per_1000_calls": 40.01867365199575,
       "cap_hits_per_1000_calls": 14.186788391213009,
       "t_first_iso": "2026-10-25T21:07:40-07:00",
       "t_last_iso": "2026-10-28T05:50:36-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 22,
       "episodes": 500,
       "timeouts": 31,
       "zero_other": 1,
       "instances": 468,
       "first_timeouts": 23,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 37451,
       "completion_sum": 67155048,
       "over_8k": 2264,
       "cap_hits": 800,
       "length_finish": 799,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 23,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1792969676.808,
       "t_last": 1793195638.241,
       "timeouts_per_100_episodes": 6.2,
       "first_timeouts_per_100_instances": 4.914529914529915,
       "completion_per_call": 1793.1443219139676,
       "over_8k_per_1000_calls": 60.4523243705108,
       "cap_hits_per_1000_calls": 21.361245360604524,
       "t_first_iso": "2026-10-25T16:07:56-07:00",
       "t_last_iso": "2026-10-28T06:53:58-07:00"
      }
     }
    },
    "tri_b4096_s1": {
     "units": 24,
     "attempts": 60,
     "episodes": 1532,
     "timeouts": 59,
     "zero_other": 0,
     "instances": 1477,
     "first_timeouts": 42,
     "counted_zero": 5,
     "counted_timeouts": 5,
     "calls": 116473,
     "completion_sum": 161459186,
     "over_8k": 4409,
     "cap_hits": 1616,
     "length_finish": 1616,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 62,
     "attempts_without_snapshot": 2,
     "units_first_attempt_without_snapshot": 2,
     "t_first": 1791059397.39,
     "t_last": 1791093253.334,
     "timeouts_per_100_episodes": 3.8511749347258486,
     "first_timeouts_per_100_instances": 2.843601895734597,
     "completion_per_call": 1386.2370334755694,
     "over_8k_per_1000_calls": 37.85426665407434,
     "cap_hits_per_1000_calls": 13.874460175319602,
     "t_first_iso": "2026-10-03T13:29:57-07:00",
     "t_last_iso": "2026-10-03T22:54:13-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 23,
       "episodes": 512,
       "timeouts": 29,
       "zero_other": 0,
       "instances": 487,
       "first_timeouts": 17,
       "counted_zero": 4,
       "counted_timeouts": 4,
       "calls": 38169,
       "completion_sum": 60326587,
       "over_8k": 1779,
       "cap_hits": 671,
       "length_finish": 671,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1791059397.39,
       "t_last": 1791093087.134,
       "timeouts_per_100_episodes": 5.6640625,
       "first_timeouts_per_100_instances": 3.490759753593429,
       "completion_per_call": 1580.512641148576,
       "over_8k_per_1000_calls": 46.60850428358091,
       "cap_hits_per_1000_calls": 17.579711284026303,
       "t_first_iso": "2026-10-03T13:29:57-07:00",
       "t_last_iso": "2026-10-03T22:51:27-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 16,
       "episodes": 500,
       "timeouts": 10,
       "zero_other": 0,
       "instances": 490,
       "first_timeouts": 9,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 38696,
       "completion_sum": 42087228,
       "over_8k": 983,
       "cap_hits": 317,
       "length_finish": 317,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 17,
       "attempts_without_snapshot": 1,
       "units_first_attempt_without_snapshot": 1,
       "t_first": 1791060592.023,
       "t_last": 1791083786.505,
       "timeouts_per_100_episodes": 2.0,
       "first_timeouts_per_100_instances": 1.836734693877551,
       "completion_per_call": 1087.6376886499897,
       "over_8k_per_1000_calls": 25.403142443663427,
       "cap_hits_per_1000_calls": 8.192061194955551,
       "t_first_iso": "2026-10-03T13:49:52-07:00",
       "t_last_iso": "2026-10-03T20:16:26-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 21,
       "episodes": 520,
       "timeouts": 20,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 16,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 39608,
       "completion_sum": 59045371,
       "over_8k": 1647,
       "cap_hits": 628,
       "length_finish": 628,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1791061598.519,
       "t_last": 1791093253.334,
       "timeouts_per_100_episodes": 3.8461538461538463,
       "first_timeouts_per_100_instances": 3.2,
       "completion_per_call": 1490.7435619066855,
       "over_8k_per_1000_calls": 41.58250858412442,
       "cap_hits_per_1000_calls": 15.855382750959402,
       "t_first_iso": "2026-10-03T14:06:38-07:00",
       "t_last_iso": "2026-10-03T22:54:13-07:00"
      }
     }
    },
    "fp8kv_s1_sxs": {
     "units": 24,
     "attempts": 66,
     "episodes": 1593,
     "timeouts": 90,
     "zero_other": 1,
     "instances": 1500,
     "first_timeouts": 63,
     "counted_zero": 8,
     "counted_timeouts": 8,
     "calls": 120178,
     "completion_sum": 198806899,
     "over_8k": 5973,
     "cap_hits": 1442,
     "length_finish": 1441,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 66,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792969576.423,
     "t_last": 1793196058.522,
     "timeouts_per_100_episodes": 5.649717514124294,
     "first_timeouts_per_100_instances": 4.2,
     "completion_per_call": 1654.2703240193712,
     "over_8k_per_1000_calls": 49.701276439947414,
     "cap_hits_per_1000_calls": 11.998868345287823,
     "t_first_iso": "2026-10-25T16:06:16-07:00",
     "t_last_iso": "2026-10-28T07:00:58-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 26,
       "episodes": 551,
       "timeouts": 44,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 31,
       "counted_zero": 3,
       "counted_timeouts": 3,
       "calls": 41768,
       "completion_sum": 78073841,
       "over_8k": 2569,
       "cap_hits": 638,
       "length_finish": 637,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 26,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793026512.643,
       "t_last": 1793195917.656,
       "timeouts_per_100_episodes": 7.985480943738657,
       "first_timeouts_per_100_instances": 6.2,
       "completion_per_call": 1869.2262258188086,
       "over_8k_per_1000_calls": 61.50641639532657,
       "cap_hits_per_1000_calls": 15.27485156100364,
       "t_first_iso": "2026-10-26T07:55:12-07:00",
       "t_last_iso": "2026-10-28T06:58:37-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 19,
       "episodes": 510,
       "timeouts": 10,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 8,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37968,
       "completion_sum": 51342664,
       "over_8k": 1299,
       "cap_hits": 295,
       "length_finish": 295,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987407.177,
       "t_last": 1793193425.932,
       "timeouts_per_100_episodes": 1.9607843137254901,
       "first_timeouts_per_100_instances": 1.6,
       "completion_per_call": 1352.2614833544037,
       "over_8k_per_1000_calls": 34.213021491782555,
       "cap_hits_per_1000_calls": 7.769700800674252,
       "t_first_iso": "2026-10-25T21:03:27-07:00",
       "t_last_iso": "2026-10-28T06:17:05-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 21,
       "episodes": 532,
       "timeouts": 36,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 24,
       "counted_zero": 5,
       "counted_timeouts": 5,
       "calls": 40442,
       "completion_sum": 69390394,
       "over_8k": 2105,
       "cap_hits": 509,
       "length_finish": 509,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 21,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792969576.423,
       "t_last": 1793196058.522,
       "timeouts_per_100_episodes": 6.7669172932330826,
       "first_timeouts_per_100_instances": 4.8,
       "completion_per_call": 1715.8002571583997,
       "over_8k_per_1000_calls": 52.04984916670788,
       "cap_hits_per_1000_calls": 12.585925522971168,
       "t_first_iso": "2026-10-25T16:06:16-07:00",
       "t_last_iso": "2026-10-28T07:00:58-07:00"
      }
     }
    },
    "fp8kv_s1": {
     "units": 24,
     "attempts": 55,
     "episodes": 1541,
     "timeouts": 39,
     "zero_other": 0,
     "instances": 1500,
     "first_timeouts": 30,
     "counted_zero": 3,
     "counted_timeouts": 3,
     "calls": 110428,
     "completion_sum": 150641932,
     "over_8k": 3731,
     "cap_hits": 795,
     "length_finish": 795,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 55,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792678641.624,
     "t_last": 1792721420.93,
     "timeouts_per_100_episodes": 2.5308241401687215,
     "first_timeouts_per_100_instances": 2.0,
     "completion_per_call": 1364.1642699315391,
     "over_8k_per_1000_calls": 33.786720759227734,
     "cap_hits_per_1000_calls": 7.199261056978303,
     "t_first_iso": "2026-10-22T07:17:21-07:00",
     "t_last_iso": "2026-10-22T19:10:20-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 22,
       "episodes": 523,
       "timeouts": 23,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 16,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 36744,
       "completion_sum": 58149172,
       "over_8k": 1625,
       "cap_hits": 342,
       "length_finish": 342,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792678641.624,
       "t_last": 1792713437.611,
       "timeouts_per_100_episodes": 4.397705544933078,
       "first_timeouts_per_100_instances": 3.2,
       "completion_per_call": 1582.548769867189,
       "over_8k_per_1000_calls": 44.22490746788591,
       "cap_hits_per_1000_calls": 9.30764206401045,
       "t_first_iso": "2026-10-22T07:17:21-07:00",
       "t_last_iso": "2026-10-22T16:57:17-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 14,
       "episodes": 506,
       "timeouts": 6,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 6,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37072,
       "completion_sum": 38500898,
       "over_8k": 676,
       "cap_hits": 141,
       "length_finish": 141,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 14,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792684415.333,
       "t_last": 1792704650.673,
       "timeouts_per_100_episodes": 1.1857707509881423,
       "first_timeouts_per_100_instances": 1.2,
       "completion_per_call": 1038.5438605955978,
       "over_8k_per_1000_calls": 18.23478636167458,
       "cap_hits_per_1000_calls": 3.8034095813552007,
       "t_first_iso": "2026-10-22T08:53:35-07:00",
       "t_last_iso": "2026-10-22T14:30:50-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 19,
       "episodes": 512,
       "timeouts": 10,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 8,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 36612,
       "completion_sum": 53991862,
       "over_8k": 1430,
       "cap_hits": 312,
       "length_finish": 312,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792684419.162,
       "t_last": 1792721420.93,
       "timeouts_per_100_episodes": 1.953125,
       "first_timeouts_per_100_instances": 1.6,
       "completion_per_call": 1474.703976838195,
       "over_8k_per_1000_calls": 39.058232273571505,
       "cap_hits_per_1000_calls": 8.521796132415602,
       "t_first_iso": "2026-10-22T08:53:39-07:00",
       "t_last_iso": "2026-10-22T19:10:20-07:00"
      }
     }
    },
    "blasst_t50_s1_sxs": {
     "units": 24,
     "attempts": 67,
     "episodes": 1583,
     "timeouts": 75,
     "zero_other": 9,
     "instances": 1500,
     "first_timeouts": 52,
     "counted_zero": 7,
     "counted_timeouts": 7,
     "calls": 119325,
     "completion_sum": 191171776,
     "over_8k": 5472,
     "cap_hits": 1348,
     "length_finish": 1348,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 67,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792968887.868,
     "t_last": 1793198497.992,
     "timeouts_per_100_episodes": 4.737839545167404,
     "first_timeouts_per_100_instances": 3.466666666666667,
     "completion_per_call": 1602.1100020951183,
     "over_8k_per_1000_calls": 45.85795097423004,
     "cap_hits_per_1000_calls": 11.29687827362246,
     "t_first_iso": "2026-10-25T15:54:47-07:00",
     "t_last_iso": "2026-10-28T07:41:37-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 545,
       "timeouts": 39,
       "zero_other": 8,
       "instances": 500,
       "first_timeouts": 27,
       "counted_zero": 4,
       "counted_timeouts": 4,
       "calls": 41040,
       "completion_sum": 72459592,
       "over_8k": 2223,
       "cap_hits": 506,
       "length_finish": 506,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1793028135.819,
       "t_last": 1793192559.004,
       "timeouts_per_100_episodes": 7.155963302752293,
       "first_timeouts_per_100_instances": 5.4,
       "completion_per_call": 1765.5846003898635,
       "over_8k_per_1000_calls": 54.166666666666664,
       "cap_hits_per_1000_calls": 12.329434697855751,
       "t_first_iso": "2026-10-26T08:22:15-07:00",
       "t_last_iso": "2026-10-28T06:02:39-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 19,
       "episodes": 512,
       "timeouts": 13,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 9,
       "counted_zero": 1,
       "counted_timeouts": 1,
       "calls": 38433,
       "completion_sum": 52047901,
       "over_8k": 1311,
       "cap_hits": 349,
       "length_finish": 349,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 19,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792987679.166,
       "t_last": 1793198497.992,
       "timeouts_per_100_episodes": 2.5390625,
       "first_timeouts_per_100_instances": 1.8,
       "completion_per_call": 1354.250279707543,
       "over_8k_per_1000_calls": 34.1113105924596,
       "cap_hits_per_1000_calls": 9.080737907527386,
       "t_first_iso": "2026-10-25T21:07:59-07:00",
       "t_last_iso": "2026-10-28T07:41:37-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 24,
       "episodes": 526,
       "timeouts": 23,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 16,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 39852,
       "completion_sum": 66664283,
       "over_8k": 1938,
       "cap_hits": 493,
       "length_finish": 493,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792968887.868,
       "t_last": 1793195799.534,
       "timeouts_per_100_episodes": 4.3726235741444865,
       "first_timeouts_per_100_instances": 3.2,
       "completion_per_call": 1672.7964217605138,
       "over_8k_per_1000_calls": 48.629930743751885,
       "cap_hits_per_1000_calls": 12.370771855866707,
       "t_first_iso": "2026-10-25T15:54:47-07:00",
       "t_last_iso": "2026-10-28T06:56:39-07:00"
      }
     }
    },
    "blasst_t50_s1": {
     "units": 24,
     "attempts": 62,
     "episodes": 1571,
     "timeouts": 62,
     "zero_other": 3,
     "instances": 1500,
     "first_timeouts": 46,
     "counted_zero": 4,
     "counted_timeouts": 4,
     "calls": 113660,
     "completion_sum": 161997368,
     "over_8k": 4239,
     "cap_hits": 936,
     "length_finish": 936,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 62,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792678745.153,
     "t_last": 1792713982.355,
     "timeouts_per_100_episodes": 3.9465308720560155,
     "first_timeouts_per_100_instances": 3.066666666666667,
     "completion_per_call": 1425.2803800809431,
     "over_8k_per_1000_calls": 37.295442547950024,
     "cap_hits_per_1000_calls": 8.235087101882808,
     "t_first_iso": "2026-10-22T07:19:05-07:00",
     "t_last_iso": "2026-10-22T17:06:22-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 22,
       "episodes": 532,
       "timeouts": 26,
       "zero_other": 3,
       "instances": 500,
       "first_timeouts": 19,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 37795,
       "completion_sum": 61568578,
       "over_8k": 1755,
       "cap_hits": 396,
       "length_finish": 396,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792678745.153,
       "t_last": 1792711899.304,
       "timeouts_per_100_episodes": 4.887218045112782,
       "first_timeouts_per_100_instances": 3.8,
       "completion_per_call": 1629.013837809234,
       "over_8k_per_1000_calls": 46.434713586453235,
       "cap_hits_per_1000_calls": 10.477576398994575,
       "t_first_iso": "2026-10-22T07:19:05-07:00",
       "t_last_iso": "2026-10-22T16:31:39-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 18,
       "episodes": 512,
       "timeouts": 10,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 9,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 37403,
       "completion_sum": 41615085,
       "over_8k": 874,
       "cap_hits": 192,
       "length_finish": 192,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 18,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792680631.876,
       "t_last": 1792706094.091,
       "timeouts_per_100_episodes": 1.953125,
       "first_timeouts_per_100_instances": 1.8,
       "completion_per_call": 1112.6135604095928,
       "over_8k_per_1000_calls": 23.36710959013983,
       "cap_hits_per_1000_calls": 5.133278079298452,
       "t_first_iso": "2026-10-22T07:50:31-07:00",
       "t_last_iso": "2026-10-22T14:54:54-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 22,
       "episodes": 527,
       "timeouts": 26,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 18,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 38462,
       "completion_sum": 58813705,
       "over_8k": 1610,
       "cap_hits": 348,
       "length_finish": 348,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792680634.166,
       "t_last": 1792713982.355,
       "timeouts_per_100_episodes": 4.933586337760911,
       "first_timeouts_per_100_instances": 3.6,
       "completion_per_call": 1529.1379803442358,
       "over_8k_per_1000_calls": 41.859497686027765,
       "cap_hits_per_1000_calls": 9.047891425302897,
       "t_first_iso": "2026-10-22T07:50:34-07:00",
       "t_last_iso": "2026-10-22T17:06:22-07:00"
      }
     }
    },
    "dense_s1d": {
     "units": 24,
     "attempts": 61,
     "episodes": 1553,
     "timeouts": 49,
     "zero_other": 1,
     "instances": 1500,
     "first_timeouts": 32,
     "counted_zero": 6,
     "counted_timeouts": 6,
     "calls": 112111,
     "completion_sum": 154551358,
     "over_8k": 3963,
     "cap_hits": 960,
     "length_finish": 959,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "bad_lines": 0,
     "attempts_listed": 61,
     "attempts_without_snapshot": 0,
     "units_first_attempt_without_snapshot": 0,
     "t_first": 1792680686.026,
     "t_last": 1792713436.49,
     "timeouts_per_100_episodes": 3.1551835157759176,
     "first_timeouts_per_100_instances": 2.1333333333333333,
     "completion_per_call": 1378.556591235472,
     "over_8k_per_1000_calls": 35.34889529127383,
     "cap_hits_per_1000_calls": 8.562942084184424,
     "t_first_iso": "2026-10-22T07:51:26-07:00",
     "t_last_iso": "2026-10-22T16:57:16-07:00",
     "seeds": {
      "42": {
       "units": 8,
       "attempts": 24,
       "episodes": 519,
       "timeouts": 22,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 13,
       "counted_zero": 4,
       "counted_timeouts": 4,
       "calls": 37139,
       "completion_sum": 57503459,
       "over_8k": 1567,
       "cap_hits": 390,
       "length_finish": 390,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 24,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792680686.026,
       "t_last": 1792712578.353,
       "timeouts_per_100_episodes": 4.238921001926783,
       "first_timeouts_per_100_instances": 2.6,
       "completion_per_call": 1548.3308382024288,
       "over_8k_per_1000_calls": 42.192843102937616,
       "cap_hits_per_1000_calls": 10.501090497859392,
       "t_first_iso": "2026-10-22T07:51:26-07:00",
       "t_last_iso": "2026-10-22T16:42:58-07:00"
      },
      "43": {
       "units": 8,
       "attempts": 15,
       "episodes": 508,
       "timeouts": 5,
       "zero_other": 1,
       "instances": 500,
       "first_timeouts": 5,
       "counted_zero": 0,
       "counted_timeouts": 0,
       "calls": 36939,
       "completion_sum": 39803656,
       "over_8k": 782,
       "cap_hits": 153,
       "length_finish": 153,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 15,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792680818.764,
       "t_last": 1792705687.86,
       "timeouts_per_100_episodes": 0.984251968503937,
       "first_timeouts_per_100_instances": 1.0,
       "completion_per_call": 1077.5509894691247,
       "over_8k_per_1000_calls": 21.170037088172393,
       "cap_hits_per_1000_calls": 4.141963778120686,
       "t_first_iso": "2026-10-22T07:53:38-07:00",
       "t_last_iso": "2026-10-22T14:48:07-07:00"
      },
      "44": {
       "units": 8,
       "attempts": 22,
       "episodes": 526,
       "timeouts": 22,
       "zero_other": 0,
       "instances": 500,
       "first_timeouts": 14,
       "counted_zero": 2,
       "counted_timeouts": 2,
       "calls": 38033,
       "completion_sum": 57244243,
       "over_8k": 1614,
       "cap_hits": 417,
       "length_finish": 416,
       "non200": 0,
       "excluded_episodes": 0,
       "excluded_calls": 0,
       "bad_lines": 0,
       "attempts_listed": 22,
       "attempts_without_snapshot": 0,
       "units_first_attempt_without_snapshot": 0,
       "t_first": 1792681328.697,
       "t_last": 1792713436.49,
       "timeouts_per_100_episodes": 4.182509505703422,
       "first_timeouts_per_100_instances": 2.8,
       "completion_per_call": 1505.1203691531039,
       "over_8k_per_1000_calls": 42.43683117292877,
       "cap_hits_per_1000_calls": 10.964162700812452,
       "t_first_iso": "2026-10-22T08:02:08-07:00",
       "t_last_iso": "2026-10-22T16:57:16-07:00"
      }
     }
    }
   },
   "units": [
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293510_0",
      "293510_1",
      "299850_0",
      "307823_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 73,
     "timeouts": 11,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 7,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5252,
     "completion_sum": 11580655,
     "over_8k": 440,
     "cap_hits": 140,
     "length_finish": 140,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028039.34,
     "t_last": 1793191875.596,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.068493150684931,
     "first_timeouts_per_100_instances": 11.11111111111111,
     "completion_per_call": 2204.999047981721,
     "over_8k_per_1000_calls": 83.77760853008378,
     "cap_hits_per_1000_calls": 26.656511805026657,
     "t_first_iso": "2026-10-26T08:20:39-07:00",
     "t_last_iso": "2026-10-28T05:51:15-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293554_0",
      "293554_1",
      "301387_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 70,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5666,
     "completion_sum": 10732711,
     "over_8k": 328,
     "cap_hits": 78,
     "length_finish": 78,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793059864.349,
     "t_last": 1793157534.093,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.0,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 1894.2306741969644,
     "over_8k_per_1000_calls": 57.88916343099188,
     "cap_hits_per_1000_calls": 13.766325450052948,
     "t_first_iso": "2026-10-26T17:11:04-07:00",
     "t_last_iso": "2026-10-27T20:18:54-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293706_0",
      "293706_1",
      "305373_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4768,
     "completion_sum": 8947731,
     "over_8k": 278,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114329.852,
     "t_last": 1793185010.619,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1876.6214345637584,
     "over_8k_per_1000_calls": 58.30536912751678,
     "cap_hits_per_1000_calls": 12.583892617449665,
     "t_first_iso": "2026-10-27T08:18:49-07:00",
     "t_last_iso": "2026-10-28T03:56:50-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293635_0",
      "293635_1",
      "303009_0",
      "308246_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5558,
     "completion_sum": 9512626,
     "over_8k": 260,
     "cap_hits": 59,
     "length_finish": 59,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087333.575,
     "t_last": 1793194456.586,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1711.5196113709967,
     "over_8k_per_1000_calls": 46.77941705649514,
     "cap_hits_per_1000_calls": 10.615329255127744,
     "t_first_iso": "2026-10-27T00:48:53-07:00",
     "t_last_iso": "2026-10-28T06:34:16-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293542_0",
      "293542_1",
      "300388_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5121,
     "completion_sum": 7900166,
     "over_8k": 198,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793035091.553,
     "t_last": 1793155164.294,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1542.6998633079477,
     "over_8k_per_1000_calls": 38.66432337434095,
     "cap_hits_per_1000_calls": 5.4676820933411445,
     "t_first_iso": "2026-10-26T10:18:11-07:00",
     "t_last_iso": "2026-10-27T19:39:24-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293747_0",
      "293747_1",
      "306737_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4578,
     "completion_sum": 8135785,
     "over_8k": 255,
     "cap_hits": 65,
     "length_finish": 65,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117302.382,
     "t_last": 1793188188.39,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1777.1483180428133,
     "over_8k_per_1000_calls": 55.70117955439056,
     "cap_hits_per_1000_calls": 14.198339886413281,
     "t_first_iso": "2026-10-27T09:08:22-07:00",
     "t_last_iso": "2026-10-28T04:49:48-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293686_0",
      "293686_1",
      "305642_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 5,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 6010,
     "completion_sum": 10249693,
     "over_8k": 295,
     "cap_hits": 62,
     "length_finish": 62,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113105.962,
     "t_last": 1793188460.539,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.294117647058824,
     "first_timeouts_per_100_instances": 8.064516129032258,
     "completion_per_call": 1705.4397670549085,
     "over_8k_per_1000_calls": 49.08485856905158,
     "cap_hits_per_1000_calls": 10.316139767054908,
     "t_first_iso": "2026-10-27T07:58:25-07:00",
     "t_last_iso": "2026-10-28T04:54:20-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293608_0",
      "293608_1",
      "302881_0",
      "307954_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4679,
     "completion_sum": 8938282,
     "over_8k": 299,
     "cap_hits": 104,
     "length_finish": 104,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082040.258,
     "t_last": 1793189539.127,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1910.297499465698,
     "over_8k_per_1000_calls": 63.902543278478305,
     "cap_hits_per_1000_calls": 22.22697157512289,
     "t_first_iso": "2026-10-26T23:20:40-07:00",
     "t_last_iso": "2026-10-28T05:12:19-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293500_0",
      "293500_1",
      "299452_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4585,
     "completion_sum": 6800713,
     "over_8k": 183,
     "cap_hits": 65,
     "length_finish": 65,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025666.686,
     "t_last": 1793156072.79,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1483.252562704471,
     "over_8k_per_1000_calls": 39.91275899672846,
     "cap_hits_per_1000_calls": 14.176663031624864,
     "t_first_iso": "2026-10-26T07:41:06-07:00",
     "t_last_iso": "2026-10-27T19:54:32-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293521_0",
      "293521_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4893,
     "completion_sum": 6993528,
     "over_8k": 162,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793030697.416,
     "t_last": 1793054159.195,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1429.292458614347,
     "over_8k_per_1000_calls": 33.108522378908646,
     "cap_hits_per_1000_calls": 8.992438176987534,
     "t_first_iso": "2026-10-26T09:04:57-07:00",
     "t_last_iso": "2026-10-26T15:35:59-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293596_0",
      "293596_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4429,
     "completion_sum": 6481342,
     "over_8k": 179,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081514.404,
     "t_last": 1793106795.905,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1463.3872205915557,
     "over_8k_per_1000_calls": 40.41544366674193,
     "cap_hits_per_1000_calls": 9.031384059607134,
     "t_first_iso": "2026-10-26T23:11:54-07:00",
     "t_last_iso": "2026-10-27T06:13:15-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293561_0",
      "293561_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5144,
     "completion_sum": 6450545,
     "over_8k": 145,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065534.172,
     "t_last": 1793081799.069,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1253.9939735614307,
     "over_8k_per_1000_calls": 28.188180404354586,
     "cap_hits_per_1000_calls": 5.637636080870918,
     "t_first_iso": "2026-10-26T18:45:34-07:00",
     "t_last_iso": "2026-10-26T23:16:39-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293576_0",
      "301577_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4621,
     "completion_sum": 6062224,
     "over_8k": 123,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793071007.627,
     "t_last": 1793154690.025,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1311.8857390175287,
     "over_8k_per_1000_calls": 26.61761523479766,
     "cap_hits_per_1000_calls": 3.6788573901752866,
     "t_first_iso": "2026-10-26T20:16:47-07:00",
     "t_last_iso": "2026-10-27T19:31:30-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293617_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4121,
     "completion_sum": 4958188,
     "over_8k": 95,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793084224.596,
     "t_last": 1793095883.269,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1203.1516622179083,
     "over_8k_per_1000_calls": 23.052657122057752,
     "cap_hits_per_1000_calls": 2.911914583838874,
     "t_first_iso": "2026-10-26T23:57:04-07:00",
     "t_last_iso": "2026-10-27T03:11:23-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293482_0",
      "293482_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5315,
     "completion_sum": 6319993,
     "over_8k": 139,
     "cap_hits": 23,
     "length_finish": 23,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987653.625,
     "t_last": 1793027786.918,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1189.0861712135465,
     "over_8k_per_1000_calls": 26.152398871119473,
     "cap_hits_per_1000_calls": 4.327375352775165,
     "t_first_iso": "2026-10-25T21:07:33-07:00",
     "t_last_iso": "2026-10-26T08:16:26-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293769_0",
      "293769_1",
      "308249_0",
      "310398_0",
      "310677_0"
     ],
     "units": 1,
     "attempts": 5,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5023,
     "completion_sum": 8655402,
     "over_8k": 295,
     "cap_hits": 118,
     "length_finish": 118,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793142438.749,
     "t_last": 1793204504.124,
     "attempts_listed": 5,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1723.1538920963567,
     "over_8k_per_1000_calls": 58.72984272347203,
     "cap_hits_per_1000_calls": 23.491937089388813,
     "t_first_iso": "2026-10-27T16:07:18-07:00",
     "t_last_iso": "2026-10-28T09:21:44-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293671_0",
      "293671_1",
      "304976_0",
      "308506_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5406,
     "completion_sum": 10023742,
     "over_8k": 343,
     "cap_hits": 79,
     "length_finish": 79,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110922.023,
     "t_last": 1793195450.411,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1854.1883092859784,
     "over_8k_per_1000_calls": 63.44802071772105,
     "cap_hits_per_1000_calls": 14.61339252682205,
     "t_first_iso": "2026-10-27T07:22:02-07:00",
     "t_last_iso": "2026-10-28T06:50:50-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293653_0",
      "293653_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4648,
     "completion_sum": 7125062,
     "over_8k": 168,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108342.373,
     "t_last": 1793128532.338,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1532.9307228915663,
     "over_8k_per_1000_calls": 36.144578313253014,
     "cap_hits_per_1000_calls": 9.46643717728055,
     "t_first_iso": "2026-10-27T06:39:02-07:00",
     "t_last_iso": "2026-10-27T12:15:32-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293699_0",
      "293699_1",
      "305154_0",
      "308728_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4828,
     "completion_sum": 9229421,
     "over_8k": 308,
     "cap_hits": 78,
     "length_finish": 78,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113581.362,
     "t_last": 1793196008.311,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1911.6447804473903,
     "over_8k_per_1000_calls": 63.79453189726595,
     "cap_hits_per_1000_calls": 16.15575807787904,
     "t_first_iso": "2026-10-27T08:06:21-07:00",
     "t_last_iso": "2026-10-28T07:00:08-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293782_0",
      "293782_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5010,
     "completion_sum": 6596560,
     "over_8k": 147,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150214.678,
     "t_last": 1793168755.089,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1316.678642714571,
     "over_8k_per_1000_calls": 29.34131736526946,
     "cap_hits_per_1000_calls": 3.992015968063872,
     "t_first_iso": "2026-10-27T18:16:54-07:00",
     "t_last_iso": "2026-10-27T23:25:55-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "286983_0",
      "286983_1",
      "293448_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4849,
     "completion_sum": 7823273,
     "over_8k": 228,
     "cap_hits": 49,
     "length_finish": 49,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792862356.851,
     "t_last": 1792967764.963,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1613.3786347700557,
     "over_8k_per_1000_calls": 47.020004124561765,
     "cap_hits_per_1000_calls": 10.105176325015467,
     "t_first_iso": "2026-10-24T10:19:16-07:00",
     "t_last_iso": "2026-10-25T15:36:04-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293473_0",
      "293473_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4408,
     "completion_sum": 7153684,
     "over_8k": 206,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987230.01,
     "t_last": 1793027554.019,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1622.8865698729583,
     "over_8k_per_1000_calls": 46.73321234119782,
     "cap_hits_per_1000_calls": 7.259528130671506,
     "t_first_iso": "2026-10-25T21:00:30-07:00",
     "t_last_iso": "2026-10-26T08:12:34-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293735_0",
      "293735_1",
      "306107_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5875,
     "completion_sum": 8087742,
     "over_8k": 202,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116460.139,
     "t_last": 1793190429.974,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1376.6369361702127,
     "over_8k_per_1000_calls": 34.38297872340426,
     "cap_hits_per_1000_calls": 7.148936170212766,
     "t_first_iso": "2026-10-27T08:54:20-07:00",
     "t_last_iso": "2026-10-28T05:27:09-07:00"
    },
    {
     "arm": "dense_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293715_0",
      "293715_1",
      "305644_0",
      "310110_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4724,
     "completion_sum": 8427533,
     "over_8k": 283,
     "cap_hits": 84,
     "length_finish": 84,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114443.978,
     "t_last": 1793197240.563,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1783.9824301439457,
     "over_8k_per_1000_calls": 59.90685859441152,
     "cap_hits_per_1000_calls": 17.781541066892466,
     "t_first_iso": "2026-10-27T08:20:43-07:00",
     "t_last_iso": "2026-10-28T07:20:40-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "103109_0",
      "107875_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4346,
     "completion_sum": 5676628,
     "over_8k": 120,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901109.124,
     "t_last": 1790916311.099,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1306.173032673723,
     "over_8k_per_1000_calls": 27.611596870685688,
     "cap_hits_per_1000_calls": 4.1417395306028535,
     "t_first_iso": "2026-10-01T17:31:49-07:00",
     "t_last_iso": "2026-10-01T21:45:11-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "103110_0",
      "107872_0",
      "108809_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4889,
     "completion_sum": 6503243,
     "over_8k": 156,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901098.127,
     "t_last": 1790921557.148,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1330.1785641235426,
     "over_8k_per_1000_calls": 31.908365718960933,
     "cap_hits_per_1000_calls": 6.749846594395582,
     "t_first_iso": "2026-10-01T17:31:38-07:00",
     "t_last_iso": "2026-10-01T23:12:37-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "103111_0",
      "103111_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4421,
     "completion_sum": 6159107,
     "over_8k": 168,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901094.737,
     "t_last": 1790917594.321,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1393.1479303325038,
     "over_8k_per_1000_calls": 38.00045238633793,
     "cap_hits_per_1000_calls": 6.107215562090025,
     "t_first_iso": "2026-10-01T17:31:34-07:00",
     "t_last_iso": "2026-10-01T22:06:34-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "103112_0",
      "107970_0",
      "109003_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4963,
     "completion_sum": 7216835,
     "over_8k": 219,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901092.126,
     "t_last": 1790924891.061,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1454.1275438243,
     "over_8k_per_1000_calls": 44.12653636913157,
     "cap_hits_per_1000_calls": 12.089462018940157,
     "t_first_iso": "2026-10-01T17:31:32-07:00",
     "t_last_iso": "2026-10-02T00:08:11-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "103194_0",
      "103194_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4490,
     "completion_sum": 5209294,
     "over_8k": 91,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901772.42,
     "t_last": 1790916463.486,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1160.199109131403,
     "over_8k_per_1000_calls": 20.267260579064587,
     "cap_hits_per_1000_calls": 1.1135857461024499,
     "t_first_iso": "2026-10-01T17:42:52-07:00",
     "t_last_iso": "2026-10-01T21:47:43-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "103195_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4238,
     "completion_sum": 5059410,
     "over_8k": 96,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901838.594,
     "t_last": 1790912807.847,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1193.8201982067012,
     "over_8k_per_1000_calls": 22.652194431335534,
     "cap_hits_per_1000_calls": 4.483246814535158,
     "t_first_iso": "2026-10-01T17:43:58-07:00",
     "t_last_iso": "2026-10-01T20:46:47-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "103196_0",
      "103196_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5206,
     "completion_sum": 6540354,
     "over_8k": 135,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901828.961,
     "t_last": 1790920230.912,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1256.310795236266,
     "over_8k_per_1000_calls": 25.93161736457933,
     "cap_hits_per_1000_calls": 3.2654629273914715,
     "t_first_iso": "2026-10-01T17:43:48-07:00",
     "t_last_iso": "2026-10-01T22:50:30-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "103197_0",
      "103197_1",
      "109433_0",
      "110460_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4645,
     "completion_sum": 7265797,
     "over_8k": 223,
     "cap_hits": 89,
     "length_finish": 89,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901827.907,
     "t_last": 1790932836.404,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1564.2189451022605,
     "over_8k_per_1000_calls": 48.008611410118405,
     "cap_hits_per_1000_calls": 19.16038751345533,
     "t_first_iso": "2026-10-01T17:43:47-07:00",
     "t_last_iso": "2026-10-02T02:20:36-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "103113_0",
      "107973_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4479,
     "completion_sum": 4196980,
     "over_8k": 79,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901098.982,
     "t_last": 1790917874.129,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 937.0350524670686,
     "over_8k_per_1000_calls": 17.637865594998885,
     "cap_hits_per_1000_calls": 5.35833891493637,
     "t_first_iso": "2026-10-01T17:31:38-07:00",
     "t_last_iso": "2026-10-01T22:11:14-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "103114_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4862,
     "completion_sum": 4397237,
     "over_8k": 82,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901105.494,
     "t_last": 1790910899.146,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 904.4090909090909,
     "over_8k_per_1000_calls": 16.865487453722746,
     "cap_hits_per_1000_calls": 2.262443438914027,
     "t_first_iso": "2026-10-01T17:31:45-07:00",
     "t_last_iso": "2026-10-01T20:14:59-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "103115_0",
      "107974_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4781,
     "completion_sum": 4536803,
     "over_8k": 80,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901110.47,
     "t_last": 1790914420.427,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 948.9234469776197,
     "over_8k_per_1000_calls": 16.732901066722444,
     "cap_hits_per_1000_calls": 1.4641288433382138,
     "t_first_iso": "2026-10-01T17:31:50-07:00",
     "t_last_iso": "2026-10-01T21:13:40-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "103116_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5276,
     "completion_sum": 3764688,
     "over_8k": 44,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901101.534,
     "t_last": 1790911132.128,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 713.5496588324488,
     "over_8k_per_1000_calls": 8.339651250947687,
     "cap_hits_per_1000_calls": 0.7581501137225171,
     "t_first_iso": "2026-10-01T17:31:41-07:00",
     "t_last_iso": "2026-10-01T20:18:52-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "103198_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4356,
     "completion_sum": 3575393,
     "over_8k": 44,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902489.866,
     "t_last": 1790912486.381,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 820.7972910927456,
     "over_8k_per_1000_calls": 10.1010101010101,
     "cap_hits_per_1000_calls": 0.9182736455463728,
     "t_first_iso": "2026-10-01T17:54:49-07:00",
     "t_last_iso": "2026-10-01T20:41:26-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "103199_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4154,
     "completion_sum": 3163867,
     "over_8k": 42,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901952.608,
     "t_last": 1790910028.804,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 761.6434761675494,
     "over_8k_per_1000_calls": 10.110736639383726,
     "cap_hits_per_1000_calls": 0.9629272989889264,
     "t_first_iso": "2026-10-01T17:45:52-07:00",
     "t_last_iso": "2026-10-01T20:00:28-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "103201_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5192,
     "completion_sum": 4274903,
     "over_8k": 67,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901938.98,
     "t_last": 1790914599.34,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 823.3634437596302,
     "over_8k_per_1000_calls": 12.90446841294299,
     "cap_hits_per_1000_calls": 1.926040061633282,
     "t_first_iso": "2026-10-01T17:45:38-07:00",
     "t_last_iso": "2026-10-01T21:16:39-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "103202_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4331,
     "completion_sum": 3684367,
     "over_8k": 57,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902042.742,
     "t_last": 1790910878.245,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 850.6966058646964,
     "over_8k_per_1000_calls": 13.160932809974602,
     "cap_hits_per_1000_calls": 1.8471484645578389,
     "t_first_iso": "2026-10-01T17:47:22-07:00",
     "t_last_iso": "2026-10-01T20:14:38-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "103117_0",
      "103117_1",
      "109272_0",
      "110411_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4995,
     "completion_sum": 7886188,
     "over_8k": 246,
     "cap_hits": 64,
     "length_finish": 64,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901103.565,
     "t_last": 1790932365.598,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1578.8164164164164,
     "over_8k_per_1000_calls": 49.249249249249246,
     "cap_hits_per_1000_calls": 12.812812812812814,
     "t_first_iso": "2026-10-01T17:31:43-07:00",
     "t_last_iso": "2026-10-02T02:12:45-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "103118_0",
      "108004_0",
      "109081_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4929,
     "completion_sum": 6498448,
     "over_8k": 147,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901085.968,
     "t_last": 1790923566.113,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1318.4110367214446,
     "over_8k_per_1000_calls": 29.82349360925137,
     "cap_hits_per_1000_calls": 5.883546358287685,
     "t_first_iso": "2026-10-01T17:31:25-07:00",
     "t_last_iso": "2026-10-01T23:46:06-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "103119_0",
      "103119_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4721,
     "completion_sum": 7192938,
     "over_8k": 201,
     "cap_hits": 47,
     "length_finish": 47,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902106.987,
     "t_last": 1790919274.325,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1523.6047447574667,
     "over_8k_per_1000_calls": 42.57572548188943,
     "cap_hits_per_1000_calls": 9.955517898750264,
     "t_first_iso": "2026-10-01T17:48:26-07:00",
     "t_last_iso": "2026-10-01T22:34:34-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "103120_0",
      "108005_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5009,
     "completion_sum": 6183237,
     "over_8k": 145,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790901136.634,
     "t_last": 1790917684.587,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1234.425434218407,
     "over_8k_per_1000_calls": 28.947893791175883,
     "cap_hits_per_1000_calls": 5.190656817728089,
     "t_first_iso": "2026-10-01T17:32:16-07:00",
     "t_last_iso": "2026-10-01T22:08:04-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "103203_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4528,
     "completion_sum": 5344094,
     "over_8k": 83,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902020.13,
     "t_last": 1790914340.432,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1180.23277385159,
     "over_8k_per_1000_calls": 18.330388692579504,
     "cap_hits_per_1000_calls": 1.5459363957597174,
     "t_first_iso": "2026-10-01T17:47:00-07:00",
     "t_last_iso": "2026-10-01T21:12:20-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "103204_0",
      "108050_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3874,
     "completion_sum": 4997765,
     "over_8k": 125,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902009.436,
     "t_last": 1790916526.099,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1290.0787299948374,
     "over_8k_per_1000_calls": 32.266391326794015,
     "cap_hits_per_1000_calls": 6.969540526587506,
     "t_first_iso": "2026-10-01T17:46:49-07:00",
     "t_last_iso": "2026-10-01T21:48:46-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "103205_0",
      "103205_1",
      "109434_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5813,
     "completion_sum": 7322042,
     "over_8k": 133,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902012.774,
     "t_last": 1790926815.401,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.575757575757576,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1259.5977980388784,
     "over_8k_per_1000_calls": 22.879752279373818,
     "cap_hits_per_1000_calls": 2.0643385515224497,
     "t_first_iso": "2026-10-01T17:46:52-07:00",
     "t_last_iso": "2026-10-02T00:40:15-07:00"
    },
    {
     "arm": "dense_s1",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "103206_0",
      "103206_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4506,
     "completion_sum": 5633776,
     "over_8k": 129,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790902047.315,
     "t_last": 1790918639.397,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1250.2831779849091,
     "over_8k_per_1000_calls": 28.62849533954727,
     "cap_hits_per_1000_calls": 3.1069684864624945,
     "t_first_iso": "2026-10-01T17:47:27-07:00",
     "t_last_iso": "2026-10-01T22:23:59-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293507_0",
      "293507_1",
      "299569_0",
      "307820_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4730,
     "completion_sum": 9356694,
     "over_8k": 326,
     "cap_hits": 129,
     "length_finish": 129,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793027540.031,
     "t_last": 1793191808.383,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1978.1594080338266,
     "over_8k_per_1000_calls": 68.92177589852008,
     "cap_hits_per_1000_calls": 27.272727272727273,
     "t_first_iso": "2026-10-26T08:12:20-07:00",
     "t_last_iso": "2026-10-28T05:50:08-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293549_0",
      "293549_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4878,
     "completion_sum": 7674334,
     "over_8k": 198,
     "cap_hits": 36,
     "length_finish": 36,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793057521.066,
     "t_last": 1793078952.867,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1573.2542025420255,
     "over_8k_per_1000_calls": 40.59040590405904,
     "cap_hits_per_1000_calls": 7.380073800738008,
     "t_first_iso": "2026-10-26T16:32:01-07:00",
     "t_last_iso": "2026-10-26T22:29:12-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293708_0",
      "293708_1",
      "305847_0",
      "310182_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 70,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5499,
     "completion_sum": 12551412,
     "over_8k": 450,
     "cap_hits": 121,
     "length_finish": 121,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114321.019,
     "t_last": 1793197917.903,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.0,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 2282.4899072558646,
     "over_8k_per_1000_calls": 81.83306055646482,
     "cap_hits_per_1000_calls": 22.004000727404982,
     "t_first_iso": "2026-10-27T08:18:41-07:00",
     "t_last_iso": "2026-10-28T07:31:57-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293634_0",
      "293634_1",
      "303008_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4887,
     "completion_sum": 8257745,
     "over_8k": 270,
     "cap_hits": 57,
     "length_finish": 57,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087372.444,
     "t_last": 1793161988.902,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1689.7370574994884,
     "over_8k_per_1000_calls": 55.248618784530386,
     "cap_hits_per_1000_calls": 11.663597298956415,
     "t_first_iso": "2026-10-27T00:49:32-07:00",
     "t_last_iso": "2026-10-27T21:33:08-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293539_0",
      "293539_1",
      "300236_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4972,
     "completion_sum": 7748862,
     "over_8k": 178,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793034449.49,
     "t_last": 1793156475.108,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1558.5,
     "over_8k_per_1000_calls": 35.80048270313757,
     "cap_hits_per_1000_calls": 3.6202735317779564,
     "t_first_iso": "2026-10-26T10:07:29-07:00",
     "t_last_iso": "2026-10-27T20:01:15-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293743_0",
      "293743_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4138,
     "completion_sum": 6905793,
     "over_8k": 193,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117063.579,
     "t_last": 1793143204.589,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1668.8721604639923,
     "over_8k_per_1000_calls": 46.640889318511356,
     "cap_hits_per_1000_calls": 8.941517641372643,
     "t_first_iso": "2026-10-27T09:04:23-07:00",
     "t_last_iso": "2026-10-27T16:20:04-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293679_0",
      "293679_1",
      "305152_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 1,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5599,
     "completion_sum": 8560724,
     "over_8k": 214,
     "cap_hits": 31,
     "length_finish": 31,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113133.899,
     "t_last": 1793163313.462,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1528.9737453116627,
     "over_8k_per_1000_calls": 38.22111091266297,
     "cap_hits_per_1000_calls": 5.536702982675478,
     "t_first_iso": "2026-10-27T07:58:53-07:00",
     "t_last_iso": "2026-10-27T21:55:13-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293602_0",
      "293602_1",
      "302849_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4927,
     "completion_sum": 10017477,
     "over_8k": 351,
     "cap_hits": 95,
     "length_finish": 95,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081920.439,
     "t_last": 1793159519.769,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 2033.1798254515932,
     "over_8k_per_1000_calls": 71.2401055408971,
     "cap_hits_per_1000_calls": 19.28151004668155,
     "t_first_iso": "2026-10-26T23:18:40-07:00",
     "t_last_iso": "2026-10-27T20:51:59-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293497_0",
      "293497_1",
      "299358_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4995,
     "completion_sum": 7665059,
     "over_8k": 215,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025568.476,
     "t_last": 1793154522.404,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1534.5463463463464,
     "over_8k_per_1000_calls": 43.04304304304304,
     "cap_hits_per_1000_calls": 10.21021021021021,
     "t_first_iso": "2026-10-26T07:39:28-07:00",
     "t_last_iso": "2026-10-27T19:28:42-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293529_0",
      "293529_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5215,
     "completion_sum": 7424584,
     "over_8k": 185,
     "cap_hits": 50,
     "length_finish": 50,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031619.729,
     "t_last": 1793055542.452,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1423.697794822627,
     "over_8k_per_1000_calls": 35.47459252157239,
     "cap_hits_per_1000_calls": 9.587727708533079,
     "t_first_iso": "2026-10-26T09:20:19-07:00",
     "t_last_iso": "2026-10-26T15:59:02-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293590_0",
      "293590_1",
      "302726_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5200,
     "completion_sum": 7903066,
     "over_8k": 233,
     "cap_hits": 64,
     "length_finish": 64,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079572.521,
     "t_last": 1793158747.49,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1519.8203846153847,
     "over_8k_per_1000_calls": 44.80769230769231,
     "cap_hits_per_1000_calls": 12.307692307692308,
     "t_first_iso": "2026-10-26T22:39:32-07:00",
     "t_last_iso": "2026-10-27T20:39:07-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293571_0",
      "293571_1",
      "301831_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5269,
     "completion_sum": 7148281,
     "over_8k": 177,
     "cap_hits": 45,
     "length_finish": 45,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793068748.71,
     "t_last": 1793154605.739,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1356.6674890871134,
     "over_8k_per_1000_calls": 33.592712089580566,
     "cap_hits_per_1000_calls": 8.54052002277472,
     "t_first_iso": "2026-10-26T19:39:08-07:00",
     "t_last_iso": "2026-10-27T19:30:05-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293585_0",
      "293585_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4758,
     "completion_sum": 5979430,
     "over_8k": 119,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079044.663,
     "t_last": 1793102873.595,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1256.7108028583439,
     "over_8k_per_1000_calls": 25.010508617065994,
     "cap_hits_per_1000_calls": 3.9932744850777637,
     "t_first_iso": "2026-10-26T22:30:44-07:00",
     "t_last_iso": "2026-10-27T05:07:53-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293620_0",
      "302424_0",
      "307957_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4407,
     "completion_sum": 6544992,
     "over_8k": 177,
     "cap_hits": 50,
     "length_finish": 50,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086411.569,
     "t_last": 1793188745.338,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1485.135466303608,
     "over_8k_per_1000_calls": 40.16337644656229,
     "cap_hits_per_1000_calls": 11.345586566825505,
     "t_first_iso": "2026-10-27T00:33:31-07:00",
     "t_last_iso": "2026-10-28T04:59:05-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293479_0",
      "293479_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5213,
     "completion_sum": 6318603,
     "over_8k": 126,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987508.763,
     "t_last": 1793025949.87,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1212.0857471705351,
     "over_8k_per_1000_calls": 24.170343372338383,
     "cap_hits_per_1000_calls": 5.3711874160751965,
     "t_first_iso": "2026-10-25T21:05:08-07:00",
     "t_last_iso": "2026-10-26T07:45:49-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293757_0",
      "293757_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5055,
     "completion_sum": 7484563,
     "over_8k": 205,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119151.942,
     "t_last": 1793146505.485,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1480.6257171117704,
     "over_8k_per_1000_calls": 40.553907022749755,
     "cap_hits_per_1000_calls": 11.869436201780415,
     "t_first_iso": "2026-10-27T09:39:11-07:00",
     "t_last_iso": "2026-10-27T17:15:05-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293661_0",
      "293661_1",
      "304969_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5274,
     "completion_sum": 9268600,
     "over_8k": 288,
     "cap_hits": 58,
     "length_finish": 58,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110055.532,
     "t_last": 1793162767.044,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.352941176470588,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1757.413727720895,
     "over_8k_per_1000_calls": 54.60750853242321,
     "cap_hits_per_1000_calls": 10.99734546833523,
     "t_first_iso": "2026-10-27T07:07:35-07:00",
     "t_last_iso": "2026-10-27T21:46:07-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293656_0",
      "293656_1",
      "304885_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5223,
     "completion_sum": 9474048,
     "over_8k": 302,
     "cap_hits": 91,
     "length_finish": 91,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108566.677,
     "t_last": 1793162909.293,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.695652173913043,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1813.9092475588743,
     "over_8k_per_1000_calls": 57.821175569596015,
     "cap_hits_per_1000_calls": 17.42293700938158,
     "t_first_iso": "2026-10-27T06:42:46-07:00",
     "t_last_iso": "2026-10-27T21:48:29-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293689_0",
      "293689_1",
      "305425_0",
      "310101_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 8,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5462,
     "completion_sum": 11341002,
     "over_8k": 411,
     "cap_hits": 105,
     "length_finish": 105,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113336.33,
     "t_last": 1793197085.341,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.267605633802816,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 2076.346027096302,
     "over_8k_per_1000_calls": 75.24716221164408,
     "cap_hits_per_1000_calls": 19.22372757231783,
     "t_first_iso": "2026-10-27T08:02:16-07:00",
     "t_last_iso": "2026-10-28T07:18:05-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293772_0",
      "293772_1",
      "308251_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5191,
     "completion_sum": 7995911,
     "over_8k": 208,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793143934.179,
     "t_last": 1793193777.133,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1540.3411674051242,
     "over_8k_per_1000_calls": 40.06935079946061,
     "cap_hits_per_1000_calls": 9.246773261413987,
     "t_first_iso": "2026-10-27T16:32:14-07:00",
     "t_last_iso": "2026-10-28T06:22:57-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "290065_1",
      "293449_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 46,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 45,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3411,
     "completion_sum": 4972020,
     "over_8k": 113,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [
      "286984_0",
      "286984_1"
     ],
     "setasides_without_snapshot": [
      "286984_0",
      "286984_1"
     ],
     "bad_lines": 0,
     "t_first": 1792931451.015,
     "t_last": 1792968180.591,
     "attempts_listed": 3,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "290065_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 2.1739130434782608,
     "first_timeouts_per_100_instances": 2.2222222222222223,
     "completion_per_call": 1457.6429199648196,
     "over_8k_per_1000_calls": 33.128114922310175,
     "cap_hits_per_1000_calls": 3.5180299032541775,
     "t_first_iso": "2026-10-25T05:30:51-07:00",
     "t_last_iso": "2026-10-25T15:43:00-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293474_0",
      "293474_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4413,
     "completion_sum": 6629165,
     "over_8k": 189,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987294.544,
     "t_last": 1793024913.632,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1502.1901200997054,
     "over_8k_per_1000_calls": 42.82800815771584,
     "cap_hits_per_1000_calls": 7.93111262179923,
     "t_first_iso": "2026-10-25T21:01:34-07:00",
     "t_last_iso": "2026-10-26T07:28:33-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293734_0",
      "293734_1",
      "305959_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5981,
     "completion_sum": 9792453,
     "over_8k": 292,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116291.557,
     "t_last": 1793191192.413,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1637.2601571643538,
     "over_8k_per_1000_calls": 48.82126734659756,
     "cap_hits_per_1000_calls": 8.527002173549574,
     "t_first_iso": "2026-10-27T08:51:31-07:00",
     "t_last_iso": "2026-10-28T05:39:52-07:00"
    },
    {
     "arm": "jqs_f_dense_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293722_0",
      "293722_1",
      "305789_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4585,
     "completion_sum": 8366474,
     "over_8k": 286,
     "cap_hits": 77,
     "length_finish": 77,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115336.439,
     "t_last": 1793189798.218,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1824.7489640130862,
     "over_8k_per_1000_calls": 62.3773173391494,
     "cap_hits_per_1000_calls": 16.793893129770993,
     "t_first_iso": "2026-10-27T08:35:36-07:00",
     "t_last_iso": "2026-10-28T05:16:38-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "112731_0",
      "112731_1",
      "115810_0",
      "116785_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5075,
     "completion_sum": 8405855,
     "over_8k": 243,
     "cap_hits": 72,
     "length_finish": 72,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943357.319,
     "t_last": 1790974244.912,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.294117647058824,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1656.3261083743841,
     "over_8k_per_1000_calls": 47.881773399014776,
     "cap_hits_per_1000_calls": 14.187192118226601,
     "t_first_iso": "2026-10-02T05:15:57-07:00",
     "t_last_iso": "2026-10-02T13:50:44-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "112732_0",
      "115277_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4939,
     "completion_sum": 6803189,
     "over_8k": 172,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943341.591,
     "t_last": 1790962776.776,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1377.4425997165417,
     "over_8k_per_1000_calls": 34.82486333265843,
     "cap_hits_per_1000_calls": 6.4790443409597085,
     "t_first_iso": "2026-10-02T05:15:41-07:00",
     "t_last_iso": "2026-10-02T10:39:36-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "112733_0",
      "112733_1",
      "115814_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4737,
     "completion_sum": 7714846,
     "over_8k": 229,
     "cap_hits": 50,
     "length_finish": 50,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943339.233,
     "t_last": 1790966136.631,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1628.635423263669,
     "over_8k_per_1000_calls": 48.34283301667722,
     "cap_hits_per_1000_calls": 10.555203715431707,
     "t_first_iso": "2026-10-02T05:15:39-07:00",
     "t_last_iso": "2026-10-02T11:35:36-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "112734_0",
      "115303_0",
      "116177_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5294,
     "completion_sum": 6965476,
     "over_8k": 173,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943337.825,
     "t_last": 1790970633.198,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1315.7302606724593,
     "over_8k_per_1000_calls": 32.67850396675482,
     "cap_hits_per_1000_calls": 5.289006422364942,
     "t_first_iso": "2026-10-02T05:15:37-07:00",
     "t_last_iso": "2026-10-02T12:50:33-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "113119_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4202,
     "completion_sum": 4898688,
     "over_8k": 94,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950196.985,
     "t_last": 1790961681.488,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1165.7991432651118,
     "over_8k_per_1000_calls": 22.370299857210853,
     "cap_hits_per_1000_calls": 3.569728700618753,
     "t_first_iso": "2026-10-02T07:09:56-07:00",
     "t_last_iso": "2026-10-02T10:21:21-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "113120_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3823,
     "completion_sum": 4277484,
     "over_8k": 79,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950194.598,
     "t_last": 1790959081.123,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1118.8815066701543,
     "over_8k_per_1000_calls": 20.664399686110386,
     "cap_hits_per_1000_calls": 2.0925974365681403,
     "t_first_iso": "2026-10-02T07:09:54-07:00",
     "t_last_iso": "2026-10-02T09:38:01-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "113121_0",
      "113121_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5460,
     "completion_sum": 6713110,
     "over_8k": 132,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950239.28,
     "t_last": 1790966857.915,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1229.507326007326,
     "over_8k_per_1000_calls": 24.175824175824175,
     "cap_hits_per_1000_calls": 5.4945054945054945,
     "t_first_iso": "2026-10-02T07:10:39-07:00",
     "t_last_iso": "2026-10-02T11:47:37-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "113122_0",
      "113122_1",
      "117066_0",
      "117770_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4775,
     "completion_sum": 8241409,
     "over_8k": 263,
     "cap_hits": 87,
     "length_finish": 87,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950207.329,
     "t_last": 1790980980.838,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1725.9495287958116,
     "over_8k_per_1000_calls": 55.07853403141361,
     "cap_hits_per_1000_calls": 18.219895287958114,
     "t_first_iso": "2026-10-02T07:10:07-07:00",
     "t_last_iso": "2026-10-02T15:43:00-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "112735_0",
      "112735_1",
      "115815_0",
      "116786_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5149,
     "completion_sum": 5990319,
     "over_8k": 158,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943345.471,
     "t_last": 1790974323.593,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1163.3946397358711,
     "over_8k_per_1000_calls": 30.685570013594873,
     "cap_hits_per_1000_calls": 10.293260827345115,
     "t_first_iso": "2026-10-02T05:15:45-07:00",
     "t_last_iso": "2026-10-02T13:52:03-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "112736_0",
      "115017_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5202,
     "completion_sum": 4557196,
     "over_8k": 78,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943366.89,
     "t_last": 1790955119.174,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 876.0469050365244,
     "over_8k_per_1000_calls": 14.994232987312571,
     "cap_hits_per_1000_calls": 2.6912725874663592,
     "t_first_iso": "2026-10-02T05:16:06-07:00",
     "t_last_iso": "2026-10-02T08:31:59-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "112737_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4703,
     "completion_sum": 3949794,
     "over_8k": 57,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943321.911,
     "t_last": 1790954180.931,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 839.8456304486498,
     "over_8k_per_1000_calls": 12.119923453115033,
     "cap_hits_per_1000_calls": 0.637890708058686,
     "t_first_iso": "2026-10-02T05:15:21-07:00",
     "t_last_iso": "2026-10-02T08:16:20-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "112738_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5392,
     "completion_sum": 4346841,
     "over_8k": 69,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943366.358,
     "t_last": 1790953851.352,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 806.1648738872403,
     "over_8k_per_1000_calls": 12.79673590504451,
     "cap_hits_per_1000_calls": 0.9272997032640949,
     "t_first_iso": "2026-10-02T05:16:06-07:00",
     "t_last_iso": "2026-10-02T08:10:51-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "113123_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4545,
     "completion_sum": 3781015,
     "over_8k": 54,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950223.446,
     "t_last": 1790961410.499,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 831.906490649065,
     "over_8k_per_1000_calls": 11.881188118811881,
     "cap_hits_per_1000_calls": 0.8800880088008801,
     "t_first_iso": "2026-10-02T07:10:23-07:00",
     "t_last_iso": "2026-10-02T10:16:50-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "113124_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3932,
     "completion_sum": 2666006,
     "over_8k": 27,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950207.557,
     "t_last": 1790956874.595,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 678.0279755849441,
     "over_8k_per_1000_calls": 6.866734486266531,
     "cap_hits_per_1000_calls": 1.2716174974567651,
     "t_first_iso": "2026-10-02T07:10:07-07:00",
     "t_last_iso": "2026-10-02T09:01:14-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "113125_0",
      "115726_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5790,
     "completion_sum": 5686083,
     "over_8k": 111,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950212.138,
     "t_last": 1790966210.214,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 982.0523316062176,
     "over_8k_per_1000_calls": 19.17098445595855,
     "cap_hits_per_1000_calls": 2.936096718480138,
     "t_first_iso": "2026-10-02T07:10:12-07:00",
     "t_last_iso": "2026-10-02T11:36:50-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "113126_0",
      "115816_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4950,
     "completion_sum": 5311881,
     "over_8k": 97,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950246.668,
     "t_last": 1790964478.548,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1073.1072727272726,
     "over_8k_per_1000_calls": 19.595959595959595,
     "cap_hits_per_1000_calls": 4.040404040404041,
     "t_first_iso": "2026-10-02T07:10:46-07:00",
     "t_last_iso": "2026-10-02T11:07:58-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "112739_0",
      "112739_1",
      "115811_0",
      "116787_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 9,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5525,
     "completion_sum": 9925914,
     "over_8k": 318,
     "cap_hits": 109,
     "length_finish": 109,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943344.436,
     "t_last": 1790974262.758,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.67605633802817,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1796.5455203619908,
     "over_8k_per_1000_calls": 57.55656108597285,
     "cap_hits_per_1000_calls": 19.728506787330318,
     "t_first_iso": "2026-10-02T05:15:44-07:00",
     "t_last_iso": "2026-10-02T13:51:02-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "112740_0",
      "112740_1",
      "115817_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5272,
     "completion_sum": 7216263,
     "over_8k": 194,
     "cap_hits": 41,
     "length_finish": 41,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943348.291,
     "t_last": 1790967691.346,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1368.790402124431,
     "over_8k_per_1000_calls": 36.798179059180576,
     "cap_hits_per_1000_calls": 7.776934749620637,
     "t_first_iso": "2026-10-02T05:15:48-07:00",
     "t_last_iso": "2026-10-02T12:01:31-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "112741_0",
      "112741_1",
      "115891_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5220,
     "completion_sum": 8382662,
     "over_8k": 261,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943355.46,
     "t_last": 1790967185.983,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1605.8739463601532,
     "over_8k_per_1000_calls": 50.0,
     "cap_hits_per_1000_calls": 8.42911877394636,
     "t_first_iso": "2026-10-02T05:15:55-07:00",
     "t_last_iso": "2026-10-02T11:53:05-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "112742_0",
      "112742_1",
      "115888_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5608,
     "completion_sum": 8318980,
     "over_8k": 244,
     "cap_hits": 59,
     "length_finish": 59,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943357.463,
     "t_last": 1790968588.164,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.352941176470588,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1483.4129814550643,
     "over_8k_per_1000_calls": 43.509272467902996,
     "cap_hits_per_1000_calls": 10.520684736091297,
     "t_first_iso": "2026-10-02T05:15:57-07:00",
     "t_last_iso": "2026-10-02T12:16:28-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "113127_0",
      "113127_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4717,
     "completion_sum": 6253593,
     "over_8k": 120,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950225.394,
     "t_last": 1790967589.813,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1325.756412974348,
     "over_8k_per_1000_calls": 25.43989824040704,
     "cap_hits_per_1000_calls": 2.967988128047488,
     "t_first_iso": "2026-10-02T07:10:25-07:00",
     "t_last_iso": "2026-10-02T11:59:49-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "113128_0",
      "113128_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4205,
     "completion_sum": 5595558,
     "over_8k": 143,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950224.799,
     "t_last": 1790968802.065,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1330.6915576694412,
     "over_8k_per_1000_calls": 34.00713436385256,
     "cap_hits_per_1000_calls": 4.9940546967895365,
     "t_first_iso": "2026-10-02T07:10:24-07:00",
     "t_last_iso": "2026-10-02T12:20:02-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "113129_0",
      "113129_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5742,
     "completion_sum": 6801640,
     "over_8k": 111,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950187.365,
     "t_last": 1790968018.828,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1184.5419714385232,
     "over_8k_per_1000_calls": 19.331243469174503,
     "cap_hits_per_1000_calls": 2.264019505398816,
     "t_first_iso": "2026-10-02T07:09:47-07:00",
     "t_last_iso": "2026-10-02T12:06:58-07:00"
    },
    {
     "arm": "jqs_f_dense",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "113130_0",
      "113130_1",
      "117067_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4761,
     "completion_sum": 6680181,
     "over_8k": 179,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950193.919,
     "t_last": 1790972279.661,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1403.104599873976,
     "over_8k_per_1000_calls": 37.59714345725688,
     "cap_hits_per_1000_calls": 7.7714765805503045,
     "t_first_iso": "2026-10-02T07:09:53-07:00",
     "t_last_iso": "2026-10-02T13:17:59-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293511_0",
      "293511_1",
      "299757_0",
      "307824_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4819,
     "completion_sum": 7910092,
     "over_8k": 227,
     "cap_hits": 87,
     "length_finish": 87,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028064.466,
     "t_last": 1793191781.749,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1641.438472712181,
     "over_8k_per_1000_calls": 47.10520854949159,
     "cap_hits_per_1000_calls": 18.05353807843951,
     "t_first_iso": "2026-10-26T08:21:04-07:00",
     "t_last_iso": "2026-10-28T05:49:41-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293558_0",
      "301162_0",
      "307893_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5147,
     "completion_sum": 7642740,
     "over_8k": 191,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065116.397,
     "t_last": 1793192735.313,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1484.8921701962308,
     "over_8k_per_1000_calls": 37.1089955313775,
     "cap_hits_per_1000_calls": 9.32582086652419,
     "t_first_iso": "2026-10-26T18:38:36-07:00",
     "t_last_iso": "2026-10-28T06:05:35-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293709_0",
      "293709_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4529,
     "completion_sum": 6685504,
     "over_8k": 168,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114430.845,
     "t_last": 1793135628.505,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1476.1545595054097,
     "over_8k_per_1000_calls": 37.09428129829985,
     "cap_hits_per_1000_calls": 9.715168911459484,
     "t_first_iso": "2026-10-27T08:20:30-07:00",
     "t_last_iso": "2026-10-27T14:13:48-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293639_0",
      "293639_1",
      "303069_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5026,
     "completion_sum": 6529329,
     "over_8k": 137,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087581.988,
     "t_last": 1793162650.741,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1299.1104257859133,
     "over_8k_per_1000_calls": 27.258257063270992,
     "cap_hits_per_1000_calls": 6.7648229208117785,
     "t_first_iso": "2026-10-27T00:53:01-07:00",
     "t_last_iso": "2026-10-27T21:44:10-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293541_0",
      "293541_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4864,
     "completion_sum": 6800333,
     "over_8k": 123,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793034976.325,
     "t_last": 1793059242.356,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1398.0947779605262,
     "over_8k_per_1000_calls": 25.28782894736842,
     "cap_hits_per_1000_calls": 5.550986842105263,
     "t_first_iso": "2026-10-26T10:16:16-07:00",
     "t_last_iso": "2026-10-26T17:00:42-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293754_0",
      "304886_0",
      "308375_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4442,
     "completion_sum": 6403770,
     "over_8k": 161,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119102.518,
     "t_last": 1793192179.89,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1441.6411526339486,
     "over_8k_per_1000_calls": 36.24493471409275,
     "cap_hits_per_1000_calls": 9.45520036019811,
     "t_first_iso": "2026-10-27T09:38:22-07:00",
     "t_last_iso": "2026-10-28T05:56:19-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293683_0",
      "293683_1",
      "305052_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5636,
     "completion_sum": 7422372,
     "over_8k": 167,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113138.973,
     "t_last": 1793162575.067,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1316.957416607523,
     "over_8k_per_1000_calls": 29.63094393186657,
     "cap_hits_per_1000_calls": 4.790631653655074,
     "t_first_iso": "2026-10-27T07:58:58-07:00",
     "t_last_iso": "2026-10-27T21:42:55-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293607_0",
      "293607_1",
      "302880_0",
      "307953_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4870,
     "completion_sum": 8033655,
     "over_8k": 232,
     "cap_hits": 84,
     "length_finish": 84,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081990.001,
     "t_last": 1793188920.987,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1649.6211498973305,
     "over_8k_per_1000_calls": 47.63860369609856,
     "cap_hits_per_1000_calls": 17.248459958932237,
     "t_first_iso": "2026-10-26T23:19:50-07:00",
     "t_last_iso": "2026-10-28T05:02:00-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293499_0",
      "293499_1",
      "299412_0",
      "307772_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4573,
     "completion_sum": 5908232,
     "over_8k": 140,
     "cap_hits": 64,
     "length_finish": 64,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025685.233,
     "t_last": 1793190867.989,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1291.9816313142358,
     "over_8k_per_1000_calls": 30.614476273780888,
     "cap_hits_per_1000_calls": 13.995189153728406,
     "t_first_iso": "2026-10-26T07:41:25-07:00",
     "t_last_iso": "2026-10-28T05:34:27-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293522_0",
      "299040_0",
      "307830_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5193,
     "completion_sum": 5912767,
     "over_8k": 104,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793030759.266,
     "t_last": 1793192658.997,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1138.6033121509724,
     "over_8k_per_1000_calls": 20.026959368380513,
     "cap_hits_per_1000_calls": 5.7770075101097635,
     "t_first_iso": "2026-10-26T09:05:59-07:00",
     "t_last_iso": "2026-10-28T06:04:18-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293600_0",
      "302175_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4778,
     "completion_sum": 5995367,
     "over_8k": 140,
     "cap_hits": 31,
     "length_finish": 31,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081908.228,
     "t_last": 1793156283.506,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1254.7858936793637,
     "over_8k_per_1000_calls": 29.300962745918795,
     "cap_hits_per_1000_calls": 6.48807032231059,
     "t_first_iso": "2026-10-26T23:18:28-07:00",
     "t_last_iso": "2026-10-27T19:58:03-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293569_0",
      "301271_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4991,
     "completion_sum": 4936827,
     "over_8k": 75,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793067571.163,
     "t_last": 1793155544.51,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 989.1458625525946,
     "over_8k_per_1000_calls": 15.027048687637748,
     "cap_hits_per_1000_calls": 2.604688439190543,
     "t_first_iso": "2026-10-26T19:19:31-07:00",
     "t_last_iso": "2026-10-27T19:45:44-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293580_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4373,
     "completion_sum": 4234139,
     "over_8k": 65,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793077668.772,
     "t_last": 1793088183.718,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 968.2458266636177,
     "over_8k_per_1000_calls": 14.863937800137206,
     "cap_hits_per_1000_calls": 2.744111593871484,
     "t_first_iso": "2026-10-26T22:07:48-07:00",
     "t_last_iso": "2026-10-27T01:03:03-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293623_0",
      "302211_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4192,
     "completion_sum": 4409694,
     "over_8k": 67,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [
      "293623_0"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086515.344,
     "t_last": 1793156245.292,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1051.930820610687,
     "over_8k_per_1000_calls": 15.982824427480915,
     "cap_hits_per_1000_calls": 2.8625954198473282,
     "t_first_iso": "2026-10-27T00:35:15-07:00",
     "t_last_iso": "2026-10-27T19:57:25-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293486_0",
      "293486_1",
      "298021_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5771,
     "completion_sum": 6514283,
     "over_8k": 105,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987651.795,
     "t_last": 1793156843.659,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1128.7962224917692,
     "over_8k_per_1000_calls": 18.194420377750824,
     "cap_hits_per_1000_calls": 4.158724657771617,
     "t_first_iso": "2026-10-25T21:07:31-07:00",
     "t_last_iso": "2026-10-27T20:07:23-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293761_0",
      "293761_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4293,
     "completion_sum": 5889949,
     "over_8k": 135,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793120082.34,
     "t_last": 1793146990.901,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1371.9890519450269,
     "over_8k_per_1000_calls": 31.446540880503143,
     "cap_hits_per_1000_calls": 10.249242953645469,
     "t_first_iso": "2026-10-27T09:54:42-07:00",
     "t_last_iso": "2026-10-27T17:23:10-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293672_0",
      "293672_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4377,
     "completion_sum": 5894253,
     "over_8k": 135,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793111024.956,
     "t_last": 1793129396.081,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1346.642220699109,
     "over_8k_per_1000_calls": 30.84304318026045,
     "cap_hits_per_1000_calls": 7.31094356865433,
     "t_first_iso": "2026-10-27T07:23:44-07:00",
     "t_last_iso": "2026-10-27T12:29:56-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293645_0",
      "302487_0",
      "307958_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5091,
     "completion_sum": 7071035,
     "over_8k": 176,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793088715.196,
     "t_last": 1793189762.172,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1388.928501276763,
     "over_8k_per_1000_calls": 34.57081123551365,
     "cap_hits_per_1000_calls": 9.428403064230995,
     "t_first_iso": "2026-10-27T01:11:55-07:00",
     "t_last_iso": "2026-10-28T05:16:02-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293693_0",
      "293693_1",
      "305153_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4805,
     "completion_sum": 8014975,
     "over_8k": 260,
     "cap_hits": 71,
     "length_finish": 71,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113499.512,
     "t_last": 1793166954.851,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1668.0489073881374,
     "over_8k_per_1000_calls": 54.11030176899064,
     "cap_hits_per_1000_calls": 14.77627471383975,
     "t_first_iso": "2026-10-27T08:04:59-07:00",
     "t_last_iso": "2026-10-27T22:55:54-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293773_0",
      "307536_0",
      "310289_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4852,
     "completion_sum": 6065821,
     "over_8k": 139,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793143905.934,
     "t_last": 1793194306.631,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1250.169208573784,
     "over_8k_per_1000_calls": 28.6479802143446,
     "cap_hits_per_1000_calls": 5.564715581203627,
     "t_first_iso": "2026-10-27T16:31:45-07:00",
     "t_last_iso": "2026-10-28T06:31:46-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293453_0",
      "293453_1",
      "295451_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4699,
     "completion_sum": 5764363,
     "over_8k": 105,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792968276.451,
     "t_last": 1793155862.118,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.6875,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1226.7212172802724,
     "over_8k_per_1000_calls": 22.345179825494785,
     "cap_hits_per_1000_calls": 3.404979782932539,
     "t_first_iso": "2026-10-25T15:44:36-07:00",
     "t_last_iso": "2026-10-27T19:51:02-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293467_0",
      "296210_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4016,
     "completion_sum": 4724262,
     "over_8k": 91,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792985177.386,
     "t_last": 1793153815.603,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1176.3600597609561,
     "over_8k_per_1000_calls": 22.659362549800797,
     "cap_hits_per_1000_calls": 4.9800796812749,
     "t_first_iso": "2026-10-25T20:26:17-07:00",
     "t_last_iso": "2026-10-27T19:16:55-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293736_0",
      "293736_1",
      "305960_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5483,
     "completion_sum": 6910972,
     "over_8k": 146,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116653.817,
     "t_last": 1793190050.959,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1260.4362575232537,
     "over_8k_per_1000_calls": 26.627758526354185,
     "cap_hits_per_1000_calls": 6.930512493160679,
     "t_first_iso": "2026-10-27T08:57:33-07:00",
     "t_last_iso": "2026-10-28T05:20:50-07:00"
    },
    {
     "arm": "jqs_f_r40_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293727_0",
      "293727_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4883,
     "completion_sum": 7256696,
     "over_8k": 203,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115359.749,
     "t_last": 1793138970.882,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1486.114274011878,
     "over_8k_per_1000_calls": 41.572803604341594,
     "cap_hits_per_1000_calls": 8.191685439279132,
     "t_first_iso": "2026-10-27T08:35:59-07:00",
     "t_last_iso": "2026-10-27T15:09:30-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "112743_0",
      "112743_1",
      "115892_0",
      "116861_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4198,
     "completion_sum": 5636320,
     "over_8k": 147,
     "cap_hits": 57,
     "length_finish": 57,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944230.15,
     "t_last": 1790974941.008,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1342.6202953787517,
     "over_8k_per_1000_calls": 35.016674606955696,
     "cap_hits_per_1000_calls": 13.577894235350167,
     "t_first_iso": "2026-10-02T05:30:30-07:00",
     "t_last_iso": "2026-10-02T14:02:21-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "112744_0",
      "115018_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4743,
     "completion_sum": 4961146,
     "over_8k": 79,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943331.347,
     "t_last": 1790956721.058,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1045.9932532152645,
     "over_8k_per_1000_calls": 16.656124815517604,
     "cap_hits_per_1000_calls": 2.5300442757748263,
     "t_first_iso": "2026-10-02T05:15:31-07:00",
     "t_last_iso": "2026-10-02T08:58:41-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "112745_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4264,
     "completion_sum": 4555151,
     "over_8k": 89,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943321.16,
     "t_last": 1790952664.341,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1068.281191369606,
     "over_8k_per_1000_calls": 20.872420262664164,
     "cap_hits_per_1000_calls": 3.75234521575985,
     "t_first_iso": "2026-10-02T05:15:21-07:00",
     "t_last_iso": "2026-10-02T07:51:04-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "112965_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4609,
     "completion_sum": 4046053,
     "over_8k": 60,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943964.196,
     "t_last": 1790954133.113,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 877.8591885441527,
     "over_8k_per_1000_calls": 13.018008244738555,
     "cap_hits_per_1000_calls": 2.603601648947711,
     "t_first_iso": "2026-10-02T05:26:04-07:00",
     "t_last_iso": "2026-10-02T08:15:33-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "113131_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3936,
     "completion_sum": 3896634,
     "over_8k": 48,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950220.28,
     "t_last": 1790961496.125,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 989.998475609756,
     "over_8k_per_1000_calls": 12.195121951219512,
     "cap_hits_per_1000_calls": 2.540650406504065,
     "t_first_iso": "2026-10-02T07:10:20-07:00",
     "t_last_iso": "2026-10-02T10:18:16-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "113132_0",
      "115649_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3974,
     "completion_sum": 4205446,
     "over_8k": 76,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950212.34,
     "t_last": 1790962702.056,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1058.2400603925516,
     "over_8k_per_1000_calls": 19.124308002013084,
     "cap_hits_per_1000_calls": 1.509813789632612,
     "t_first_iso": "2026-10-02T07:10:12-07:00",
     "t_last_iso": "2026-10-02T10:38:22-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "113133_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5001,
     "completion_sum": 4938737,
     "over_8k": 85,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950288.147,
     "t_last": 1790961903.969,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 987.5498900219956,
     "over_8k_per_1000_calls": 16.996600679864027,
     "cap_hits_per_1000_calls": 2.599480103979204,
     "t_first_iso": "2026-10-02T07:11:28-07:00",
     "t_last_iso": "2026-10-02T10:25:03-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "113134_0",
      "113134_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4325,
     "completion_sum": 5127882,
     "over_8k": 96,
     "cap_hits": 23,
     "length_finish": 23,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950279.774,
     "t_last": 1790967653.517,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1185.637456647399,
     "over_8k_per_1000_calls": 22.196531791907514,
     "cap_hits_per_1000_calls": 5.317919075144508,
     "t_first_iso": "2026-10-02T07:11:19-07:00",
     "t_last_iso": "2026-10-02T12:00:53-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "112966_0",
      "115221_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4589,
     "completion_sum": 3678371,
     "over_8k": 62,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943971.079,
     "t_last": 1790963442.868,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 801.5626498147744,
     "over_8k_per_1000_calls": 13.510568751361953,
     "cap_hits_per_1000_calls": 5.229897581172369,
     "t_first_iso": "2026-10-02T05:26:11-07:00",
     "t_last_iso": "2026-10-02T10:50:42-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "112967_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4490,
     "completion_sum": 2792001,
     "over_8k": 13,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943991.152,
     "t_last": 1790951604.278,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 621.8265033407572,
     "over_8k_per_1000_calls": 2.89532293986637,
     "cap_hits_per_1000_calls": 0.6681514476614699,
     "t_first_iso": "2026-10-02T05:26:31-07:00",
     "t_last_iso": "2026-10-02T07:33:24-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "112968_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4436,
     "completion_sum": 3555643,
     "over_8k": 57,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943976.904,
     "t_last": 1790952779.265,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 801.5426059513075,
     "over_8k_per_1000_calls": 12.84941388638413,
     "cap_hits_per_1000_calls": 2.0288548241659154,
     "t_first_iso": "2026-10-02T05:26:16-07:00",
     "t_last_iso": "2026-10-02T07:52:59-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "112969_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4957,
     "completion_sum": 3360054,
     "over_8k": 45,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943939.766,
     "t_last": 1790953918.419,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 677.8402259431108,
     "over_8k_per_1000_calls": 9.07807141416179,
     "cap_hits_per_1000_calls": 3.026023804720597,
     "t_first_iso": "2026-10-02T05:25:39-07:00",
     "t_last_iso": "2026-10-02T08:11:58-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "113135_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4253,
     "completion_sum": 2578760,
     "over_8k": 12,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950288.77,
     "t_last": 1790957600.132,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 606.3390547848577,
     "over_8k_per_1000_calls": 2.8215377380672466,
     "cap_hits_per_1000_calls": 0.7053844345168117,
     "t_first_iso": "2026-10-02T07:11:28-07:00",
     "t_last_iso": "2026-10-02T09:13:20-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "113136_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3720,
     "completion_sum": 2311012,
     "over_8k": 13,
     "cap_hits": 0,
     "length_finish": 0,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950236.211,
     "t_last": 1790956578.235,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 621.2397849462366,
     "over_8k_per_1000_calls": 3.4946236559139785,
     "cap_hits_per_1000_calls": 0.0,
     "t_first_iso": "2026-10-02T07:10:36-07:00",
     "t_last_iso": "2026-10-02T08:56:18-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "113137_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4861,
     "completion_sum": 3458822,
     "over_8k": 41,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950274.782,
     "t_last": 1790960188.089,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 711.5453610368237,
     "over_8k_per_1000_calls": 8.434478502365769,
     "cap_hits_per_1000_calls": 2.057189878625797,
     "t_first_iso": "2026-10-02T07:11:14-07:00",
     "t_last_iso": "2026-10-02T09:56:28-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "113138_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4307,
     "completion_sum": 3650116,
     "over_8k": 48,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950255.76,
     "t_last": 1790959453.919,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 847.4845600185744,
     "over_8k_per_1000_calls": 11.144648247039703,
     "cap_hits_per_1000_calls": 2.3218017181332713,
     "t_first_iso": "2026-10-02T07:10:55-07:00",
     "t_last_iso": "2026-10-02T09:44:13-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "112970_0",
      "115351_0",
      "116178_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4449,
     "completion_sum": 5622759,
     "over_8k": 140,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943984.732,
     "t_last": 1790970487.572,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1263.8253540121375,
     "over_8k_per_1000_calls": 31.46774556080018,
     "cap_hits_per_1000_calls": 11.463250168577208,
     "t_first_iso": "2026-10-02T05:26:24-07:00",
     "t_last_iso": "2026-10-02T12:48:07-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "112971_0",
      "115078_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4947,
     "completion_sum": 5447423,
     "over_8k": 99,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943946.6,
     "t_last": 1790958167.22,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1101.1568627450981,
     "over_8k_per_1000_calls": 20.012128562765312,
     "cap_hits_per_1000_calls": 2.6278552658176673,
     "t_first_iso": "2026-10-02T05:25:46-07:00",
     "t_last_iso": "2026-10-02T09:22:47-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "112972_0",
      "115304_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4357,
     "completion_sum": 5172095,
     "over_8k": 120,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790943984.911,
     "t_last": 1790962784.029,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1187.077117282534,
     "over_8k_per_1000_calls": 27.541886619233416,
     "cap_hits_per_1000_calls": 7.57401882028919,
     "t_first_iso": "2026-10-02T05:26:24-07:00",
     "t_last_iso": "2026-10-02T10:39:44-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "112973_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4749,
     "completion_sum": 4248402,
     "over_8k": 60,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949762.056,
     "t_last": 1790961975.926,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 894.5887555274795,
     "over_8k_per_1000_calls": 12.634238787113077,
     "cap_hits_per_1000_calls": 1.684565171615077,
     "t_first_iso": "2026-10-02T07:02:42-07:00",
     "t_last_iso": "2026-10-02T10:26:15-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "114988_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 50,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 50,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3595,
     "completion_sum": 3530185,
     "over_8k": 41,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790953761.438,
     "t_last": 1790962652.471,
     "attempts_listed": 3,
     "attempts_without_snapshot": 2,
     "attempt_tags_without_snapshot": [
      "113139_0",
      "113139_1"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 981.970792767733,
     "over_8k_per_1000_calls": 11.404728789986091,
     "cap_hits_per_1000_calls": 1.1126564673157162,
     "t_first_iso": "2026-10-02T08:09:21-07:00",
     "t_last_iso": "2026-10-02T10:37:32-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "113140_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3616,
     "completion_sum": 3165673,
     "over_8k": 43,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950319.074,
     "t_last": 1790958716.204,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 875.4626659292036,
     "over_8k_per_1000_calls": 11.891592920353983,
     "cap_hits_per_1000_calls": 1.1061946902654867,
     "t_first_iso": "2026-10-02T07:11:59-07:00",
     "t_last_iso": "2026-10-02T09:31:56-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "113141_0",
      "115812_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5387,
     "completion_sum": 5226231,
     "over_8k": 73,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950334.29,
     "t_last": 1790965621.889,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 970.1561165769444,
     "over_8k_per_1000_calls": 13.55114163727492,
     "cap_hits_per_1000_calls": 3.1557453127900503,
     "t_first_iso": "2026-10-02T07:12:14-07:00",
     "t_last_iso": "2026-10-02T11:27:01-07:00"
    },
    {
     "arm": "jqs_f_r40",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "113142_0",
      "113142_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4552,
     "completion_sum": 5336400,
     "over_8k": 93,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950329.586,
     "t_last": 1790968699.044,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1172.3198594024605,
     "over_8k_per_1000_calls": 20.430579964850615,
     "cap_hits_per_1000_calls": 3.9543057996485063,
     "t_first_iso": "2026-10-02T07:12:09-07:00",
     "t_last_iso": "2026-10-02T12:18:19-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293516_0",
      "293516_1",
      "299874_0",
      "307828_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4537,
     "completion_sum": 6803018,
     "over_8k": 191,
     "cap_hits": 55,
     "length_finish": 55,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028306.508,
     "t_last": 1793192283.282,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1499.4529424729997,
     "over_8k_per_1000_calls": 42.098302843288515,
     "cap_hits_per_1000_calls": 12.12254793916685,
     "t_first_iso": "2026-10-26T08:25:06-07:00",
     "t_last_iso": "2026-10-28T05:58:03-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293550_0",
      "293550_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4771,
     "completion_sum": 6745977,
     "over_8k": 137,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793057668.631,
     "t_last": 1793077092.793,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1413.954516872773,
     "over_8k_per_1000_calls": 28.715154055753512,
     "cap_hits_per_1000_calls": 4.611192622091805,
     "t_first_iso": "2026-10-26T16:34:28-07:00",
     "t_last_iso": "2026-10-26T21:58:12-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293712_0",
      "293712_1",
      "305520_0",
      "310102_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4656,
     "completion_sum": 7576043,
     "over_8k": 231,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114423.595,
     "t_last": 1793195589.04,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1627.157001718213,
     "over_8k_per_1000_calls": 49.61340206185567,
     "cap_hits_per_1000_calls": 6.8728522336769755,
     "t_first_iso": "2026-10-27T08:20:23-07:00",
     "t_last_iso": "2026-10-28T06:53:09-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293641_0",
      "302305_0",
      "308144_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 3,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4965,
     "completion_sum": 7027010,
     "over_8k": 177,
     "cap_hits": 46,
     "length_finish": 46,
     "non200": 1,
     "excluded_episodes": 1,
     "excluded_calls": 87,
     "setasides": [
      "293641_0"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087621.628,
     "t_last": 1793190489.862,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.477611940298507,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1415.3091641490432,
     "over_8k_per_1000_calls": 35.64954682779456,
     "cap_hits_per_1000_calls": 9.264853977844915,
     "t_first_iso": "2026-10-27T00:53:41-07:00",
     "t_last_iso": "2026-10-28T05:28:09-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293543_0",
      "293543_1",
      "300237_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4584,
     "completion_sum": 6358697,
     "over_8k": 143,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793035181.521,
     "t_last": 1793154087.944,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1387.1503054101222,
     "over_8k_per_1000_calls": 31.195462478184993,
     "cap_hits_per_1000_calls": 6.326352530541012,
     "t_first_iso": "2026-10-26T10:19:41-07:00",
     "t_last_iso": "2026-10-27T19:21:27-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293745_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3629,
     "completion_sum": 4147787,
     "over_8k": 61,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117221.525,
     "t_last": 1793128668.933,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1142.9559107192065,
     "over_8k_per_1000_calls": 16.80903830256269,
     "cap_hits_per_1000_calls": 3.306696059520529,
     "t_first_iso": "2026-10-27T09:07:01-07:00",
     "t_last_iso": "2026-10-27T12:17:48-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293673_0",
      "293673_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5027,
     "completion_sum": 6137419,
     "over_8k": 122,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793112545.81,
     "t_last": 1793130840.018,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1220.8909886612294,
     "over_8k_per_1000_calls": 24.268947682514423,
     "cap_hits_per_1000_calls": 3.7795902128506067,
     "t_first_iso": "2026-10-27T07:49:05-07:00",
     "t_last_iso": "2026-10-27T12:54:00-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293610_0",
      "293610_1",
      "302883_0",
      "307956_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4616,
     "completion_sum": 8064652,
     "over_8k": 248,
     "cap_hits": 95,
     "length_finish": 95,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082140.145,
     "t_last": 1793192790.285,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.575757575757576,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1747.1083188908146,
     "over_8k_per_1000_calls": 53.726169844020795,
     "cap_hits_per_1000_calls": 20.580589254766032,
     "t_first_iso": "2026-10-26T23:22:20-07:00",
     "t_last_iso": "2026-10-28T06:06:30-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293501_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4434,
     "completion_sum": 4678101,
     "over_8k": 82,
     "cap_hits": 23,
     "length_finish": 23,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025923.223,
     "t_last": 1793037216.697,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1055.052097428958,
     "over_8k_per_1000_calls": 18.493459630130808,
     "cap_hits_per_1000_calls": 5.187189896256202,
     "t_first_iso": "2026-10-26T07:45:23-07:00",
     "t_last_iso": "2026-10-26T10:53:36-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293523_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4575,
     "completion_sum": 4930072,
     "over_8k": 88,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793030747.301,
     "t_last": 1793041567.836,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1077.6113661202187,
     "over_8k_per_1000_calls": 19.23497267759563,
     "cap_hits_per_1000_calls": 2.622950819672131,
     "t_first_iso": "2026-10-26T09:05:47-07:00",
     "t_last_iso": "2026-10-26T12:06:07-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293592_0",
      "293592_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4539,
     "completion_sum": 5056263,
     "over_8k": 90,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079647.087,
     "t_last": 1793105142.976,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1113.9596827495043,
     "over_8k_per_1000_calls": 19.828155981493722,
     "cap_hits_per_1000_calls": 3.965631196298744,
     "t_first_iso": "2026-10-26T22:40:47-07:00",
     "t_last_iso": "2026-10-27T05:45:42-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293560_0",
      "293560_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4684,
     "completion_sum": 4498497,
     "over_8k": 58,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065557.522,
     "t_last": 1793080568.337,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 960.3964560204953,
     "over_8k_per_1000_calls": 12.382578992314262,
     "cap_hits_per_1000_calls": 0.8539709649871904,
     "t_first_iso": "2026-10-26T18:45:57-07:00",
     "t_last_iso": "2026-10-26T22:56:08-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293587_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4368,
     "completion_sum": 4506053,
     "over_8k": 65,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079537.032,
     "t_last": 1793090048.931,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1031.6055402930403,
     "over_8k_per_1000_calls": 14.880952380952381,
     "cap_hits_per_1000_calls": 1.6025641025641026,
     "t_first_iso": "2026-10-26T22:38:57-07:00",
     "t_last_iso": "2026-10-27T01:34:08-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293622_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3501,
     "completion_sum": 3273737,
     "over_8k": 35,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086552.983,
     "t_last": 1793094020.88,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 935.0862610682663,
     "over_8k_per_1000_calls": 9.997143673236218,
     "cap_hits_per_1000_calls": 2.570694087403599,
     "t_first_iso": "2026-10-27T00:35:52-07:00",
     "t_last_iso": "2026-10-27T02:40:20-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293480_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4995,
     "completion_sum": 4649307,
     "over_8k": 55,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987505.671,
     "t_last": 1792998406.368,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 930.7921921921921,
     "over_8k_per_1000_calls": 11.01101101101101,
     "cap_hits_per_1000_calls": 4.004004004004004,
     "t_first_iso": "2026-10-25T21:05:05-07:00",
     "t_last_iso": "2026-10-26T00:06:46-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293768_0",
      "307327_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4211,
     "completion_sum": 4601616,
     "over_8k": 77,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793142433.251,
     "t_last": 1793189436.745,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1092.7608644027546,
     "over_8k_per_1000_calls": 18.285442887675135,
     "cap_hits_per_1000_calls": 7.59914509617668,
     "t_first_iso": "2026-10-27T16:07:13-07:00",
     "t_last_iso": "2026-10-28T05:10:36-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293668_0",
      "293668_1",
      "304974_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5087,
     "completion_sum": 7141417,
     "over_8k": 157,
     "cap_hits": 31,
     "length_finish": 31,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110965.767,
     "t_last": 1793164366.213,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1403.856300373501,
     "over_8k_per_1000_calls": 30.86298407705917,
     "cap_hits_per_1000_calls": 6.093965008846078,
     "t_first_iso": "2026-10-27T07:22:45-07:00",
     "t_last_iso": "2026-10-27T22:12:46-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293650_0",
      "303944_0",
      "308315_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4658,
     "completion_sum": 6419337,
     "over_8k": 139,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108310.614,
     "t_last": 1793191811.994,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1378.1316015457278,
     "over_8k_per_1000_calls": 29.841133533705452,
     "cap_hits_per_1000_calls": 6.869901245169601,
     "t_first_iso": "2026-10-27T06:38:30-07:00",
     "t_last_iso": "2026-10-28T05:50:11-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293700_0",
      "293700_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4404,
     "completion_sum": 6073062,
     "over_8k": 130,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113968.566,
     "t_last": 1793131468.187,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1378.9877384196186,
     "over_8k_per_1000_calls": 29.518619436875568,
     "cap_hits_per_1000_calls": 5.903723887375113,
     "t_first_iso": "2026-10-27T08:12:48-07:00",
     "t_last_iso": "2026-10-27T13:04:28-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293777_0",
      "293777_1",
      "309003_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4999,
     "completion_sum": 6093712,
     "over_8k": 123,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150280.511,
     "t_last": 1793192014.293,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1218.9861972394478,
     "over_8k_per_1000_calls": 24.604920984196838,
     "cap_hits_per_1000_calls": 3.800760152030406,
     "t_first_iso": "2026-10-27T18:18:00-07:00",
     "t_last_iso": "2026-10-28T05:53:34-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293456_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4319,
     "completion_sum": 5057394,
     "over_8k": 77,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792969123.865,
     "t_last": 1792980662.458,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1170.9641120629776,
     "over_8k_per_1000_calls": 17.828200972447327,
     "cap_hits_per_1000_calls": 2.0838156980782587,
     "t_first_iso": "2026-10-25T15:58:43-07:00",
     "t_last_iso": "2026-10-25T19:11:02-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293470_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3865,
     "completion_sum": 4288863,
     "over_8k": 71,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987230.115,
     "t_last": 1792998448.874,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1109.6670116429495,
     "over_8k_per_1000_calls": 18.36998706338939,
     "cap_hits_per_1000_calls": 4.3984476067270375,
     "t_first_iso": "2026-10-25T21:00:30-07:00",
     "t_last_iso": "2026-10-26T00:07:28-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293741_0",
      "293741_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5133,
     "completion_sum": 5866405,
     "over_8k": 101,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116921.19,
     "t_last": 1793139280.478,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1142.8803818429767,
     "over_8k_per_1000_calls": 19.676602376777712,
     "cap_hits_per_1000_calls": 3.3119033703487237,
     "t_first_iso": "2026-10-27T09:02:01-07:00",
     "t_last_iso": "2026-10-27T15:14:40-07:00"
    },
    {
     "arm": "jqs_f_r60_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293721_0",
      "293721_1",
      "305788_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4927,
     "completion_sum": 8058191,
     "over_8k": 213,
     "cap_hits": 56,
     "length_finish": 56,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115270.379,
     "t_last": 1793190188.491,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.153846153846154,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1635.516744469251,
     "over_8k_per_1000_calls": 43.231175157296526,
     "cap_hits_per_1000_calls": 11.365942764359652,
     "t_first_iso": "2026-10-27T08:34:30-07:00",
     "t_last_iso": "2026-10-28T05:23:08-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "112974_0",
      "115889_0",
      "116860_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4693,
     "completion_sum": 6125513,
     "over_8k": 126,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949749.27,
     "t_last": 1790974741.667,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1305.2446196462818,
     "over_8k_per_1000_calls": 26.848497762625186,
     "cap_hits_per_1000_calls": 10.227999147666738,
     "t_first_iso": "2026-10-02T07:02:29-07:00",
     "t_last_iso": "2026-10-02T13:59:01-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "112975_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4282,
     "completion_sum": 4295356,
     "over_8k": 62,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949742.642,
     "t_last": 1790958804.52,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1003.1191032227931,
     "over_8k_per_1000_calls": 14.479215319943952,
     "cap_hits_per_1000_calls": 1.4012143858010275,
     "t_first_iso": "2026-10-02T07:02:22-07:00",
     "t_last_iso": "2026-10-02T09:33:24-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "112976_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4299,
     "completion_sum": 5385459,
     "over_8k": 122,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949730.168,
     "t_last": 1790962393.341,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1252.7236566643405,
     "over_8k_per_1000_calls": 28.378692719237034,
     "cap_hits_per_1000_calls": 3.954408001860898,
     "t_first_iso": "2026-10-02T07:02:10-07:00",
     "t_last_iso": "2026-10-02T10:33:13-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "112977_0",
      "115813_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4725,
     "completion_sum": 4884973,
     "over_8k": 78,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949757.916,
     "t_last": 1790965735.342,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1033.8567195767196,
     "over_8k_per_1000_calls": 16.50793650793651,
     "cap_hits_per_1000_calls": 2.328042328042328,
     "t_first_iso": "2026-10-02T07:02:37-07:00",
     "t_last_iso": "2026-10-02T11:28:55-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "113143_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4260,
     "completion_sum": 4098653,
     "over_8k": 48,
     "cap_hits": 1,
     "length_finish": 1,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950400.593,
     "t_last": 1790961136.278,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 962.125117370892,
     "over_8k_per_1000_calls": 11.267605633802816,
     "cap_hits_per_1000_calls": 0.2347417840375587,
     "t_first_iso": "2026-10-02T07:13:20-07:00",
     "t_last_iso": "2026-10-02T10:12:16-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "113144_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3702,
     "completion_sum": 3531466,
     "over_8k": 40,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950398.8,
     "t_last": 1790960180.248,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 953.9346299297677,
     "over_8k_per_1000_calls": 10.804970286331713,
     "cap_hits_per_1000_calls": 0.5402485143165856,
     "t_first_iso": "2026-10-02T07:13:18-07:00",
     "t_last_iso": "2026-10-02T09:56:20-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "113145_0",
      "115727_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5304,
     "completion_sum": 5389273,
     "over_8k": 70,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950379.726,
     "t_last": 1790967137.218,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1016.0771116138764,
     "over_8k_per_1000_calls": 13.197586726998491,
     "cap_hits_per_1000_calls": 2.0739064856711917,
     "t_first_iso": "2026-10-02T07:12:59-07:00",
     "t_last_iso": "2026-10-02T11:52:17-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "113146_0",
      "116064_0",
      "117149_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4447,
     "completion_sum": 5548868,
     "over_8k": 140,
     "cap_hits": 61,
     "length_finish": 61,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950376.375,
     "t_last": 1790975866.253,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1247.7778277490443,
     "over_8k_per_1000_calls": 31.481897908702496,
     "cap_hits_per_1000_calls": 13.717112660220373,
     "t_first_iso": "2026-10-02T07:12:56-07:00",
     "t_last_iso": "2026-10-02T14:17:46-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "112978_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4040,
     "completion_sum": 2663536,
     "over_8k": 17,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949748.881,
     "t_last": 1790956945.837,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 659.2910891089109,
     "over_8k_per_1000_calls": 4.207920792079208,
     "cap_hits_per_1000_calls": 0.49504950495049505,
     "t_first_iso": "2026-10-02T07:02:28-07:00",
     "t_last_iso": "2026-10-02T09:02:25-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "112979_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4514,
     "completion_sum": 2902801,
     "over_8k": 16,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949825.347,
     "t_last": 1790957255.479,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 643.066238369517,
     "over_8k_per_1000_calls": 3.544528134692069,
     "cap_hits_per_1000_calls": 0.44306601683650865,
     "t_first_iso": "2026-10-02T07:03:45-07:00",
     "t_last_iso": "2026-10-02T09:07:35-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "112980_0",
      "115648_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5055,
     "completion_sum": 4149529,
     "over_8k": 57,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949799.735,
     "t_last": 1790964365.19,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 820.8761622156281,
     "over_8k_per_1000_calls": 11.275964391691394,
     "cap_hits_per_1000_calls": 1.3847675568743818,
     "t_first_iso": "2026-10-02T07:03:19-07:00",
     "t_last_iso": "2026-10-02T11:06:05-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "112981_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4799,
     "completion_sum": 2894461,
     "over_8k": 22,
     "cap_hits": 1,
     "length_finish": 1,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949819.863,
     "t_last": 1790957304.624,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 603.138362158783,
     "over_8k_per_1000_calls": 4.584288393415295,
     "cap_hits_per_1000_calls": 0.20837674515524068,
     "t_first_iso": "2026-10-02T07:03:39-07:00",
     "t_last_iso": "2026-10-02T09:08:24-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "113147_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4381,
     "completion_sum": 3110434,
     "over_8k": 36,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950444.807,
     "t_last": 1790960419.781,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 709.9826523624744,
     "over_8k_per_1000_calls": 8.21730198584798,
     "cap_hits_per_1000_calls": 1.5978087194704405,
     "t_first_iso": "2026-10-02T07:14:04-07:00",
     "t_last_iso": "2026-10-02T10:00:19-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "113148_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3812,
     "completion_sum": 2226480,
     "over_8k": 16,
     "cap_hits": 1,
     "length_finish": 1,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950462.004,
     "t_last": 1790957204.954,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 584.0713536201469,
     "over_8k_per_1000_calls": 4.197271773347325,
     "cap_hits_per_1000_calls": 0.2623294858342078,
     "t_first_iso": "2026-10-02T07:14:22-07:00",
     "t_last_iso": "2026-10-02T09:06:44-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "113149_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4900,
     "completion_sum": 3351378,
     "over_8k": 26,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950436.932,
     "t_last": 1790959481.423,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 683.954693877551,
     "over_8k_per_1000_calls": 5.3061224489795915,
     "cap_hits_per_1000_calls": 0.40816326530612246,
     "t_first_iso": "2026-10-02T07:13:56-07:00",
     "t_last_iso": "2026-10-02T09:44:41-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "113150_0",
      "115893_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4369,
     "completion_sum": 4096959,
     "over_8k": 86,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950455.472,
     "t_last": 1790964793.498,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 937.7338063630121,
     "over_8k_per_1000_calls": 19.684138246738385,
     "cap_hits_per_1000_calls": 7.553215838864729,
     "t_first_iso": "2026-10-02T07:14:15-07:00",
     "t_last_iso": "2026-10-02T11:13:13-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "112982_0",
      "112982_1",
      "116862_0",
      "117711_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4517,
     "completion_sum": 5804758,
     "over_8k": 138,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949824.005,
     "t_last": 1790980844.401,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1285.091432366615,
     "over_8k_per_1000_calls": 30.551250830197034,
     "cap_hits_per_1000_calls": 8.855435023245517,
     "t_first_iso": "2026-10-02T07:03:44-07:00",
     "t_last_iso": "2026-10-02T15:40:44-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "112983_0",
      "115494_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4479,
     "completion_sum": 4501979,
     "over_8k": 67,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949827.431,
     "t_last": 1790960594.326,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1005.1303862469301,
     "over_8k_per_1000_calls": 14.9586961375307,
     "cap_hits_per_1000_calls": 1.5628488501897746,
     "t_first_iso": "2026-10-02T07:03:47-07:00",
     "t_last_iso": "2026-10-02T10:03:14-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "112984_0",
      "112984_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4521,
     "completion_sum": 5508973,
     "over_8k": 118,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949860.021,
     "t_last": 1790966792.426,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1218.5297500552974,
     "over_8k_per_1000_calls": 26.100420261004203,
     "cap_hits_per_1000_calls": 3.7602300376023003,
     "t_first_iso": "2026-10-02T07:04:20-07:00",
     "t_last_iso": "2026-10-02T11:46:32-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "112985_0",
      "115422_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 0,
     "zero_other": 2,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4498,
     "completion_sum": 3841636,
     "over_8k": 41,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949813.923,
     "t_last": 1790961733.418,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 854.07647843486,
     "over_8k_per_1000_calls": 9.115162294353047,
     "cap_hits_per_1000_calls": 0.444642063139173,
     "t_first_iso": "2026-10-02T07:03:33-07:00",
     "t_last_iso": "2026-10-02T10:22:13-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "113151_1"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 53,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 53,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3494,
     "completion_sum": 3179940,
     "over_8k": 34,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790952545.818,
     "t_last": 1790961187.237,
     "attempts_listed": 2,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "113151_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 910.1144819690899,
     "over_8k_per_1000_calls": 9.73096737263881,
     "cap_hits_per_1000_calls": 0.8586147681740126,
     "t_first_iso": "2026-10-02T07:49:05-07:00",
     "t_last_iso": "2026-10-02T10:13:07-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "113243_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3616,
     "completion_sum": 3413893,
     "over_8k": 47,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945161.924,
     "t_last": 1790953094.325,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 944.1075774336283,
     "over_8k_per_1000_calls": 12.997787610619469,
     "cap_hits_per_1000_calls": 1.1061946902654867,
     "t_first_iso": "2026-10-02T05:46:01-07:00",
     "t_last_iso": "2026-10-02T07:58:14-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "113244_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4475,
     "completion_sum": 4172269,
     "over_8k": 70,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945151.229,
     "t_last": 1790954613.939,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 932.3506145251397,
     "over_8k_per_1000_calls": 15.64245810055866,
     "cap_hits_per_1000_calls": 3.1284916201117317,
     "t_first_iso": "2026-10-02T05:45:51-07:00",
     "t_last_iso": "2026-10-02T08:23:33-07:00"
    },
    {
     "arm": "jqs_f_r60",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "113245_0",
      "115349_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4299,
     "completion_sum": 5133803,
     "over_8k": 114,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945180.33,
     "t_last": 1790960882.676,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1194.1853919516166,
     "over_8k_per_1000_calls": 26.517794836008374,
     "cap_hits_per_1000_calls": 7.443591532914631,
     "t_first_iso": "2026-10-02T05:46:20-07:00",
     "t_last_iso": "2026-10-02T10:08:02-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293513_0",
      "293513_1",
      "299851_0",
      "307826_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4722,
     "completion_sum": 7827146,
     "over_8k": 222,
     "cap_hits": 83,
     "length_finish": 83,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028117.605,
     "t_last": 1793192005.678,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1657.591274883524,
     "over_8k_per_1000_calls": 47.01397712833545,
     "cap_hits_per_1000_calls": 17.57729775518848,
     "t_first_iso": "2026-10-26T08:21:57-07:00",
     "t_last_iso": "2026-10-28T05:53:25-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293548_0",
      "293548_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4731,
     "completion_sum": 6745029,
     "over_8k": 139,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793057308.071,
     "t_last": 1793073312.238,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1425.708941027267,
     "over_8k_per_1000_calls": 29.380680617205666,
     "cap_hits_per_1000_calls": 6.129782287042908,
     "t_first_iso": "2026-10-26T16:28:28-07:00",
     "t_last_iso": "2026-10-26T20:55:12-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293704_0",
      "293704_1",
      "305155_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4488,
     "completion_sum": 6765125,
     "over_8k": 157,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114179.237,
     "t_last": 1793165575.65,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1507.3807932263815,
     "over_8k_per_1000_calls": 34.98217468805704,
     "cap_hits_per_1000_calls": 5.570409982174688,
     "t_first_iso": "2026-10-27T08:16:19-07:00",
     "t_last_iso": "2026-10-27T22:32:55-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293630_0",
      "293630_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4602,
     "completion_sum": 6012431,
     "over_8k": 117,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086761.128,
     "t_last": 1793108008.414,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1306.4821816601477,
     "over_8k_per_1000_calls": 25.423728813559322,
     "cap_hits_per_1000_calls": 2.3902651021295087,
     "t_first_iso": "2026-10-27T00:39:21-07:00",
     "t_last_iso": "2026-10-27T06:33:28-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293533_0",
      "299054_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4355,
     "completion_sum": 5294999,
     "over_8k": 75,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793032132.779,
     "t_last": 1793153419.474,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1215.8436280137773,
     "over_8k_per_1000_calls": 17.22158438576349,
     "cap_hits_per_1000_calls": 1.8369690011481057,
     "t_first_iso": "2026-10-26T09:28:52-07:00",
     "t_last_iso": "2026-10-27T19:10:19-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293744_0",
      "293744_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4367,
     "completion_sum": 6473445,
     "over_8k": 152,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117223.654,
     "t_last": 1793141252.771,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1482.3551637279597,
     "over_8k_per_1000_calls": 34.80650332035722,
     "cap_hits_per_1000_calls": 4.350812915044653,
     "t_first_iso": "2026-10-27T09:07:03-07:00",
     "t_last_iso": "2026-10-27T15:47:32-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293682_0",
      "293682_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5096,
     "completion_sum": 6098915,
     "over_8k": 99,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113152.104,
     "t_last": 1793131240.889,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1196.8043563579279,
     "over_8k_per_1000_calls": 19.427001569858714,
     "cap_hits_per_1000_calls": 1.3736263736263736,
     "t_first_iso": "2026-10-27T07:59:12-07:00",
     "t_last_iso": "2026-10-27T13:00:40-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293605_0",
      "293605_1",
      "302879_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4385,
     "completion_sum": 6563171,
     "over_8k": 161,
     "cap_hits": 49,
     "length_finish": 49,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081978.534,
     "t_last": 1793156145.027,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1496.7322690992019,
     "over_8k_per_1000_calls": 36.716077537058155,
     "cap_hits_per_1000_calls": 11.174458380843786,
     "t_first_iso": "2026-10-26T23:19:38-07:00",
     "t_last_iso": "2026-10-27T19:55:45-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293496_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4325,
     "completion_sum": 4940945,
     "over_8k": 99,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025459.994,
     "t_last": 1793036843.288,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1142.415028901734,
     "over_8k_per_1000_calls": 22.890173410404625,
     "cap_hits_per_1000_calls": 5.780346820809249,
     "t_first_iso": "2026-10-26T07:37:39-07:00",
     "t_last_iso": "2026-10-26T10:47:23-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293530_0",
      "299084_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5040,
     "completion_sum": 5897966,
     "over_8k": 95,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031600.592,
     "t_last": 1793154050.412,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1170.2313492063493,
     "over_8k_per_1000_calls": 18.849206349206348,
     "cap_hits_per_1000_calls": 3.373015873015873,
     "t_first_iso": "2026-10-26T09:20:00-07:00",
     "t_last_iso": "2026-10-27T19:20:50-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293588_0",
      "301912_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 71,
     "timeouts": 0,
     "zero_other": 8,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5013,
     "completion_sum": 5900109,
     "over_8k": 101,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079520.214,
     "t_last": 1793158126.316,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1176.961699581089,
     "over_8k_per_1000_calls": 20.147616197885498,
     "cap_hits_per_1000_calls": 3.3911829243965688,
     "t_first_iso": "2026-10-26T22:38:40-07:00",
     "t_last_iso": "2026-10-27T20:28:46-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293570_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4783,
     "completion_sum": 4917208,
     "over_8k": 91,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793068687.186,
     "t_last": 1793079548.245,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1028.0593769600669,
     "over_8k_per_1000_calls": 19.025716077775456,
     "cap_hits_per_1000_calls": 2.090738030524775,
     "t_first_iso": "2026-10-26T19:38:07-07:00",
     "t_last_iso": "2026-10-26T22:39:08-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293584_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4334,
     "completion_sum": 4180836,
     "over_8k": 50,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079060.665,
     "t_last": 1793089970.604,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 964.6598984771574,
     "over_8k_per_1000_calls": 11.536686663590217,
     "cap_hits_per_1000_calls": 1.8458698661744346,
     "t_first_iso": "2026-10-26T22:31:00-07:00",
     "t_last_iso": "2026-10-27T01:32:50-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293626_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3662,
     "completion_sum": 3445977,
     "over_8k": 43,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086592.141,
     "t_last": 1793095607.573,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 941.0095576187875,
     "over_8k_per_1000_calls": 11.74221736755871,
     "cap_hits_per_1000_calls": 1.3653741125068268,
     "t_first_iso": "2026-10-27T00:36:32-07:00",
     "t_last_iso": "2026-10-27T03:06:47-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293478_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4871,
     "completion_sum": 4678389,
     "over_8k": 60,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987523.154,
     "t_last": 1792998107.707,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 960.4576062410183,
     "over_8k_per_1000_calls": 12.317799219872716,
     "cap_hits_per_1000_calls": 2.0529665366454526,
     "t_first_iso": "2026-10-25T21:05:23-07:00",
     "t_last_iso": "2026-10-26T00:01:47-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293759_0",
      "293759_1",
      "306605_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4569,
     "completion_sum": 5964359,
     "over_8k": 145,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119982.106,
     "t_last": 1793188151.284,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1305.397023418691,
     "over_8k_per_1000_calls": 31.73560954256949,
     "cap_hits_per_1000_calls": 10.505581089954038,
     "t_first_iso": "2026-10-27T09:53:02-07:00",
     "t_last_iso": "2026-10-28T04:49:11-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293662_0",
      "293662_1",
      "304970_0",
      "308422_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4634,
     "completion_sum": 6736679,
     "over_8k": 172,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110822.421,
     "t_last": 1793193654.451,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1453.7503236944324,
     "over_8k_per_1000_calls": 37.11696158826068,
     "cap_hits_per_1000_calls": 11.0056107034959,
     "t_first_iso": "2026-10-27T07:20:22-07:00",
     "t_last_iso": "2026-10-28T06:20:54-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293651_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4508,
     "completion_sum": 6189809,
     "over_8k": 118,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108305.391,
     "t_last": 1793120667.472,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1373.0720940550134,
     "over_8k_per_1000_calls": 26.175687666370898,
     "cap_hits_per_1000_calls": 4.658385093167702,
     "t_first_iso": "2026-10-27T06:38:25-07:00",
     "t_last_iso": "2026-10-27T10:04:27-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293690_0",
      "304328_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4343,
     "completion_sum": 5987906,
     "over_8k": 126,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113333.855,
     "t_last": 1793158474.639,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1378.7487911581857,
     "over_8k_per_1000_calls": 29.01220354593599,
     "cap_hits_per_1000_calls": 3.9143449228643794,
     "t_first_iso": "2026-10-27T08:02:13-07:00",
     "t_last_iso": "2026-10-27T20:34:34-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293775_0",
      "307702_0",
      "310290_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 70,
     "timeouts": 5,
     "zero_other": 2,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5388,
     "completion_sum": 7576456,
     "over_8k": 201,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793144202.607,
     "t_last": 1793197762.337,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.142857142857143,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1406.1722345953972,
     "over_8k_per_1000_calls": 37.30512249443207,
     "cap_hits_per_1000_calls": 6.867112100965108,
     "t_first_iso": "2026-10-27T16:36:42-07:00",
     "t_last_iso": "2026-10-28T07:29:22-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293454_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4457,
     "completion_sum": 5139817,
     "over_8k": 75,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792968248.266,
     "t_last": 1792980755.843,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1153.2010320843617,
     "over_8k_per_1000_calls": 16.827462418667263,
     "cap_hits_per_1000_calls": 0.8974646623289207,
     "t_first_iso": "2026-10-25T15:44:08-07:00",
     "t_last_iso": "2026-10-25T19:12:35-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293468_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3765,
     "completion_sum": 4398926,
     "over_8k": 79,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792985277.873,
     "t_last": 1792995034.572,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1168.3734395750332,
     "over_8k_per_1000_calls": 20.98273572377158,
     "cap_hits_per_1000_calls": 2.3904382470119523,
     "t_first_iso": "2026-10-25T20:27:57-07:00",
     "t_last_iso": "2026-10-25T23:10:34-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293738_0",
      "293738_1",
      "305961_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5426,
     "completion_sum": 6948392,
     "over_8k": 142,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116784.208,
     "t_last": 1793189017.836,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1280.573534832289,
     "over_8k_per_1000_calls": 26.17029119056395,
     "cap_hits_per_1000_calls": 2.5801695539992626,
     "t_first_iso": "2026-10-27T08:59:44-07:00",
     "t_last_iso": "2026-10-28T05:03:37-07:00"
    },
    {
     "arm": "jqs_f_u32_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293726_0",
      "293726_1",
      "305791_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4972,
     "completion_sum": 8088703,
     "over_8k": 232,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115380.605,
     "t_last": 1793187207.074,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.246376811594203,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1626.8509654062752,
     "over_8k_per_1000_calls": 46.66130329847144,
     "cap_hits_per_1000_calls": 10.659694288012872,
     "t_first_iso": "2026-10-27T08:36:20-07:00",
     "t_last_iso": "2026-10-28T04:33:27-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "112986_0",
      "112986_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4465,
     "completion_sum": 5213456,
     "over_8k": 91,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949889.987,
     "t_last": 1790967609.869,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1167.6273236282195,
     "over_8k_per_1000_calls": 20.38073908174692,
     "cap_hits_per_1000_calls": 2.9115341545352744,
     "t_first_iso": "2026-10-02T07:04:49-07:00",
     "t_last_iso": "2026-10-02T12:00:09-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "112987_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4216,
     "completion_sum": 4637614,
     "over_8k": 72,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949873.415,
     "t_last": 1790960498.523,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1100.003320683112,
     "over_8k_per_1000_calls": 17.077798861480076,
     "cap_hits_per_1000_calls": 1.1859582542694498,
     "t_first_iso": "2026-10-02T07:04:33-07:00",
     "t_last_iso": "2026-10-02T10:01:38-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "112988_0",
      "115890_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4552,
     "completion_sum": 5582137,
     "over_8k": 122,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949892.799,
     "t_last": 1790965393.039,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1226.3042618629174,
     "over_8k_per_1000_calls": 26.80140597539543,
     "cap_hits_per_1000_calls": 4.833040421792619,
     "t_first_iso": "2026-10-02T07:04:52-07:00",
     "t_last_iso": "2026-10-02T11:23:13-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "112989_0",
      "115553_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4634,
     "completion_sum": 4913582,
     "over_8k": 78,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949897.499,
     "t_last": 1790963657.609,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1060.3327578765645,
     "over_8k_per_1000_calls": 16.832110487699612,
     "cap_hits_per_1000_calls": 1.9421665947345705,
     "t_first_iso": "2026-10-02T07:04:57-07:00",
     "t_last_iso": "2026-10-02T10:54:17-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "113246_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4287,
     "completion_sum": 4268329,
     "over_8k": 55,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945135.059,
     "t_last": 1790954884.851,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 995.6447399113599,
     "over_8k_per_1000_calls": 12.829484487986937,
     "cap_hits_per_1000_calls": 0.9330534173081408,
     "t_first_iso": "2026-10-02T05:45:35-07:00",
     "t_last_iso": "2026-10-02T08:28:04-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "113247_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3570,
     "completion_sum": 3576361,
     "over_8k": 41,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945189.985,
     "t_last": 1790953708.952,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1001.7817927170869,
     "over_8k_per_1000_calls": 11.484593837535014,
     "cap_hits_per_1000_calls": 0.8403361344537815,
     "t_first_iso": "2026-10-02T05:46:29-07:00",
     "t_last_iso": "2026-10-02T08:08:28-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "113248_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4889,
     "completion_sum": 5283147,
     "over_8k": 93,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945158.704,
     "t_last": 1790956897.586,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1080.6191450194315,
     "over_8k_per_1000_calls": 19.022294947842095,
     "cap_hits_per_1000_calls": 2.045408058907752,
     "t_first_iso": "2026-10-02T05:45:58-07:00",
     "t_last_iso": "2026-10-02T09:01:37-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "113249_0",
      "113249_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4736,
     "completion_sum": 5505508,
     "over_8k": 107,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945154.371,
     "t_last": 1790963179.775,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1162.4805743243244,
     "over_8k_per_1000_calls": 22.592905405405407,
     "cap_hits_per_1000_calls": 3.589527027027027,
     "t_first_iso": "2026-10-02T05:45:54-07:00",
     "t_last_iso": "2026-10-02T10:46:19-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "112990_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4158,
     "completion_sum": 3272841,
     "over_8k": 35,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949930.001,
     "t_last": 1790959592.47,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 787.1190476190476,
     "over_8k_per_1000_calls": 8.417508417508417,
     "cap_hits_per_1000_calls": 1.2025012025012025,
     "t_first_iso": "2026-10-02T07:05:30-07:00",
     "t_last_iso": "2026-10-02T09:46:32-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "112991_0",
      "115403_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4812,
     "completion_sum": 3709479,
     "over_8k": 44,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949880.566,
     "t_last": 1790960932.602,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 770.8809226932668,
     "over_8k_per_1000_calls": 9.14380714879468,
     "cap_hits_per_1000_calls": 0.8312551953449709,
     "t_first_iso": "2026-10-02T07:04:40-07:00",
     "t_last_iso": "2026-10-02T10:08:52-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "112992_0",
      "115552_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 1,
     "zero_other": 2,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4984,
     "completion_sum": 4130013,
     "over_8k": 47,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949957.347,
     "t_last": 1790961842.938,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5151515151515151,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 828.6542937399679,
     "over_8k_per_1000_calls": 9.430176565008026,
     "cap_hits_per_1000_calls": 0.6019261637239165,
     "t_first_iso": "2026-10-02T07:05:57-07:00",
     "t_last_iso": "2026-10-02T10:24:02-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "112993_0",
      "115728_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4950,
     "completion_sum": 3566345,
     "over_8k": 60,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949938.834,
     "t_last": 1790964386.121,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 720.4737373737373,
     "over_8k_per_1000_calls": 12.121212121212121,
     "cap_hits_per_1000_calls": 1.6161616161616161,
     "t_first_iso": "2026-10-02T07:05:38-07:00",
     "t_last_iso": "2026-10-02T11:06:26-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "114868_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 50,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 50,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3224,
     "completion_sum": 1967394,
     "over_8k": 7,
     "cap_hits": 0,
     "length_finish": 0,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790951287.706,
     "t_last": 1790957282.278,
     "attempts_listed": 3,
     "attempts_without_snapshot": 2,
     "attempt_tags_without_snapshot": [
      "113250_0",
      "113250_1"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 610.233870967742,
     "over_8k_per_1000_calls": 2.1712158808933,
     "cap_hits_per_1000_calls": 0.0,
     "t_first_iso": "2026-10-02T07:28:07-07:00",
     "t_last_iso": "2026-10-02T09:08:02-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "113251_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3776,
     "completion_sum": 2355349,
     "over_8k": 18,
     "cap_hits": 0,
     "length_finish": 0,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945164.581,
     "t_last": 1790952137.933,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 623.7682733050848,
     "over_8k_per_1000_calls": 4.766949152542373,
     "cap_hits_per_1000_calls": 0.0,
     "t_first_iso": "2026-10-02T05:46:04-07:00",
     "t_last_iso": "2026-10-02T07:42:17-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "113252_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4979,
     "completion_sum": 3433125,
     "over_8k": 31,
     "cap_hits": 0,
     "length_finish": 0,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945186.296,
     "t_last": 1790953882.612,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 689.520988150231,
     "over_8k_per_1000_calls": 6.226149829282988,
     "cap_hits_per_1000_calls": 0.0,
     "t_first_iso": "2026-10-02T05:46:26-07:00",
     "t_last_iso": "2026-10-02T08:11:22-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "113253_0",
      "115352_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4377,
     "completion_sum": 4034655,
     "over_8k": 75,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945178.855,
     "t_last": 1790959343.744,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 921.7854694996573,
     "over_8k_per_1000_calls": 17.135023989033584,
     "cap_hits_per_1000_calls": 5.711674663011195,
     "t_first_iso": "2026-10-02T05:46:18-07:00",
     "t_last_iso": "2026-10-02T09:42:23-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "112994_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4312,
     "completion_sum": 4931405,
     "over_8k": 80,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949916.109,
     "t_last": 1790961486.985,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1143.6467996289425,
     "over_8k_per_1000_calls": 18.552875695732837,
     "cap_hits_per_1000_calls": 3.4786641929499074,
     "t_first_iso": "2026-10-02T07:05:16-07:00",
     "t_last_iso": "2026-10-02T10:18:06-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "112995_0",
      "115423_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4543,
     "completion_sum": 4550520,
     "over_8k": 68,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949949.117,
     "t_last": 1790961094.31,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1001.6552938586836,
     "over_8k_per_1000_calls": 14.968082764692934,
     "cap_hits_per_1000_calls": 2.201188641866608,
     "t_first_iso": "2026-10-02T07:05:49-07:00",
     "t_last_iso": "2026-10-02T10:11:34-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "112996_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4326,
     "completion_sum": 4956679,
     "over_8k": 88,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949944.804,
     "t_last": 1790961057.516,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1145.7880258899677,
     "over_8k_per_1000_calls": 20.34211742949607,
     "cap_hits_per_1000_calls": 3.005085529357374,
     "t_first_iso": "2026-10-02T07:05:44-07:00",
     "t_last_iso": "2026-10-02T10:10:57-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "112997_0",
      "115424_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4514,
     "completion_sum": 3950988,
     "over_8k": 46,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949932.678,
     "t_last": 1790959934.013,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 875.2742578644218,
     "over_8k_per_1000_calls": 10.190518387239699,
     "cap_hits_per_1000_calls": 0.44306601683650865,
     "t_first_iso": "2026-10-02T07:05:32-07:00",
     "t_last_iso": "2026-10-02T09:52:14-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "113254_0",
      "113254_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4499,
     "completion_sum": 5297663,
     "over_8k": 82,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945226.672,
     "t_last": 1790960729.726,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1177.5201155812404,
     "over_8k_per_1000_calls": 18.226272505001113,
     "cap_hits_per_1000_calls": 1.3336296954878861,
     "t_first_iso": "2026-10-02T05:47:06-07:00",
     "t_last_iso": "2026-10-02T10:05:29-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "113255_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3841,
     "completion_sum": 3831475,
     "over_8k": 56,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945233.653,
     "t_last": 1790955648.924,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 997.5201770372299,
     "over_8k_per_1000_calls": 14.579536579015882,
     "cap_hits_per_1000_calls": 1.8224420723769852,
     "t_first_iso": "2026-10-02T05:47:13-07:00",
     "t_last_iso": "2026-10-02T08:40:48-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "113256_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4804,
     "completion_sum": 4251535,
     "over_8k": 41,
     "cap_hits": 0,
     "length_finish": 0,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945227.008,
     "t_last": 1790954964.941,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 884.9989592006661,
     "over_8k_per_1000_calls": 8.534554537885096,
     "cap_hits_per_1000_calls": 0.0,
     "t_first_iso": "2026-10-02T05:47:07-07:00",
     "t_last_iso": "2026-10-02T08:29:24-07:00"
    },
    {
     "arm": "jqs_f_u32",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "113257_0",
      "115353_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4217,
     "completion_sum": 4803654,
     "over_8k": 91,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945233.955,
     "t_last": 1790962780.02,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1139.1164334835191,
     "over_8k_per_1000_calls": 21.579321792743656,
     "cap_hits_per_1000_calls": 6.639791320844202,
     "t_first_iso": "2026-10-02T05:47:13-07:00",
     "t_last_iso": "2026-10-02T10:39:40-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293517_0",
      "293517_1",
      "299895_0",
      "307829_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4849,
     "completion_sum": 8175804,
     "over_8k": 231,
     "cap_hits": 67,
     "length_finish": 67,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793029304.949,
     "t_last": 1793191420.615,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1686.0804289544235,
     "over_8k_per_1000_calls": 47.63868838935863,
     "cap_hits_per_1000_calls": 13.81728191379666,
     "t_first_iso": "2026-10-26T08:41:44-07:00",
     "t_last_iso": "2026-10-28T05:43:40-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293546_0",
      "293546_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4745,
     "completion_sum": 6611785,
     "over_8k": 137,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793056929.47,
     "t_last": 1793072028.311,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1393.4214963119073,
     "over_8k_per_1000_calls": 28.87249736564805,
     "cap_hits_per_1000_calls": 5.690200210748156,
     "t_first_iso": "2026-10-26T16:22:09-07:00",
     "t_last_iso": "2026-10-26T20:33:48-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293710_0",
      "293710_1",
      "305519_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4574,
     "completion_sum": 7286110,
     "over_8k": 177,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114405.369,
     "t_last": 1793184893.659,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1592.9405334499345,
     "over_8k_per_1000_calls": 38.69698294709226,
     "cap_hits_per_1000_calls": 6.340183646698732,
     "t_first_iso": "2026-10-27T08:20:05-07:00",
     "t_last_iso": "2026-10-28T03:54:53-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293642_0",
      "302450_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4523,
     "completion_sum": 6164163,
     "over_8k": 125,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087796.931,
     "t_last": 1793158526.926,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1362.8483307539243,
     "over_8k_per_1000_calls": 27.636524430687597,
     "cap_hits_per_1000_calls": 3.9796595180190137,
     "t_first_iso": "2026-10-27T00:56:36-07:00",
     "t_last_iso": "2026-10-27T20:35:26-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293535_0",
      "293535_1",
      "300079_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5067,
     "completion_sum": 8196714,
     "over_8k": 192,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793032613.922,
     "t_last": 1793158146.325,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.575757575757576,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1617.6660746003552,
     "over_8k_per_1000_calls": 37.89224393132031,
     "cap_hits_per_1000_calls": 5.723307677126505,
     "t_first_iso": "2026-10-26T09:36:53-07:00",
     "t_last_iso": "2026-10-27T20:29:06-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293748_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3939,
     "completion_sum": 5301803,
     "over_8k": 107,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117394.091,
     "t_last": 1793129267.629,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1345.976897689769,
     "over_8k_per_1000_calls": 27.164254887027163,
     "cap_hits_per_1000_calls": 3.808073115003808,
     "t_first_iso": "2026-10-27T09:09:54-07:00",
     "t_last_iso": "2026-10-27T12:27:47-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293684_0",
      "293684_1",
      "305111_0",
      "308571_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6032,
     "completion_sum": 9474149,
     "over_8k": 248,
     "cap_hits": 36,
     "length_finish": 36,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113143.541,
     "t_last": 1793192554.849,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1570.6480437665782,
     "over_8k_per_1000_calls": 41.11405835543766,
     "cap_hits_per_1000_calls": 5.968169761273209,
     "t_first_iso": "2026-10-27T07:59:03-07:00",
     "t_last_iso": "2026-10-28T06:02:34-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293603_0",
      "293603_1",
      "302850_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4779,
     "completion_sum": 7724325,
     "over_8k": 212,
     "cap_hits": 52,
     "length_finish": 52,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081917.405,
     "t_last": 1793158644.195,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1616.3057124921531,
     "over_8k_per_1000_calls": 44.36074492571668,
     "cap_hits_per_1000_calls": 10.88093743460975,
     "t_first_iso": "2026-10-26T23:18:37-07:00",
     "t_last_iso": "2026-10-27T20:37:24-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293492_0",
      "296438_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4365,
     "completion_sum": 5607209,
     "over_8k": 130,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987869.833,
     "t_last": 1793152867.421,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1284.5839633447881,
     "over_8k_per_1000_calls": 29.782359679266897,
     "cap_hits_per_1000_calls": 6.643757159221077,
     "t_first_iso": "2026-10-25T21:11:09-07:00",
     "t_last_iso": "2026-10-27T19:01:07-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293518_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4538,
     "completion_sum": 5970332,
     "over_8k": 143,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793029369.194,
     "t_last": 1793041104.535,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1315.6306743058617,
     "over_8k_per_1000_calls": 31.511679153812253,
     "cap_hits_per_1000_calls": 8.373732921992067,
     "t_first_iso": "2026-10-26T08:42:49-07:00",
     "t_last_iso": "2026-10-26T11:58:24-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293598_0",
      "302040_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4516,
     "completion_sum": 5625151,
     "over_8k": 127,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081781.187,
     "t_last": 1793155197.661,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1245.6047387068202,
     "over_8k_per_1000_calls": 28.12223206377325,
     "cap_hits_per_1000_calls": 3.9858281665190436,
     "t_first_iso": "2026-10-26T23:16:21-07:00",
     "t_last_iso": "2026-10-27T19:39:57-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293565_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4454,
     "completion_sum": 4644185,
     "over_8k": 88,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793066565.766,
     "t_last": 1793077155.043,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1042.6998203861697,
     "over_8k_per_1000_calls": 19.757521329142342,
     "cap_hits_per_1000_calls": 3.816793893129771,
     "t_first_iso": "2026-10-26T19:02:45-07:00",
     "t_last_iso": "2026-10-26T21:59:15-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293581_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4521,
     "completion_sum": 5113964,
     "over_8k": 74,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793077759.051,
     "t_last": 1793089316.216,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1131.157708471577,
     "over_8k_per_1000_calls": 16.368060163680603,
     "cap_hits_per_1000_calls": 1.9907100199071002,
     "t_first_iso": "2026-10-26T22:09:19-07:00",
     "t_last_iso": "2026-10-27T01:21:56-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293628_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3782,
     "completion_sum": 4324896,
     "over_8k": 86,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086689.855,
     "t_last": 1793095999.705,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1143.5473294553146,
     "over_8k_per_1000_calls": 22.739291380222106,
     "cap_hits_per_1000_calls": 5.817028027498678,
     "t_first_iso": "2026-10-27T00:38:09-07:00",
     "t_last_iso": "2026-10-27T03:13:19-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293483_0",
      "293483_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4993,
     "completion_sum": 5571256,
     "over_8k": 96,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987703.69,
     "t_last": 1793025007.697,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1115.8133386741438,
     "over_8k_per_1000_calls": 19.22691768475866,
     "cap_hits_per_1000_calls": 3.2044862807931103,
     "t_first_iso": "2026-10-25T21:08:23-07:00",
     "t_last_iso": "2026-10-26T07:30:07-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293765_0",
      "293765_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4761,
     "completion_sum": 6088656,
     "over_8k": 126,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793121165.11,
     "t_last": 1793146201.531,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1278.8607435412728,
     "over_8k_per_1000_calls": 26.465028355387524,
     "cap_hits_per_1000_calls": 4.620877966813695,
     "t_first_iso": "2026-10-27T10:12:45-07:00",
     "t_last_iso": "2026-10-27T17:10:01-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293660_0",
      "293660_1",
      "304968_0",
      "308421_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4941,
     "completion_sum": 8257557,
     "over_8k": 243,
     "cap_hits": 63,
     "length_finish": 63,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793109867.243,
     "t_last": 1793195533.366,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1671.2319368548876,
     "over_8k_per_1000_calls": 49.18032786885246,
     "cap_hits_per_1000_calls": 12.750455373406194,
     "t_first_iso": "2026-10-27T07:04:27-07:00",
     "t_last_iso": "2026-10-28T06:52:13-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293647_0",
      "293647_1",
      "304666_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5103,
     "completion_sum": 7826140,
     "over_8k": 196,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793107887.449,
     "t_last": 1793160587.067,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1533.6351165980795,
     "over_8k_per_1000_calls": 38.40877914951989,
     "cap_hits_per_1000_calls": 7.4466000391926315,
     "t_first_iso": "2026-10-27T06:31:27-07:00",
     "t_last_iso": "2026-10-27T21:09:47-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293696_0",
      "293696_1",
      "305115_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4538,
     "completion_sum": 7247097,
     "over_8k": 197,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113500.784,
     "t_last": 1793163962.061,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1596.980387836051,
     "over_8k_per_1000_calls": 43.41119435874835,
     "cap_hits_per_1000_calls": 8.373732921992067,
     "t_first_iso": "2026-10-27T08:05:00-07:00",
     "t_last_iso": "2026-10-27T22:06:02-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293780_0",
      "293780_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4965,
     "completion_sum": 6447190,
     "over_8k": 144,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150248.934,
     "t_last": 1793167950.671,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1298.527693856999,
     "over_8k_per_1000_calls": 29.003021148036254,
     "cap_hits_per_1000_calls": 4.431017119838872,
     "t_first_iso": "2026-10-27T18:17:28-07:00",
     "t_last_iso": "2026-10-27T23:12:30-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293451_0",
      "293451_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4662,
     "completion_sum": 6558074,
     "over_8k": 133,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792967703.473,
     "t_last": 1792987692.971,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1406.7082797082796,
     "over_8k_per_1000_calls": 28.52852852852853,
     "cap_hits_per_1000_calls": 4.719004719004719,
     "t_first_iso": "2026-10-25T15:35:03-07:00",
     "t_last_iso": "2026-10-25T21:08:12-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293465_0",
      "294755_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4155,
     "completion_sum": 5872862,
     "over_8k": 157,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792970410.242,
     "t_last": 1793152181.75,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1413.4445246690734,
     "over_8k_per_1000_calls": 37.785800240673886,
     "cap_hits_per_1000_calls": 4.332129963898917,
     "t_first_iso": "2026-10-25T16:20:10-07:00",
     "t_last_iso": "2026-10-27T18:49:41-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293740_0",
      "293740_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5000,
     "completion_sum": 6235609,
     "over_8k": 147,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116910.299,
     "t_last": 1793140574.316,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1247.1218,
     "over_8k_per_1000_calls": 29.4,
     "cap_hits_per_1000_calls": 4.2,
     "t_first_iso": "2026-10-27T09:01:50-07:00",
     "t_last_iso": "2026-10-27T15:36:14-07:00"
    },
    {
     "arm": "jqs_f_u64_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293717_0",
      "293717_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4494,
     "completion_sum": 6604912,
     "over_8k": 163,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114945.269,
     "t_last": 1793137168.747,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1469.7178460169114,
     "over_8k_per_1000_calls": 36.27058299955496,
     "cap_hits_per_1000_calls": 3.3377837116154874,
     "t_first_iso": "2026-10-27T08:29:05-07:00",
     "t_last_iso": "2026-10-27T14:39:28-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "112998_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4204,
     "completion_sum": 5047133,
     "over_8k": 92,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949953.577,
     "t_last": 1790962956.985,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1200.5549476688868,
     "over_8k_per_1000_calls": 21.883920076117985,
     "cap_hits_per_1000_calls": 3.8058991436726926,
     "t_first_iso": "2026-10-02T07:05:53-07:00",
     "t_last_iso": "2026-10-02T10:42:36-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "112999_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4397,
     "completion_sum": 4939512,
     "over_8k": 85,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949932.918,
     "t_last": 1790959926.47,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1123.3823061178075,
     "over_8k_per_1000_calls": 19.33136229247214,
     "cap_hits_per_1000_calls": 2.274277916761428,
     "t_first_iso": "2026-10-02T07:05:32-07:00",
     "t_last_iso": "2026-10-02T09:52:06-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "113000_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4506,
     "completion_sum": 5389085,
     "over_8k": 106,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950000.335,
     "t_last": 1790961400.179,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1195.979804704838,
     "over_8k_per_1000_calls": 23.524189968930315,
     "cap_hits_per_1000_calls": 2.4411895250776743,
     "t_first_iso": "2026-10-02T07:06:40-07:00",
     "t_last_iso": "2026-10-02T10:16:40-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "113001_0",
      "115650_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4618,
     "completion_sum": 4814402,
     "over_8k": 77,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790949993.235,
     "t_last": 1790964574.342,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1042.529666522304,
     "over_8k_per_1000_calls": 16.673884798614118,
     "cap_hits_per_1000_calls": 2.38198354265916,
     "t_first_iso": "2026-10-02T07:06:33-07:00",
     "t_last_iso": "2026-10-02T11:09:34-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "113258_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4267,
     "completion_sum": 4749158,
     "over_8k": 69,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945229.42,
     "t_last": 1790955741.897,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1112.9969533630185,
     "over_8k_per_1000_calls": 16.170611670963208,
     "cap_hits_per_1000_calls": 0.7030700726505742,
     "t_first_iso": "2026-10-02T05:47:09-07:00",
     "t_last_iso": "2026-10-02T08:42:21-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "113259_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3907,
     "completion_sum": 3758341,
     "over_8k": 53,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945206.395,
     "t_last": 1790954275.005,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 961.950601484515,
     "over_8k_per_1000_calls": 13.565395444074738,
     "cap_hits_per_1000_calls": 1.0238034297414895,
     "t_first_iso": "2026-10-02T05:46:46-07:00",
     "t_last_iso": "2026-10-02T08:17:55-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "113260_0",
      "115370_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5387,
     "completion_sum": 5638677,
     "over_8k": 88,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945232.091,
     "t_last": 1790961271.934,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1046.719324299239,
     "over_8k_per_1000_calls": 16.335622795619084,
     "cap_hits_per_1000_calls": 1.6706886950064972,
     "t_first_iso": "2026-10-02T05:47:12-07:00",
     "t_last_iso": "2026-10-02T10:14:31-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "113264_0",
      "113264_1",
      "116179_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4557,
     "completion_sum": 6135897,
     "over_8k": 144,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945223.727,
     "t_last": 1790970375.538,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1346.4772876892694,
     "over_8k_per_1000_calls": 31.599736668861095,
     "cap_hits_per_1000_calls": 9.216589861751151,
     "t_first_iso": "2026-10-02T05:47:03-07:00",
     "t_last_iso": "2026-10-02T12:46:15-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "113002_0",
      "115818_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4740,
     "completion_sum": 3976034,
     "over_8k": 54,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950128.66,
     "t_last": 1790964423.568,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 838.8257383966245,
     "over_8k_per_1000_calls": 11.39240506329114,
     "cap_hits_per_1000_calls": 1.4767932489451476,
     "t_first_iso": "2026-10-02T07:08:48-07:00",
     "t_last_iso": "2026-10-02T11:07:03-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "113003_0",
      "115404_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4693,
     "completion_sum": 3574347,
     "over_8k": 45,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950141.686,
     "t_last": 1790961858.716,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 761.6337097805242,
     "over_8k_per_1000_calls": 9.588749200937567,
     "cap_hits_per_1000_calls": 1.4915832090347325,
     "t_first_iso": "2026-10-02T07:09:01-07:00",
     "t_last_iso": "2026-10-02T10:24:18-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "113004_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4232,
     "completion_sum": 2883979,
     "over_8k": 29,
     "cap_hits": 1,
     "length_finish": 1,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950203.915,
     "t_last": 1790957815.718,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 681.4695179584121,
     "over_8k_per_1000_calls": 6.852551984877127,
     "cap_hits_per_1000_calls": 0.23629489603024575,
     "t_first_iso": "2026-10-02T07:10:03-07:00",
     "t_last_iso": "2026-10-02T09:16:55-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "113005_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4902,
     "completion_sum": 3522272,
     "over_8k": 40,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950214.2,
     "t_last": 1790960364.889,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 718.5377396980824,
     "over_8k_per_1000_calls": 8.159934720522235,
     "cap_hits_per_1000_calls": 1.2239902080783354,
     "t_first_iso": "2026-10-02T07:10:14-07:00",
     "t_last_iso": "2026-10-02T09:59:24-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "113265_1"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 53,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 53,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3725,
     "completion_sum": 2451617,
     "over_8k": 16,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950513.997,
     "t_last": 1790958421.165,
     "attempts_listed": 2,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "113265_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 658.1522147651007,
     "over_8k_per_1000_calls": 4.295302013422819,
     "cap_hits_per_1000_calls": 0.5369127516778524,
     "t_first_iso": "2026-10-02T07:15:13-07:00",
     "t_last_iso": "2026-10-02T09:27:01-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "113274_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4058,
     "completion_sum": 2687162,
     "over_8k": 25,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790945219.692,
     "t_last": 1790952471.339,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 662.1887629374075,
     "over_8k_per_1000_calls": 6.160670280926565,
     "cap_hits_per_1000_calls": 0.7392804337111878,
     "t_first_iso": "2026-10-02T05:46:59-07:00",
     "t_last_iso": "2026-10-02T07:47:51-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "113275_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4863,
     "completion_sum": 3423383,
     "over_8k": 46,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950527.332,
     "t_last": 1790959584.602,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 703.9652477894304,
     "over_8k_per_1000_calls": 9.459181575159366,
     "cap_hits_per_1000_calls": 1.2338062924120914,
     "t_first_iso": "2026-10-02T07:15:27-07:00",
     "t_last_iso": "2026-10-02T09:46:24-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "113276_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4394,
     "completion_sum": 3530424,
     "over_8k": 52,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950548.458,
     "t_last": 1790960512.089,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 803.464724624488,
     "over_8k_per_1000_calls": 11.834319526627219,
     "cap_hits_per_1000_calls": 3.413746017296313,
     "t_first_iso": "2026-10-02T07:15:48-07:00",
     "t_last_iso": "2026-10-02T10:01:52-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "113103_0",
      "113103_1",
      "116065_0",
      "117150_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4798,
     "completion_sum": 6734978,
     "over_8k": 170,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944609.891,
     "t_last": 1790976222.5,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1403.7052938724469,
     "over_8k_per_1000_calls": 35.431429762401,
     "cap_hits_per_1000_calls": 7.919966652771988,
     "t_first_iso": "2026-10-02T05:36:49-07:00",
     "t_last_iso": "2026-10-02T14:23:42-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "113104_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4432,
     "completion_sum": 4655855,
     "over_8k": 77,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944583.024,
     "t_last": 1790954318.106,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1050.508799638989,
     "over_8k_per_1000_calls": 17.373646209386283,
     "cap_hits_per_1000_calls": 1.5794223826714802,
     "t_first_iso": "2026-10-02T05:36:23-07:00",
     "t_last_iso": "2026-10-02T08:18:38-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "113105_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4443,
     "completion_sum": 5073538,
     "over_8k": 99,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944605.256,
     "t_last": 1790955845.012,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1141.9171730812513,
     "over_8k_per_1000_calls": 22.282241728561782,
     "cap_hits_per_1000_calls": 1.350438892640108,
     "t_first_iso": "2026-10-02T05:36:45-07:00",
     "t_last_iso": "2026-10-02T08:44:05-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "113106_0",
      "115305_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4621,
     "completion_sum": 5040218,
     "over_8k": 109,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944592.54,
     "t_last": 1790959160.781,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1090.7201904349708,
     "over_8k_per_1000_calls": 23.58796797230037,
     "cap_hits_per_1000_calls": 4.111664141960615,
     "t_first_iso": "2026-10-02T05:36:32-07:00",
     "t_last_iso": "2026-10-02T09:39:20-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "113277_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4380,
     "completion_sum": 4421779,
     "over_8k": 59,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950588.186,
     "t_last": 1790962226.506,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1009.5385844748859,
     "over_8k_per_1000_calls": 13.470319634703197,
     "cap_hits_per_1000_calls": 0.45662100456621,
     "t_first_iso": "2026-10-02T07:16:28-07:00",
     "t_last_iso": "2026-10-02T10:30:26-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "113278_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3741,
     "completion_sum": 3846696,
     "over_8k": 76,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950565.435,
     "t_last": 1790960717.214,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1028.2534081796312,
     "over_8k_per_1000_calls": 20.315423683507085,
     "cap_hits_per_1000_calls": 1.3365410318096766,
     "t_first_iso": "2026-10-02T07:16:05-07:00",
     "t_last_iso": "2026-10-02T10:05:17-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "113279_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5290,
     "completion_sum": 4955620,
     "over_8k": 60,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950584.447,
     "t_last": 1790961658.029,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 936.7901701323251,
     "over_8k_per_1000_calls": 11.342155009451796,
     "cap_hits_per_1000_calls": 1.1342155009451795,
     "t_first_iso": "2026-10-02T07:16:24-07:00",
     "t_last_iso": "2026-10-02T10:20:58-07:00"
    },
    {
     "arm": "jqs_f_u64",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "113280_0",
      "113280_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 70,
     "timeouts": 0,
     "zero_other": 8,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4596,
     "completion_sum": 5549749,
     "over_8k": 122,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950576.224,
     "t_last": 1790964471.061,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1207.5171888598782,
     "over_8k_per_1000_calls": 26.544821583986074,
     "cap_hits_per_1000_calls": 3.4812880765883376,
     "t_first_iso": "2026-10-02T07:16:16-07:00",
     "t_last_iso": "2026-10-02T11:07:51-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293506_0",
      "293506_1",
      "299542_0",
      "307819_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5366,
     "completion_sum": 10322798,
     "over_8k": 347,
     "cap_hits": 92,
     "length_finish": 92,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793027416.804,
     "t_last": 1793191875.044,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1923.7417070443532,
     "over_8k_per_1000_calls": 64.66641818859486,
     "cap_hits_per_1000_calls": 17.14498695490123,
     "t_first_iso": "2026-10-26T08:10:16-07:00",
     "t_last_iso": "2026-10-28T05:51:15-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293556_0",
      "293556_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5000,
     "completion_sum": 7798111,
     "over_8k": 194,
     "cap_hits": 43,
     "length_finish": 43,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793061683.539,
     "t_last": 1793079135.392,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1559.6222,
     "over_8k_per_1000_calls": 38.8,
     "cap_hits_per_1000_calls": 8.6,
     "t_first_iso": "2026-10-26T17:41:23-07:00",
     "t_last_iso": "2026-10-26T22:32:15-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293711_0",
      "293711_1",
      "305643_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4726,
     "completion_sum": 9291767,
     "over_8k": 318,
     "cap_hits": 79,
     "length_finish": 79,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114419.351,
     "t_last": 1793184936.586,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1966.0954295387219,
     "over_8k_per_1000_calls": 67.28734659331359,
     "cap_hits_per_1000_calls": 16.716038933559034,
     "t_first_iso": "2026-10-27T08:20:19-07:00",
     "t_last_iso": "2026-10-28T03:55:36-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293643_0",
      "293643_1",
      "303070_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5161,
     "completion_sum": 7978422,
     "over_8k": 210,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087806.605,
     "t_last": 1793159593.013,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.477611940298507,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1545.9062197248595,
     "over_8k_per_1000_calls": 40.689788800620036,
     "cap_hits_per_1000_calls": 7.169153264871149,
     "t_first_iso": "2026-10-27T00:56:46-07:00",
     "t_last_iso": "2026-10-27T20:53:13-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293537_0",
      "293537_1",
      "300428_0",
      "307889_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5061,
     "completion_sum": 8915037,
     "over_8k": 231,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793033372.343,
     "t_last": 1793188362.278,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1761.5168938944873,
     "over_8k_per_1000_calls": 45.643153526970956,
     "cap_hits_per_1000_calls": 8.298755186721992,
     "t_first_iso": "2026-10-26T09:49:32-07:00",
     "t_last_iso": "2026-10-28T04:52:42-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293749_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3958,
     "completion_sum": 5152474,
     "over_8k": 93,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117402.469,
     "t_last": 1793129708.02,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1301.7872662961092,
     "over_8k_per_1000_calls": 23.496715512885295,
     "cap_hits_per_1000_calls": 4.295098534613441,
     "t_first_iso": "2026-10-27T09:10:02-07:00",
     "t_last_iso": "2026-10-27T12:35:08-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293678_0",
      "293678_1",
      "305258_0",
      "309284_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5617,
     "completion_sum": 8934195,
     "over_8k": 257,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113052.683,
     "t_last": 1793192762.628,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1590.5634680434396,
     "over_8k_per_1000_calls": 45.75396118924693,
     "cap_hits_per_1000_calls": 6.231084208652305,
     "t_first_iso": "2026-10-27T07:57:32-07:00",
     "t_last_iso": "2026-10-28T06:06:02-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293611_0",
      "293611_1",
      "302884_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4560,
     "completion_sum": 7156488,
     "over_8k": 191,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082127.274,
     "t_last": 1793158024.297,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1569.4052631578948,
     "over_8k_per_1000_calls": 41.8859649122807,
     "cap_hits_per_1000_calls": 5.921052631578948,
     "t_first_iso": "2026-10-26T23:22:07-07:00",
     "t_last_iso": "2026-10-27T20:27:04-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293498_0",
      "293498_1",
      "299359_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4688,
     "completion_sum": 6680216,
     "over_8k": 194,
     "cap_hits": 52,
     "length_finish": 52,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025622.757,
     "t_last": 1793157616.628,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1424.9607508532424,
     "over_8k_per_1000_calls": 41.382252559726965,
     "cap_hits_per_1000_calls": 11.092150170648464,
     "t_first_iso": "2026-10-26T07:40:22-07:00",
     "t_last_iso": "2026-10-27T20:20:16-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293528_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4746,
     "completion_sum": 5674006,
     "over_8k": 126,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031572.568,
     "t_last": 1793042746.924,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1195.534344711336,
     "over_8k_per_1000_calls": 26.548672566371682,
     "cap_hits_per_1000_calls": 6.321112515802781,
     "t_first_iso": "2026-10-26T09:19:32-07:00",
     "t_last_iso": "2026-10-26T12:25:46-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293601_0",
      "293601_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4705,
     "completion_sum": 6080313,
     "over_8k": 156,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081876.241,
     "t_last": 1793107391.608,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1292.3088204038256,
     "over_8k_per_1000_calls": 33.156216790648244,
     "cap_hits_per_1000_calls": 8.926673751328375,
     "t_first_iso": "2026-10-26T23:17:56-07:00",
     "t_last_iso": "2026-10-27T06:23:11-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293573_0",
      "293573_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5133,
     "completion_sum": 6358877,
     "over_8k": 136,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793069521.043,
     "t_last": 1793088342.263,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1238.8227157607637,
     "over_8k_per_1000_calls": 26.49522696278979,
     "cap_hits_per_1000_calls": 3.506721215663355,
     "t_first_iso": "2026-10-26T19:52:01-07:00",
     "t_last_iso": "2026-10-27T01:05:42-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293574_0",
      "293574_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4803,
     "completion_sum": 6081110,
     "over_8k": 131,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793070511.642,
     "t_last": 1793086155.273,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1266.1066000416406,
     "over_8k_per_1000_calls": 27.274620029148448,
     "cap_hits_per_1000_calls": 4.372267332916927,
     "t_first_iso": "2026-10-26T20:08:31-07:00",
     "t_last_iso": "2026-10-27T00:29:15-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293618_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4357,
     "completion_sum": 4806119,
     "over_8k": 80,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793084230.052,
     "t_last": 1793095028.352,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1103.0798714711957,
     "over_8k_per_1000_calls": 18.361257746155612,
     "cap_hits_per_1000_calls": 3.213220105577232,
     "t_first_iso": "2026-10-26T23:57:10-07:00",
     "t_last_iso": "2026-10-27T02:57:08-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293481_0",
      "293481_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5473,
     "completion_sum": 6182396,
     "over_8k": 105,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987509.081,
     "t_last": 1793028068.094,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1129.6173944820025,
     "over_8k_per_1000_calls": 19.185090443997808,
     "cap_hits_per_1000_calls": 2.9234423533710943,
     "t_first_iso": "2026-10-25T21:05:09-07:00",
     "t_last_iso": "2026-10-26T08:21:08-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293762_0",
      "293762_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4632,
     "completion_sum": 6229261,
     "over_8k": 148,
     "cap_hits": 54,
     "length_finish": 54,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793120862.872,
     "t_last": 1793147249.391,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1344.8318221070813,
     "over_8k_per_1000_calls": 31.951640759930914,
     "cap_hits_per_1000_calls": 11.658031088082902,
     "t_first_iso": "2026-10-27T10:07:42-07:00",
     "t_last_iso": "2026-10-27T17:27:29-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293664_0",
      "293664_1",
      "304972_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4734,
     "completion_sum": 8037984,
     "over_8k": 238,
     "cap_hits": 58,
     "length_finish": 58,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110806.613,
     "t_last": 1793162255.467,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1697.9264892268695,
     "over_8k_per_1000_calls": 50.27460920997043,
     "cap_hits_per_1000_calls": 12.251795521757499,
     "t_first_iso": "2026-10-27T07:20:06-07:00",
     "t_last_iso": "2026-10-27T21:37:35-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293652_0",
      "293652_1",
      "304748_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5489,
     "completion_sum": 9098387,
     "over_8k": 254,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108391.642,
     "t_last": 1793162915.42,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.882352941176471,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1657.567316451084,
     "over_8k_per_1000_calls": 46.27436691564948,
     "cap_hits_per_1000_calls": 6.922936782656222,
     "t_first_iso": "2026-10-27T06:39:51-07:00",
     "t_last_iso": "2026-10-27T21:48:35-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293687_0",
      "293687_1",
      "305112_0",
      "308572_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5054,
     "completion_sum": 8704247,
     "over_8k": 255,
     "cap_hits": 47,
     "length_finish": 47,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113117.208,
     "t_last": 1793193789.588,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1722.2491096161457,
     "over_8k_per_1000_calls": 50.45508508112386,
     "cap_hits_per_1000_calls": 9.299564701226751,
     "t_first_iso": "2026-10-27T07:58:37-07:00",
     "t_last_iso": "2026-10-28T06:23:09-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293771_0",
      "293771_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4955,
     "completion_sum": 6992366,
     "over_8k": 174,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793143841.313,
     "t_last": 1793161110.327,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1411.1737638748739,
     "over_8k_per_1000_calls": 35.11604439959637,
     "cap_hits_per_1000_calls": 8.476286579212916,
     "t_first_iso": "2026-10-27T16:30:41-07:00",
     "t_last_iso": "2026-10-27T21:18:30-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293452_0",
      "293452_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 1,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4730,
     "completion_sum": 6178647,
     "over_8k": 113,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792968201.591,
     "t_last": 1792984958.492,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1306.2678646934462,
     "over_8k_per_1000_calls": 23.890063424947147,
     "cap_hits_per_1000_calls": 2.536997885835095,
     "t_first_iso": "2026-10-25T15:43:21-07:00",
     "t_last_iso": "2026-10-25T20:22:38-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293469_0",
      "293469_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4084,
     "completion_sum": 5640888,
     "over_8k": 150,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792985590.513,
     "t_last": 1793024782.583,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1381.2164544564152,
     "over_8k_per_1000_calls": 36.72869735553379,
     "cap_hits_per_1000_calls": 6.121449559255632,
     "t_first_iso": "2026-10-25T20:33:10-07:00",
     "t_last_iso": "2026-10-26T07:26:22-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293730_0",
      "293730_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5379,
     "completion_sum": 7577381,
     "over_8k": 170,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116147.999,
     "t_last": 1793140579.134,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1408.6969696969697,
     "over_8k_per_1000_calls": 31.60438743260829,
     "cap_hits_per_1000_calls": 5.391336679680238,
     "t_first_iso": "2026-10-27T08:49:07-07:00",
     "t_last_iso": "2026-10-27T15:36:19-07:00"
    },
    {
     "arm": "jqs_f_u128_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293716_0",
      "304174_0",
      "308729_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4919,
     "completion_sum": 7557457,
     "over_8k": 202,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 1,
     "excluded_calls": 67,
     "setasides": [
      "293716_0"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114902.296,
     "t_last": 1793194009.321,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1536.3807684488718,
     "over_8k_per_1000_calls": 41.06525716609067,
     "cap_hits_per_1000_calls": 8.9449075015247,
     "t_first_iso": "2026-10-27T08:28:22-07:00",
     "t_last_iso": "2026-10-28T06:26:49-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "113107_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4401,
     "completion_sum": 5398986,
     "over_8k": 122,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944606.283,
     "t_last": 1790956663.333,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1226.7634628493524,
     "over_8k_per_1000_calls": 27.72097250624858,
     "cap_hits_per_1000_calls": 4.08997955010225,
     "t_first_iso": "2026-10-02T05:36:46-07:00",
     "t_last_iso": "2026-10-02T08:57:43-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "113108_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4528,
     "completion_sum": 5287798,
     "over_8k": 103,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944596.116,
     "t_last": 1790955561.643,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1167.7999116607773,
     "over_8k_per_1000_calls": 22.747349823321557,
     "cap_hits_per_1000_calls": 2.65017667844523,
     "t_first_iso": "2026-10-02T05:36:36-07:00",
     "t_last_iso": "2026-10-02T08:39:21-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "113109_0",
      "113109_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4889,
     "completion_sum": 6928134,
     "over_8k": 186,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944611.887,
     "t_last": 1790962406.59,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1417.08611167928,
     "over_8k_per_1000_calls": 38.04458989568419,
     "cap_hits_per_1000_calls": 5.318060953160155,
     "t_first_iso": "2026-10-02T05:36:51-07:00",
     "t_last_iso": "2026-10-02T10:33:26-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "113110_0",
      "115276_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5177,
     "completion_sum": 5987565,
     "over_8k": 113,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944574.448,
     "t_last": 1790963520.449,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1156.570407571953,
     "over_8k_per_1000_calls": 21.827313115704076,
     "cap_hits_per_1000_calls": 0.7726482518833301,
     "t_first_iso": "2026-10-02T05:36:14-07:00",
     "t_last_iso": "2026-10-02T10:52:00-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "113281_0",
      "116066_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4207,
     "completion_sum": 4784891,
     "over_8k": 67,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950584.176,
     "t_last": 1790966978.589,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1137.3641549797956,
     "over_8k_per_1000_calls": 15.925837889232232,
     "cap_hits_per_1000_calls": 1.188495364868077,
     "t_first_iso": "2026-10-02T07:16:24-07:00",
     "t_last_iso": "2026-10-02T11:49:38-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "113282_0",
      "115729_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3973,
     "completion_sum": 4870963,
     "over_8k": 105,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950596.182,
     "t_last": 1790965108.604,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1226.0163604329223,
     "over_8k_per_1000_calls": 26.42839164359426,
     "cap_hits_per_1000_calls": 2.5169896803423106,
     "t_first_iso": "2026-10-02T07:16:36-07:00",
     "t_last_iso": "2026-10-02T11:18:28-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "113283_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4914,
     "completion_sum": 5697682,
     "over_8k": 109,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950601.792,
     "t_last": 1790962546.495,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1159.4794464794466,
     "over_8k_per_1000_calls": 22.181522181522183,
     "cap_hits_per_1000_calls": 1.8315018315018314,
     "t_first_iso": "2026-10-02T07:16:41-07:00",
     "t_last_iso": "2026-10-02T10:35:46-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "113284_0",
      "113284_1",
      "117068_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4603,
     "completion_sum": 6609346,
     "over_8k": 161,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950573.77,
     "t_last": 1790974456.017,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1435.877905713665,
     "over_8k_per_1000_calls": 34.977188789919616,
     "cap_hits_per_1000_calls": 11.514229850097763,
     "t_first_iso": "2026-10-02T07:16:13-07:00",
     "t_last_iso": "2026-10-02T13:54:16-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "113111_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4356,
     "completion_sum": 3315347,
     "over_8k": 44,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944583.453,
     "t_last": 1790952904.478,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 761.0989439853076,
     "over_8k_per_1000_calls": 10.1010101010101,
     "cap_hits_per_1000_calls": 2.9843893480257115,
     "t_first_iso": "2026-10-02T05:36:23-07:00",
     "t_last_iso": "2026-10-02T07:55:04-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "113112_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4746,
     "completion_sum": 3742450,
     "over_8k": 49,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944603.001,
     "t_last": 1790953873.614,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 788.5482511588706,
     "over_8k_per_1000_calls": 10.32448377581121,
     "cap_hits_per_1000_calls": 1.2642225031605563,
     "t_first_iso": "2026-10-02T05:36:43-07:00",
     "t_last_iso": "2026-10-02T08:11:13-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "113113_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4895,
     "completion_sum": 4421336,
     "over_8k": 82,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944640.123,
     "t_last": 1790956064.646,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 903.235137895812,
     "over_8k_per_1000_calls": 16.75178753830439,
     "cap_hits_per_1000_calls": 1.634320735444331,
     "t_first_iso": "2026-10-02T05:37:20-07:00",
     "t_last_iso": "2026-10-02T08:47:44-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "113114_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4741,
     "completion_sum": 3076819,
     "over_8k": 28,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944570.513,
     "t_last": 1790952141.199,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 648.9810166631512,
     "over_8k_per_1000_calls": 5.905927019616115,
     "cap_hits_per_1000_calls": 0.8437038599451593,
     "t_first_iso": "2026-10-02T05:36:10-07:00",
     "t_last_iso": "2026-10-02T07:42:21-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "113285_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4626,
     "completion_sum": 3671661,
     "over_8k": 51,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950657.303,
     "t_last": 1790961945.909,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 793.701037613489,
     "over_8k_per_1000_calls": 11.024643320363165,
     "cap_hits_per_1000_calls": 1.0808473843493298,
     "t_first_iso": "2026-10-02T07:17:37-07:00",
     "t_last_iso": "2026-10-02T10:25:45-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "113286_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3890,
     "completion_sum": 2851877,
     "over_8k": 32,
     "cap_hits": 0,
     "length_finish": 0,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950654.88,
     "t_last": 1790957796.504,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 733.1303341902313,
     "over_8k_per_1000_calls": 8.226221079691516,
     "cap_hits_per_1000_calls": 0.0,
     "t_first_iso": "2026-10-02T07:17:34-07:00",
     "t_last_iso": "2026-10-02T09:16:36-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "113287_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5158,
     "completion_sum": 3671430,
     "over_8k": 28,
     "cap_hits": 1,
     "length_finish": 1,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950641.579,
     "t_last": 1790960057.008,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 711.7933307483521,
     "over_8k_per_1000_calls": 5.428460643660333,
     "cap_hits_per_1000_calls": 0.19387359441644048,
     "t_first_iso": "2026-10-02T07:17:21-07:00",
     "t_last_iso": "2026-10-02T09:54:17-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "113288_0",
      "113288_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4639,
     "completion_sum": 4432923,
     "over_8k": 77,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950630.869,
     "t_last": 1790968319.478,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 955.5772795861177,
     "over_8k_per_1000_calls": 16.598404828626858,
     "cap_hits_per_1000_calls": 2.802328087949989,
     "t_first_iso": "2026-10-02T07:17:10-07:00",
     "t_last_iso": "2026-10-02T12:11:59-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "113115_0",
      "113115_1",
      "116180_0",
      "117151_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5126,
     "completion_sum": 7128781,
     "over_8k": 186,
     "cap_hits": 36,
     "length_finish": 36,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944594.907,
     "t_last": 1790976691.031,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1390.7103004291846,
     "over_8k_per_1000_calls": 36.28560280920796,
     "cap_hits_per_1000_calls": 7.023019898556379,
     "t_first_iso": "2026-10-02T05:36:34-07:00",
     "t_last_iso": "2026-10-02T14:31:31-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "113116_0",
      "115347_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 72,
     "timeouts": 3,
     "zero_other": 6,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6262,
     "completion_sum": 7500918,
     "over_8k": 170,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944591.943,
     "t_last": 1790962712.228,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.166666666666667,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1197.8470137336315,
     "over_8k_per_1000_calls": 27.147876077930373,
     "cap_hits_per_1000_calls": 4.631108272117534,
     "t_first_iso": "2026-10-02T05:36:31-07:00",
     "t_last_iso": "2026-10-02T10:38:32-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "113117_0",
      "115354_0",
      "116181_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4717,
     "completion_sum": 6465135,
     "over_8k": 171,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944596.396,
     "t_last": 1790968421.05,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1370.6031375874497,
     "over_8k_per_1000_calls": 36.25185499258003,
     "cap_hits_per_1000_calls": 6.783972864108543,
     "t_first_iso": "2026-10-02T05:36:36-07:00",
     "t_last_iso": "2026-10-02T12:13:41-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "113118_0",
      "115350_0",
      "116182_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5236,
     "completion_sum": 6707773,
     "over_8k": 185,
     "cap_hits": 45,
     "length_finish": 45,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790944609.027,
     "t_last": 1790970754.474,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1281.087280366692,
     "over_8k_per_1000_calls": 35.33231474407945,
     "cap_hits_per_1000_calls": 8.594346829640948,
     "t_first_iso": "2026-10-02T05:36:49-07:00",
     "t_last_iso": "2026-10-02T12:52:34-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "113289_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4360,
     "completion_sum": 4813442,
     "over_8k": 73,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950666.659,
     "t_last": 1790961618.46,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1104.0004587155963,
     "over_8k_per_1000_calls": 16.743119266055047,
     "cap_hits_per_1000_calls": 1.834862385321101,
     "t_first_iso": "2026-10-02T07:17:46-07:00",
     "t_last_iso": "2026-10-02T10:20:18-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "113290_0",
      "113290_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4227,
     "completion_sum": 4781848,
     "over_8k": 87,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950674.339,
     "t_last": 1790964973.581,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1131.2628341613438,
     "over_8k_per_1000_calls": 20.5819730305181,
     "cap_hits_per_1000_calls": 1.6560208185474332,
     "t_first_iso": "2026-10-02T07:17:54-07:00",
     "t_last_iso": "2026-10-02T11:16:13-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "113291_0",
      "113291_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5050,
     "completion_sum": 6042199,
     "over_8k": 113,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950672.904,
     "t_last": 1790966614.491,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1196.4750495049504,
     "over_8k_per_1000_calls": 22.376237623762375,
     "cap_hits_per_1000_calls": 1.7821782178217822,
     "t_first_iso": "2026-10-02T07:17:52-07:00",
     "t_last_iso": "2026-10-02T11:43:34-07:00"
    },
    {
     "arm": "jqs_f_u128",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "113292_0",
      "113292_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4758,
     "completion_sum": 6396425,
     "over_8k": 147,
     "cap_hits": 23,
     "length_finish": 23,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1790950651.214,
     "t_last": 1790968039.524,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1344.351618327028,
     "over_8k_per_1000_calls": 30.8953341740227,
     "cap_hits_per_1000_calls": 4.833963850357293,
     "t_first_iso": "2026-10-02T07:17:31-07:00",
     "t_last_iso": "2026-10-02T12:07:19-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard0of16",
     "attempt_tags": [
      "293512_0",
      "293512_1",
      "299998_0",
      "307825_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 44,
     "timeouts": 10,
     "zero_other": 5,
     "instances": 32,
     "first_timeouts": 6,
     "counted_zero": 3,
     "counted_timeouts": 1,
     "calls": 7899,
     "completion_sum": 7387114,
     "over_8k": 131,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028057.05,
     "t_last": 1793192010.805,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 22.727272727272727,
     "first_timeouts_per_100_instances": 18.75,
     "completion_per_call": 935.1961007722497,
     "over_8k_per_1000_calls": 16.58437776933789,
     "cap_hits_per_1000_calls": 3.1649575895682998,
     "t_first_iso": "2026-10-26T08:20:57-07:00",
     "t_last_iso": "2026-10-28T05:53:30-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard1of16",
     "attempt_tags": [
      "293515_0",
      "293515_1",
      "300143_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 41,
     "timeouts": 6,
     "zero_other": 4,
     "instances": 32,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7491,
     "completion_sum": 6462234,
     "over_8k": 116,
     "cap_hits": 47,
     "length_finish": 47,
     "non200": 4,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028261.129,
     "t_last": 1793158223.993,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 14.634146341463415,
     "first_timeouts_per_100_instances": 12.5,
     "completion_per_call": 862.6663996796156,
     "over_8k_per_1000_calls": 15.485248965425177,
     "cap_hits_per_1000_calls": 6.274195701508477,
     "t_first_iso": "2026-10-26T08:24:21-07:00",
     "t_last_iso": "2026-10-27T20:30:23-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard2of16",
     "attempt_tags": [
      "293557_0",
      "293557_1",
      "301981_0",
      "307892_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 43,
     "timeouts": 9,
     "zero_other": 3,
     "instances": 32,
     "first_timeouts": 8,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 8210,
     "completion_sum": 8288218,
     "over_8k": 82,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065153.545,
     "t_last": 1793192814.596,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 20.930232558139537,
     "first_timeouts_per_100_instances": 25.0,
     "completion_per_call": 1009.5271619975639,
     "over_8k_per_1000_calls": 9.987819732034104,
     "cap_hits_per_1000_calls": 1.0962241169305724,
     "t_first_iso": "2026-10-26T18:39:13-07:00",
     "t_last_iso": "2026-10-28T06:06:54-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard3of16",
     "attempt_tags": [
      "293547_0",
      "293547_1",
      "301386_0",
      "307890_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 42,
     "timeouts": 10,
     "zero_other": 1,
     "instances": 32,
     "first_timeouts": 6,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 8095,
     "completion_sum": 7472767,
     "over_8k": 85,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793057080.147,
     "t_last": 1793192727.625,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 23.80952380952381,
     "first_timeouts_per_100_instances": 18.75,
     "completion_per_call": 923.1336627547869,
     "over_8k_per_1000_calls": 10.500308832612724,
     "cap_hits_per_1000_calls": 1.8529956763434219,
     "t_first_iso": "2026-10-26T16:24:40-07:00",
     "t_last_iso": "2026-10-28T06:05:27-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard4of16",
     "attempt_tags": [
      "293707_0",
      "293707_1",
      "305786_0",
      "310162_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 42,
     "timeouts": 6,
     "zero_other": 7,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7733,
     "completion_sum": 6331256,
     "over_8k": 72,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 7,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114388.799,
     "t_last": 1793198144.334,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 14.285714285714286,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 818.7321867321867,
     "over_8k_per_1000_calls": 9.310746152851417,
     "cap_hits_per_1000_calls": 1.422475106685633,
     "t_first_iso": "2026-10-27T08:19:48-07:00",
     "t_last_iso": "2026-10-28T07:35:44-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard5of16",
     "attempt_tags": [
      "293701_0",
      "293701_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6585,
     "completion_sum": 4581646,
     "over_8k": 17,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113924.939,
     "t_last": 1793136539.685,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 695.7700835231587,
     "over_8k_per_1000_calls": 2.5816249050873195,
     "cap_hits_per_1000_calls": 0.7593014426727411,
     "t_first_iso": "2026-10-27T08:12:04-07:00",
     "t_last_iso": "2026-10-27T14:28:59-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard6of16",
     "attempt_tags": [
      "293644_0",
      "293644_1",
      "303143_0",
      "308314_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 36,
     "timeouts": 5,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 6812,
     "completion_sum": 5810621,
     "over_8k": 83,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087947.917,
     "t_last": 1793195033.623,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 13.88888888888889,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 852.9977980035231,
     "over_8k_per_1000_calls": 12.184380504991193,
     "cap_hits_per_1000_calls": 2.6423957721667644,
     "t_first_iso": "2026-10-27T00:59:07-07:00",
     "t_last_iso": "2026-10-28T06:43:53-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard7of16",
     "attempt_tags": [
      "293631_0",
      "293631_1",
      "303282_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 40,
     "timeouts": 7,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 5,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7724,
     "completion_sum": 6484139,
     "over_8k": 64,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086829.795,
     "t_last": 1793162822.968,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 17.5,
     "first_timeouts_per_100_instances": 16.129032258064516,
     "completion_per_call": 839.4794148109788,
     "over_8k_per_1000_calls": 8.285862247540134,
     "cap_hits_per_1000_calls": 1.0357327809425168,
     "t_first_iso": "2026-10-27T00:40:29-07:00",
     "t_last_iso": "2026-10-27T21:47:02-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard8of16",
     "attempt_tags": [
      "293540_0",
      "293540_1",
      "300080_0",
      "307831_0",
      "310310_0"
     ],
     "units": 1,
     "attempts": 5,
     "episodes": 37,
     "timeouts": 6,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 6777,
     "completion_sum": 6314902,
     "over_8k": 148,
     "cap_hits": 64,
     "length_finish": 64,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [
      "293540_1"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793035001.938,
     "t_last": 1793198814.796,
     "attempts_listed": 5,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 16.216216216216218,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 931.8137819093995,
     "over_8k_per_1000_calls": 21.838571639368453,
     "cap_hits_per_1000_calls": 9.443706654862034,
     "t_first_iso": "2026-10-26T10:16:41-07:00",
     "t_last_iso": "2026-10-28T07:46:54-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard9of16",
     "attempt_tags": [
      "293538_0",
      "293538_1",
      "300429_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 40,
     "timeouts": 2,
     "zero_other": 8,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7824,
     "completion_sum": 5179750,
     "over_8k": 31,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 8,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793033381.844,
     "t_last": 1793158195.893,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.0,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 662.0334867075665,
     "over_8k_per_1000_calls": 3.962167689161554,
     "cap_hits_per_1000_calls": 0.3834355828220859,
     "t_first_iso": "2026-10-26T09:49:41-07:00",
     "t_last_iso": "2026-10-27T20:29:55-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard10of16",
     "attempt_tags": [
      "293750_0",
      "293750_1",
      "307027_0",
      "310287_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 46,
     "timeouts": 9,
     "zero_other": 9,
     "instances": 31,
     "first_timeouts": 6,
     "counted_zero": 3,
     "counted_timeouts": 0,
     "calls": 8687,
     "completion_sum": 6926816,
     "over_8k": 84,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 9,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117544.723,
     "t_last": 1793198479.287,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 19.565217391304348,
     "first_timeouts_per_100_instances": 19.35483870967742,
     "completion_per_call": 797.3772303441925,
     "over_8k_per_1000_calls": 9.6696212731668,
     "cap_hits_per_1000_calls": 1.6116035455278002,
     "t_first_iso": "2026-10-27T09:12:24-07:00",
     "t_last_iso": "2026-10-28T07:41:19-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard11of16",
     "attempt_tags": [
      "293753_0",
      "293753_1",
      "307325_0",
      "310425_0",
      "310698_0"
     ],
     "units": 1,
     "attempts": 5,
     "episodes": 62,
     "timeouts": 17,
     "zero_other": 19,
     "instances": 31,
     "first_timeouts": 6,
     "counted_zero": 6,
     "counted_timeouts": 2,
     "calls": 10930,
     "completion_sum": 9535447,
     "over_8k": 164,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 19,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117836.572,
     "t_last": 1793208052.613,
     "attempts_listed": 5,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 27.419354838709676,
     "first_timeouts_per_100_instances": 19.35483870967742,
     "completion_per_call": 872.4105215004574,
     "over_8k_per_1000_calls": 15.004574565416286,
     "cap_hits_per_1000_calls": 2.92772186642269,
     "t_first_iso": "2026-10-27T09:17:16-07:00",
     "t_last_iso": "2026-10-28T10:20:52-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard12of16",
     "attempt_tags": [
      "293676_0",
      "293676_1",
      "305423_0",
      "310069_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 47,
     "timeouts": 6,
     "zero_other": 12,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 3,
     "counted_timeouts": 0,
     "calls": 8628,
     "completion_sum": 6668835,
     "over_8k": 70,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 12,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793112856.511,
     "t_last": 1793196580.873,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.76595744680851,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 772.9294158553547,
     "over_8k_per_1000_calls": 8.113120074177099,
     "cap_hits_per_1000_calls": 1.7385257301808066,
     "t_first_iso": "2026-10-27T07:54:16-07:00",
     "t_last_iso": "2026-10-28T07:09:40-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard13of16",
     "attempt_tags": [
      "293681_0",
      "293681_1",
      "305367_0",
      "309285_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 41,
     "timeouts": 7,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 3,
     "counted_timeouts": 1,
     "calls": 7631,
     "completion_sum": 6253765,
     "over_8k": 93,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113181.283,
     "t_last": 1793196298.07,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 17.073170731707318,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 819.5210326300615,
     "over_8k_per_1000_calls": 12.187131437557332,
     "cap_hits_per_1000_calls": 2.2277552090158563,
     "t_first_iso": "2026-10-27T07:59:41-07:00",
     "t_last_iso": "2026-10-28T07:04:58-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard14of16",
     "attempt_tags": [
      "293604_0",
      "293604_1",
      "303795_0",
      "308504_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 56,
     "timeouts": 18,
     "zero_other": 12,
     "instances": 31,
     "first_timeouts": 8,
     "counted_zero": 5,
     "counted_timeouts": 3,
     "calls": 9067,
     "completion_sum": 10429259,
     "over_8k": 296,
     "cap_hits": 117,
     "length_finish": 117,
     "non200": 12,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081904.391,
     "t_last": 1793195694.631,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 32.142857142857146,
     "first_timeouts_per_100_instances": 25.806451612903224,
     "completion_per_call": 1150.2436307488695,
     "over_8k_per_1000_calls": 32.645858608139406,
     "cap_hits_per_1000_calls": 12.903937355244292,
     "t_first_iso": "2026-10-26T23:18:24-07:00",
     "t_last_iso": "2026-10-28T06:54:54-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 42,
     "unit": "shard15of16",
     "attempt_tags": [
      "293612_0",
      "293612_1",
      "303323_0",
      "308312_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 47,
     "timeouts": 15,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 7,
     "counted_zero": 4,
     "counted_timeouts": 2,
     "calls": 8086,
     "completion_sum": 9960427,
     "over_8k": 238,
     "cap_hits": 63,
     "length_finish": 63,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082152.126,
     "t_last": 1793194947.141,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 31.914893617021278,
     "first_timeouts_per_100_instances": 22.580645161290324,
     "completion_per_call": 1231.8114024239426,
     "over_8k_per_1000_calls": 29.433588919119465,
     "cap_hits_per_1000_calls": 7.79124412564927,
     "t_first_iso": "2026-10-26T23:22:32-07:00",
     "t_last_iso": "2026-10-28T06:42:27-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard0of16",
     "attempt_tags": [
      "293494_0",
      "293494_1",
      "298505_0",
      "307816_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 42,
     "timeouts": 7,
     "zero_other": 5,
     "instances": 32,
     "first_timeouts": 5,
     "counted_zero": 2,
     "counted_timeouts": 1,
     "calls": 7928,
     "completion_sum": 6528559,
     "over_8k": 92,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792988058.622,
     "t_last": 1793192006.612,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 16.666666666666668,
     "first_timeouts_per_100_instances": 15.625,
     "completion_per_call": 823.4812058526741,
     "over_8k_per_1000_calls": 11.60443995963673,
     "cap_hits_per_1000_calls": 1.3874873864783048,
     "t_first_iso": "2026-10-25T21:14:18-07:00",
     "t_last_iso": "2026-10-28T05:53:26-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard1of16",
     "attempt_tags": [
      "293502_0",
      "293502_1",
      "299645_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 6,
     "zero_other": 1,
     "instances": 32,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7149,
     "completion_sum": 5949497,
     "over_8k": 82,
     "cap_hits": 46,
     "length_finish": 46,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793025958.445,
     "t_last": 1793157938.95,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.789473684210526,
     "first_timeouts_per_100_instances": 9.375,
     "completion_per_call": 832.2138760665828,
     "over_8k_per_1000_calls": 11.470135683312352,
     "cap_hits_per_1000_calls": 6.434466358931319,
     "t_first_iso": "2026-10-26T07:45:58-07:00",
     "t_last_iso": "2026-10-27T20:25:38-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard2of16",
     "attempt_tags": [
      "293524_0",
      "293524_1",
      "300294_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 5,
     "zero_other": 1,
     "instances": 32,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7437,
     "completion_sum": 6832362,
     "over_8k": 61,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793030782.291,
     "t_last": 1793158340.771,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 13.157894736842104,
     "first_timeouts_per_100_instances": 15.625,
     "completion_per_call": 918.6986688180718,
     "over_8k_per_1000_calls": 8.202232082829097,
     "cap_hits_per_1000_calls": 1.210165389269867,
     "t_first_iso": "2026-10-26T09:06:22-07:00",
     "t_last_iso": "2026-10-27T20:32:20-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard3of16",
     "attempt_tags": [
      "293520_0",
      "293520_1",
      "300183_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7337,
     "completion_sum": 6874120,
     "over_8k": 92,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793030698.048,
     "t_last": 1793157083.517,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.789473684210526,
     "first_timeouts_per_100_instances": 12.5,
     "completion_per_call": 936.9115442278861,
     "over_8k_per_1000_calls": 12.539184952978056,
     "cap_hits_per_1000_calls": 2.725909772386534,
     "t_first_iso": "2026-10-26T09:04:58-07:00",
     "t_last_iso": "2026-10-27T20:11:23-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard4of16",
     "attempt_tags": [
      "293599_0",
      "293599_1",
      "303006_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 37,
     "timeouts": 3,
     "zero_other": 4,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7240,
     "completion_sum": 5895890,
     "over_8k": 60,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 4,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081843.748,
     "t_last": 1793161699.243,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.108108108108109,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 814.3494475138122,
     "over_8k_per_1000_calls": 8.287292817679559,
     "cap_hits_per_1000_calls": 1.5193370165745856,
     "t_first_iso": "2026-10-26T23:17:23-07:00",
     "t_last_iso": "2026-10-27T21:28:19-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard5of16",
     "attempt_tags": [
      "293595_0",
      "293595_1",
      "302920_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 35,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6824,
     "completion_sum": 5539647,
     "over_8k": 54,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793080126.826,
     "t_last": 1793158087.154,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.428571428571429,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 811.7888335287222,
     "over_8k_per_1000_calls": 7.913247362250879,
     "cap_hits_per_1000_calls": 1.611957796014068,
     "t_first_iso": "2026-10-26T22:48:46-07:00",
     "t_last_iso": "2026-10-27T20:28:07-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard6of16",
     "attempt_tags": [
      "293567_0",
      "293567_1",
      "301716_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 34,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6702,
     "completion_sum": 4861498,
     "over_8k": 27,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793067386.67,
     "t_last": 1793157119.378,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.882352941176471,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 725.3801850193972,
     "over_8k_per_1000_calls": 4.028648164726947,
     "cap_hits_per_1000_calls": 0.5968367651447329,
     "t_first_iso": "2026-10-26T19:16:26-07:00",
     "t_last_iso": "2026-10-27T20:11:59-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard7of16",
     "attempt_tags": [
      "293566_0",
      "293566_1",
      "301830_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 36,
     "timeouts": 3,
     "zero_other": 2,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7105,
     "completion_sum": 5705794,
     "over_8k": 56,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793067382.811,
     "t_last": 1793158723.054,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.333333333333334,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 803.0674173117523,
     "over_8k_per_1000_calls": 7.8817733990147785,
     "cap_hits_per_1000_calls": 1.266713581984518,
     "t_first_iso": "2026-10-26T19:16:22-07:00",
     "t_last_iso": "2026-10-27T20:38:43-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard8of16",
     "attempt_tags": [
      "293577_0",
      "293577_1",
      "301754_0",
      "308143_0",
      "310394_0"
     ],
     "units": 1,
     "attempts": 5,
     "episodes": 36,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7012,
     "completion_sum": 5454589,
     "over_8k": 92,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [
      "293577_1"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793071055.374,
     "t_last": 1793198591.596,
     "attempts_listed": 5,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "293577_1"
     ],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.11111111111111,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 777.8934683399885,
     "over_8k_per_1000_calls": 13.120365088419852,
     "cap_hits_per_1000_calls": 2.7096406160867086,
     "t_first_iso": "2026-10-26T20:17:35-07:00",
     "t_last_iso": "2026-10-28T07:43:11-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard9of16",
     "attempt_tags": [
      "293582_0",
      "293582_1",
      "302848_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 39,
     "timeouts": 2,
     "zero_other": 8,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7487,
     "completion_sum": 4946356,
     "over_8k": 24,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 8,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793078069.297,
     "t_last": 1793158558.735,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.128205128205129,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 660.6592760785361,
     "over_8k_per_1000_calls": 3.2055562975824765,
     "cap_hits_per_1000_calls": 0.6678242286630159,
     "t_first_iso": "2026-10-26T22:14:29-07:00",
     "t_last_iso": "2026-10-27T20:35:58-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard10of16",
     "attempt_tags": [
      "293616_0",
      "293616_1",
      "303280_0",
      "308313_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 50,
     "timeouts": 11,
     "zero_other": 9,
     "instances": 31,
     "first_timeouts": 8,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 9389,
     "completion_sum": 7915540,
     "over_8k": 130,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 9,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793084147.736,
     "t_last": 1793193641.042,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 22.0,
     "first_timeouts_per_100_instances": 25.806451612903224,
     "completion_per_call": 843.0652891681755,
     "over_8k_per_1000_calls": 13.845989988284161,
     "cap_hits_per_1000_calls": 2.2366599211843647,
     "t_first_iso": "2026-10-26T23:55:47-07:00",
     "t_last_iso": "2026-10-28T06:20:41-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard11of16",
     "attempt_tags": [
      "293625_0",
      "293625_1",
      "303281_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 44,
     "timeouts": 4,
     "zero_other": 11,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7966,
     "completion_sum": 5405441,
     "over_8k": 62,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 11,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086619.796,
     "t_last": 1793161697.358,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 9.090909090909092,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 678.5640220938991,
     "over_8k_per_1000_calls": 7.7830780818478535,
     "cap_hits_per_1000_calls": 1.2553351744915893,
     "t_first_iso": "2026-10-27T00:36:59-07:00",
     "t_last_iso": "2026-10-27T21:28:17-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard12of16",
     "attempt_tags": [
      "293477_0",
      "293477_1",
      "298110_0",
      "307768_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 46,
     "timeouts": 9,
     "zero_other": 10,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 4,
     "counted_timeouts": 1,
     "calls": 8401,
     "completion_sum": 6694649,
     "over_8k": 76,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 10,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987542.489,
     "t_last": 1793192025.853,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 19.565217391304348,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 796.8871562909178,
     "over_8k_per_1000_calls": 9.04654207832401,
     "cap_hits_per_1000_calls": 2.023568622783002,
     "t_first_iso": "2026-10-25T21:05:42-07:00",
     "t_last_iso": "2026-10-28T05:53:45-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard13of16",
     "attempt_tags": [
      "293485_0",
      "293485_1",
      "298357_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 36,
     "timeouts": 3,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 6913,
     "completion_sum": 5476510,
     "over_8k": 67,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987646.907,
     "t_last": 1793156859.85,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.333333333333334,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 792.2045421669319,
     "over_8k_per_1000_calls": 9.691884854621728,
     "cap_hits_per_1000_calls": 1.8805149717922753,
     "t_first_iso": "2026-10-25T21:07:26-07:00",
     "t_last_iso": "2026-10-27T20:07:39-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard14of16",
     "attempt_tags": [
      "293763_0",
      "293763_1",
      "307028_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 41,
     "timeouts": 7,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 2,
     "counted_timeouts": 1,
     "calls": 7319,
     "completion_sum": 6556521,
     "over_8k": 132,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793121180.457,
     "t_last": 1793192076.209,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 17.073170731707318,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 895.8219702145102,
     "over_8k_per_1000_calls": 18.035250717311108,
     "cap_hits_per_1000_calls": 4.37218199207542,
     "t_first_iso": "2026-10-27T10:13:00-07:00",
     "t_last_iso": "2026-10-28T05:54:36-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 43,
     "unit": "shard15of16",
     "attempt_tags": [
      "293758_0",
      "293758_1",
      "307326_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 46,
     "timeouts": 10,
     "zero_other": 8,
     "instances": 31,
     "first_timeouts": 5,
     "counted_zero": 3,
     "counted_timeouts": 2,
     "calls": 8217,
     "completion_sum": 8246562,
     "over_8k": 178,
     "cap_hits": 57,
     "length_finish": 57,
     "non200": 8,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119731.769,
     "t_last": 1793194065.984,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 21.73913043478261,
     "first_timeouts_per_100_instances": 16.129032258064516,
     "completion_per_call": 1003.5976633807959,
     "over_8k_per_1000_calls": 21.662407204575878,
     "cap_hits_per_1000_calls": 6.936838262139467,
     "t_first_iso": "2026-10-27T09:48:51-07:00",
     "t_last_iso": "2026-10-28T06:27:45-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard0of16",
     "attempt_tags": [
      "293667_0",
      "293667_1",
      "305198_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 42,
     "timeouts": 3,
     "zero_other": 9,
     "instances": 32,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7892,
     "completion_sum": 5730077,
     "over_8k": 74,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 9,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110947.798,
     "t_last": 1793166335.746,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.142857142857143,
     "first_timeouts_per_100_instances": 9.375,
     "completion_per_call": 726.0614546376077,
     "over_8k_per_1000_calls": 9.37658388241257,
     "cap_hits_per_1000_calls": 2.6609224531170805,
     "t_first_iso": "2026-10-27T07:22:27-07:00",
     "t_last_iso": "2026-10-27T22:45:35-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard1of16",
     "attempt_tags": [
      "293659_0",
      "293659_1",
      "305150_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 42,
     "timeouts": 6,
     "zero_other": 5,
     "instances": 32,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7900,
     "completion_sum": 6442759,
     "over_8k": 114,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793109802.199,
     "t_last": 1793165651.635,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 14.285714285714286,
     "first_timeouts_per_100_instances": 9.375,
     "completion_per_call": 815.5391139240506,
     "over_8k_per_1000_calls": 14.430379746835444,
     "cap_hits_per_1000_calls": 6.708860759493671,
     "t_first_iso": "2026-10-27T07:03:22-07:00",
     "t_last_iso": "2026-10-27T22:34:11-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard2of16",
     "attempt_tags": [
      "293655_0",
      "293655_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 35,
     "timeouts": 1,
     "zero_other": 1,
     "instances": 32,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6808,
     "completion_sum": 5465596,
     "over_8k": 36,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108549.2,
     "t_last": 1793132887.439,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 2.857142857142857,
     "first_timeouts_per_100_instances": 3.125,
     "completion_per_call": 802.8196239717979,
     "over_8k_per_1000_calls": 5.287896592244419,
     "cap_hits_per_1000_calls": 0.5875440658049353,
     "t_first_iso": "2026-10-27T06:42:29-07:00",
     "t_last_iso": "2026-10-27T13:28:07-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard3of16",
     "attempt_tags": [
      "293648_0",
      "293648_1",
      "305051_0",
      "308505_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 40,
     "timeouts": 6,
     "zero_other": 3,
     "instances": 32,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7691,
     "completion_sum": 6526096,
     "over_8k": 88,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793107907.785,
     "t_last": 1793195376.228,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.0,
     "first_timeouts_per_100_instances": 9.375,
     "completion_per_call": 848.5367312443116,
     "over_8k_per_1000_calls": 11.441945130672215,
     "cap_hits_per_1000_calls": 4.940839942790275,
     "t_first_iso": "2026-10-27T06:31:47-07:00",
     "t_last_iso": "2026-10-28T06:49:36-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard4of16",
     "attempt_tags": [
      "293694_0",
      "293694_1",
      "305518_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 39,
     "timeouts": 4,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7222,
     "completion_sum": 5405906,
     "over_8k": 64,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113523.456,
     "t_last": 1793186637.597,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.256410256410257,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 748.5330933259485,
     "over_8k_per_1000_calls": 8.861811132650235,
     "cap_hits_per_1000_calls": 1.938521185267239,
     "t_first_iso": "2026-10-27T08:05:23-07:00",
     "t_last_iso": "2026-10-28T04:23:57-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard5of16",
     "attempt_tags": [
      "293697_0",
      "293697_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6233,
     "completion_sum": 4312476,
     "over_8k": 47,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113495.065,
     "t_last": 1793134409.597,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 691.8780683459008,
     "over_8k_per_1000_calls": 7.540510187710573,
     "cap_hits_per_1000_calls": 0.48130916091769615,
     "t_first_iso": "2026-10-27T08:04:55-07:00",
     "t_last_iso": "2026-10-27T13:53:29-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard6of16",
     "attempt_tags": [
      "293779_0",
      "293779_1",
      "309287_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 39,
     "timeouts": 4,
     "zero_other": 6,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7676,
     "completion_sum": 5456062,
     "over_8k": 47,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150286.238,
     "t_last": 1793195516.396,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.256410256410257,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 710.7949452840021,
     "over_8k_per_1000_calls": 6.122980719124544,
     "cap_hits_per_1000_calls": 1.1724856696195936,
     "t_first_iso": "2026-10-27T18:18:06-07:00",
     "t_last_iso": "2026-10-28T06:51:56-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard7of16",
     "attempt_tags": [
      "293784_0",
      "293784_1",
      "309478_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 37,
     "timeouts": 5,
     "zero_other": 2,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7134,
     "completion_sum": 5474368,
     "over_8k": 73,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150399.11,
     "t_last": 1793196528.133,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 13.513513513513514,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 767.363050182226,
     "over_8k_per_1000_calls": 10.23268853378189,
     "cap_hits_per_1000_calls": 2.943650126156434,
     "t_first_iso": "2026-10-27T18:19:59-07:00",
     "t_last_iso": "2026-10-28T07:08:48-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard8of16",
     "attempt_tags": [
      "293460_0",
      "293460_1",
      "295981_0",
      "307590_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 39,
     "timeouts": 5,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7333,
     "completion_sum": 5711279,
     "over_8k": 95,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792969633.483,
     "t_last": 1793188980.653,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.820512820512821,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 778.8461748261285,
     "over_8k_per_1000_calls": 12.955134324287467,
     "cap_hits_per_1000_calls": 4.5002045547524885,
     "t_first_iso": "2026-10-25T16:07:13-07:00",
     "t_last_iso": "2026-10-28T05:03:00-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard9of16",
     "attempt_tags": [
      "293457_0",
      "293457_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 36,
     "timeouts": 2,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7121,
     "completion_sum": 4127743,
     "over_8k": 19,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792969408.862,
     "t_last": 1792988983.874,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.555555555555555,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 579.6577727847213,
     "over_8k_per_1000_calls": 2.668164583625895,
     "cap_hits_per_1000_calls": 0.2808594298553574,
     "t_first_iso": "2026-10-25T16:03:28-07:00",
     "t_last_iso": "2026-10-25T21:29:43-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard10of16",
     "attempt_tags": [
      "293462_0",
      "293462_1",
      "295982_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 41,
     "timeouts": 4,
     "zero_other": 9,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 3,
     "counted_timeouts": 0,
     "calls": 7883,
     "completion_sum": 5452218,
     "over_8k": 67,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 9,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792970090.68,
     "t_last": 1793156783.642,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 9.75609756097561,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 691.642521882532,
     "over_8k_per_1000_calls": 8.499302296080172,
     "cap_hits_per_1000_calls": 1.7759736141063047,
     "t_first_iso": "2026-10-25T16:14:50-07:00",
     "t_last_iso": "2026-10-27T20:06:23-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard11of16",
     "attempt_tags": [
      "293472_0",
      "293472_1",
      "298413_0",
      "307767_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 54,
     "timeouts": 6,
     "zero_other": 21,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 4,
     "counted_timeouts": 0,
     "calls": 9476,
     "completion_sum": 6220630,
     "over_8k": 62,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 21,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987310.742,
     "t_last": 1793186763.008,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.11111111111111,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 656.4615871675812,
     "over_8k_per_1000_calls": 6.542845082313212,
     "cap_hits_per_1000_calls": 1.4774166314900803,
     "t_first_iso": "2026-10-25T21:01:50-07:00",
     "t_last_iso": "2026-10-28T04:26:03-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard12of16",
     "attempt_tags": [
      "293732_0",
      "293732_1",
      "306264_0",
      "310163_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 45,
     "timeouts": 6,
     "zero_other": 12,
     "instances": 31,
     "first_timeouts": 5,
     "counted_zero": 4,
     "counted_timeouts": 0,
     "calls": 8067,
     "completion_sum": 6387965,
     "over_8k": 96,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 11,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116244.708,
     "t_last": 1793196656.327,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 13.333333333333334,
     "first_timeouts_per_100_instances": 16.129032258064516,
     "completion_per_call": 791.8637659600843,
     "over_8k_per_1000_calls": 11.900334696913351,
     "cap_hits_per_1000_calls": 2.355274575430767,
     "t_first_iso": "2026-10-27T08:50:44-07:00",
     "t_last_iso": "2026-10-28T07:10:56-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard13of16",
     "attempt_tags": [
      "293731_0",
      "293731_1",
      "306263_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 42,
     "timeouts": 5,
     "zero_other": 6,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 8039,
     "completion_sum": 6377317,
     "over_8k": 86,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116161.633,
     "t_last": 1793190826.647,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.904761904761905,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 793.297300659286,
     "over_8k_per_1000_calls": 10.697847991043663,
     "cap_hits_per_1000_calls": 2.6122652071153127,
     "t_first_iso": "2026-10-27T08:49:21-07:00",
     "t_last_iso": "2026-10-28T05:33:46-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard14of16",
     "attempt_tags": [
      "293723_0",
      "293723_1",
      "306296_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 44,
     "timeouts": 9,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 5,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 7665,
     "completion_sum": 7859344,
     "over_8k": 226,
     "cap_hits": 75,
     "length_finish": 75,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115321.03,
     "t_last": 1793192032.345,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 20.454545454545453,
     "first_timeouts_per_100_instances": 16.129032258064516,
     "completion_per_call": 1025.354729288976,
     "over_8k_per_1000_calls": 29.48467058056099,
     "cap_hits_per_1000_calls": 9.784735812133073,
     "t_first_iso": "2026-10-27T08:35:21-07:00",
     "t_last_iso": "2026-10-28T05:53:52-07:00"
    },
    {
     "arm": "quest_b2048_s1_sxs",
     "seed": 44,
     "unit": "shard15of16",
     "attempt_tags": [
      "293720_0",
      "293720_1",
      "306262_0",
      "310286_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 50,
     "timeouts": 11,
     "zero_other": 13,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 6,
     "counted_timeouts": 2,
     "calls": 8667,
     "completion_sum": 8680208,
     "over_8k": 228,
     "cap_hits": 71,
     "length_finish": 71,
     "non200": 13,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115225.871,
     "t_last": 1793198651.113,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 22.0,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 1001.5239413868698,
     "over_8k_per_1000_calls": 26.30668051228799,
     "cap_hits_per_1000_calls": 8.191992615668628,
     "t_first_iso": "2026-10-27T08:33:45-07:00",
     "t_last_iso": "2026-10-28T07:44:11-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard0of16",
     "attempt_tags": [
      "127312_0",
      "127312_1",
      "129021_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 3,
     "zero_other": 4,
     "instances": 32,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7206,
     "completion_sum": 4894747,
     "over_8k": 59,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 4,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791068491.452,
     "t_last": 1791092539.746,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.894736842105263,
     "first_timeouts_per_100_instances": 6.25,
     "completion_per_call": 679.259922286983,
     "over_8k_per_1000_calls": 8.187621426588954,
     "cap_hits_per_1000_calls": 1.2489592006661117,
     "t_first_iso": "2026-10-03T16:01:31-07:00",
     "t_last_iso": "2026-10-03T22:42:19-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard1of16",
     "attempt_tags": [
      "127313_0",
      "127313_1",
      "129387_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 40,
     "timeouts": 6,
     "zero_other": 3,
     "instances": 32,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7441,
     "completion_sum": 5872822,
     "over_8k": 108,
     "cap_hits": 62,
     "length_finish": 62,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791068564.661,
     "t_last": 1791098044.301,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.0,
     "first_timeouts_per_100_instances": 12.5,
     "completion_per_call": 789.251713479371,
     "over_8k_per_1000_calls": 14.51417820185459,
     "cap_hits_per_1000_calls": 8.332213412175783,
     "t_first_iso": "2026-10-03T16:02:44-07:00",
     "t_last_iso": "2026-10-04T00:14:04-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard2of16",
     "attempt_tags": [
      "127314_0",
      "127314_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6362,
     "completion_sum": 3404144,
     "over_8k": 20,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791068558.147,
     "t_last": 1791085411.151,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 535.0745048726816,
     "over_8k_per_1000_calls": 3.1436655139893115,
     "cap_hits_per_1000_calls": 0.31436655139893116,
     "t_first_iso": "2026-10-03T16:02:38-07:00",
     "t_last_iso": "2026-10-03T20:43:31-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard3of16",
     "attempt_tags": [
      "127315_0",
      "127315_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6570,
     "completion_sum": 3943556,
     "over_8k": 32,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791068942.972,
     "t_last": 1791086406.249,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.125,
     "completion_per_call": 600.2368340943683,
     "over_8k_per_1000_calls": 4.87062404870624,
     "cap_hits_per_1000_calls": 1.5220700152207,
     "t_first_iso": "2026-10-03T16:09:02-07:00",
     "t_last_iso": "2026-10-03T21:00:06-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard4of16",
     "attempt_tags": [
      "127324_0",
      "127324_1",
      "129092_0",
      "129389_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 37,
     "timeouts": 2,
     "zero_other": 6,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7177,
     "completion_sum": 4274191,
     "over_8k": 31,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069321.824,
     "t_last": 1791095816.221,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.405405405405405,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 595.5400585202731,
     "over_8k_per_1000_calls": 4.3193534903162885,
     "cap_hits_per_1000_calls": 0.9753378849101296,
     "t_first_iso": "2026-10-03T16:15:21-07:00",
     "t_last_iso": "2026-10-03T23:36:56-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard5of16",
     "attempt_tags": [
      "127325_0",
      "127325_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6106,
     "completion_sum": 2925609,
     "over_8k": 11,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069335.634,
     "t_last": 1791085563.407,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 479.13675073698005,
     "over_8k_per_1000_calls": 1.8015067147068458,
     "cap_hits_per_1000_calls": 0.32754667540124466,
     "t_first_iso": "2026-10-03T16:15:35-07:00",
     "t_last_iso": "2026-10-03T20:46:03-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard6of16",
     "attempt_tags": [
      "127326_0",
      "127326_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 31,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6203,
     "completion_sum": 3604345,
     "over_8k": 28,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069355.564,
     "t_last": 1791086647.11,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 581.0648073512816,
     "over_8k_per_1000_calls": 4.513944865387716,
     "cap_hits_per_1000_calls": 1.128486216346929,
     "t_first_iso": "2026-10-03T16:15:55-07:00",
     "t_last_iso": "2026-10-03T21:04:07-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard7of16",
     "attempt_tags": [
      "127327_0",
      "127327_1",
      "129170_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 33,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6474,
     "completion_sum": 3845378,
     "over_8k": 41,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069344.968,
     "t_last": 1791093387.212,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 593.9725054062403,
     "over_8k_per_1000_calls": 6.333024405313562,
     "cap_hits_per_1000_calls": 2.7803521779425395,
     "t_first_iso": "2026-10-03T16:15:44-07:00",
     "t_last_iso": "2026-10-03T22:56:27-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard8of16",
     "attempt_tags": [
      "127328_1",
      "129090_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 23,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 20,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4541,
     "completion_sum": 3196274,
     "over_8k": 28,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791075706.328,
     "t_last": 1791091682.937,
     "attempts_listed": 3,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "127328_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 8.695652173913043,
     "first_timeouts_per_100_instances": 10.0,
     "completion_per_call": 703.8700726712178,
     "over_8k_per_1000_calls": 6.16604272186743,
     "cap_hits_per_1000_calls": 0.6606474344857961,
     "t_first_iso": "2026-10-03T18:01:46-07:00",
     "t_last_iso": "2026-10-03T22:28:02-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard9of16",
     "attempt_tags": [
      "127329_0",
      "127329_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6216,
     "completion_sum": 3207327,
     "over_8k": 12,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069389.686,
     "t_last": 1791086139.243,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 515.9792471042471,
     "over_8k_per_1000_calls": 1.9305019305019304,
     "cap_hits_per_1000_calls": 0.32175032175032175,
     "t_first_iso": "2026-10-03T16:16:29-07:00",
     "t_last_iso": "2026-10-03T20:55:39-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard10of16",
     "attempt_tags": [
      "127330_0",
      "127330_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 31,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6202,
     "completion_sum": 3285433,
     "over_8k": 21,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069400.854,
     "t_last": 1791087005.588,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 529.737665269268,
     "over_8k_per_1000_calls": 3.386004514672686,
     "cap_hits_per_1000_calls": 0.6449532408900355,
     "t_first_iso": "2026-10-03T16:16:40-07:00",
     "t_last_iso": "2026-10-03T21:10:05-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard11of16",
     "attempt_tags": [
      "127331_0",
      "127331_1",
      "129168_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 2,
     "zero_other": 6,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7184,
     "completion_sum": 3795496,
     "over_8k": 16,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069380.699,
     "t_last": 1791093095.922,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.2631578947368425,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 528.326280623608,
     "over_8k_per_1000_calls": 2.2271714922048997,
     "cap_hits_per_1000_calls": 0.5567928730512249,
     "t_first_iso": "2026-10-03T16:16:20-07:00",
     "t_last_iso": "2026-10-03T22:51:35-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard12of16",
     "attempt_tags": [
      "127332_0",
      "127332_1",
      "129169_0",
      "129406_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 41,
     "timeouts": 4,
     "zero_other": 7,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7874,
     "completion_sum": 4940181,
     "over_8k": 44,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 7,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069416.858,
     "t_last": 1791096321.101,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 9.75609756097561,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 627.4042418084836,
     "over_8k_per_1000_calls": 5.588011176022352,
     "cap_hits_per_1000_calls": 2.286004572009144,
     "t_first_iso": "2026-10-03T16:16:56-07:00",
     "t_last_iso": "2026-10-03T23:45:21-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard13of16",
     "attempt_tags": [
      "127333_0",
      "127333_1",
      "129167_0",
      "129522_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 42,
     "timeouts": 4,
     "zero_other": 7,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7942,
     "completion_sum": 5728098,
     "over_8k": 84,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 7,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069410.721,
     "t_last": 1791098967.826,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 9.523809523809524,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 721.2412490556535,
     "over_8k_per_1000_calls": 10.57668093679174,
     "cap_hits_per_1000_calls": 2.3923444976076556,
     "t_first_iso": "2026-10-03T16:16:50-07:00",
     "t_last_iso": "2026-10-04T00:29:27-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard14of16",
     "attempt_tags": [
      "127334_0",
      "127334_1",
      "129346_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 40,
     "timeouts": 8,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 7032,
     "completion_sum": 6173323,
     "over_8k": 130,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069428.842,
     "t_last": 1791097594.035,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 20.0,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 877.8900739476678,
     "over_8k_per_1000_calls": 18.486916951080772,
     "cap_hits_per_1000_calls": 5.688282138794084,
     "t_first_iso": "2026-10-03T16:17:08-07:00",
     "t_last_iso": "2026-10-04T00:06:34-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 42,
     "unit": "shard15of16",
     "attempt_tags": [
      "127335_0",
      "127335_1",
      "129388_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 39,
     "timeouts": 4,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7442,
     "completion_sum": 5516858,
     "over_8k": 85,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069424.463,
     "t_last": 1791097363.525,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.256410256410257,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 741.3138941144854,
     "over_8k_per_1000_calls": 11.421660843859177,
     "cap_hits_per_1000_calls": 4.29991937651169,
     "t_first_iso": "2026-10-03T16:17:04-07:00",
     "t_last_iso": "2026-10-04T00:02:43-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard0of16",
     "attempt_tags": [
      "127316_0",
      "127316_1",
      "129091_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 4,
     "zero_other": 2,
     "instances": 32,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7508,
     "completion_sum": 4721789,
     "over_8k": 53,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069125.331,
     "t_last": 1791092793.639,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.526315789473685,
     "first_timeouts_per_100_instances": 9.375,
     "completion_per_call": 628.9010388918487,
     "over_8k_per_1000_calls": 7.059136920618007,
     "cap_hits_per_1000_calls": 1.9978689397975493,
     "t_first_iso": "2026-10-03T16:12:05-07:00",
     "t_last_iso": "2026-10-03T22:46:33-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard1of16",
     "attempt_tags": [
      "127317_0",
      "127317_1",
      "129295_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 36,
     "timeouts": 3,
     "zero_other": 2,
     "instances": 32,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 6714,
     "completion_sum": 4616081,
     "over_8k": 82,
     "cap_hits": 55,
     "length_finish": 55,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069183.98,
     "t_last": 1791096829.729,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.333333333333334,
     "first_timeouts_per_100_instances": 3.125,
     "completion_per_call": 687.5306821566875,
     "over_8k_per_1000_calls": 12.213285671730713,
     "cap_hits_per_1000_calls": 8.191837950551088,
     "t_first_iso": "2026-10-03T16:13:03-07:00",
     "t_last_iso": "2026-10-03T23:53:49-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard2of16",
     "attempt_tags": [
      "127318_0",
      "127318_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6391,
     "completion_sum": 3389299,
     "over_8k": 21,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069173.643,
     "t_last": 1791085617.253,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 530.3237365044594,
     "over_8k_per_1000_calls": 3.285870755750274,
     "cap_hits_per_1000_calls": 0.4694101079643248,
     "t_first_iso": "2026-10-03T16:12:53-07:00",
     "t_last_iso": "2026-10-03T20:46:57-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard3of16",
     "attempt_tags": [
      "127319_0",
      "127319_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6603,
     "completion_sum": 3673135,
     "over_8k": 33,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069237.311,
     "t_last": 1791086913.732,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.125,
     "completion_per_call": 556.282750265031,
     "over_8k_per_1000_calls": 4.997728305315766,
     "cap_hits_per_1000_calls": 1.2115704982583675,
     "t_first_iso": "2026-10-03T16:13:57-07:00",
     "t_last_iso": "2026-10-03T21:08:33-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard4of16",
     "attempt_tags": [
      "127336_0",
      "127336_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 0,
     "zero_other": 2,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6465,
     "completion_sum": 3523463,
     "over_8k": 22,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069526.661,
     "t_last": 1791086742.584,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 545.0058778035576,
     "over_8k_per_1000_calls": 3.4029389017788088,
     "cap_hits_per_1000_calls": 1.082753286929621,
     "t_first_iso": "2026-10-03T16:18:46-07:00",
     "t_last_iso": "2026-10-03T21:05:42-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard5of16",
     "attempt_tags": [
      "127337_0",
      "127337_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6403,
     "completion_sum": 3072743,
     "over_8k": 17,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070721.675,
     "t_last": 1791086318.13,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 479.8911447758863,
     "over_8k_per_1000_calls": 2.6550054661877245,
     "cap_hits_per_1000_calls": 1.0932375449008278,
     "t_first_iso": "2026-10-03T16:38:41-07:00",
     "t_last_iso": "2026-10-03T20:58:38-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard6of16",
     "attempt_tags": [
      "127338_0",
      "127338_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6376,
     "completion_sum": 3326096,
     "over_8k": 21,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069515.771,
     "t_last": 1791086671.473,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 521.6587202007528,
     "over_8k_per_1000_calls": 3.2936010037641155,
     "cap_hits_per_1000_calls": 1.0978670012547052,
     "t_first_iso": "2026-10-03T16:18:35-07:00",
     "t_last_iso": "2026-10-03T21:04:31-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard7of16",
     "attempt_tags": [
      "127339_0",
      "127339_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 34,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6676,
     "completion_sum": 4058260,
     "over_8k": 48,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069773.451,
     "t_last": 1791088514.363,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 607.8879568603954,
     "over_8k_per_1000_calls": 7.189934092270821,
     "cap_hits_per_1000_calls": 3.5949670461354106,
     "t_first_iso": "2026-10-03T16:22:53-07:00",
     "t_last_iso": "2026-10-03T21:35:14-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard8of16",
     "attempt_tags": [
      "127340_0",
      "127340_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6600,
     "completion_sum": 3763140,
     "over_8k": 30,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069759.686,
     "t_last": 1791086979.913,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 570.1727272727272,
     "over_8k_per_1000_calls": 4.545454545454546,
     "cap_hits_per_1000_calls": 0.7575757575757576,
     "t_first_iso": "2026-10-03T16:22:39-07:00",
     "t_last_iso": "2026-10-03T21:09:39-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard9of16",
     "attempt_tags": [
      "127341_0",
      "127341_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 1,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6553,
     "completion_sum": 3440210,
     "over_8k": 17,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069759.434,
     "t_last": 1791086679.846,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 524.9824507858996,
     "over_8k_per_1000_calls": 2.5942316496261255,
     "cap_hits_per_1000_calls": 0.3052037234854265,
     "t_first_iso": "2026-10-03T16:22:39-07:00",
     "t_last_iso": "2026-10-03T21:04:39-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard10of16",
     "attempt_tags": [
      "127342_0",
      "127342_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6241,
     "completion_sum": 3533334,
     "over_8k": 27,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069874.963,
     "t_last": 1791087854.041,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 566.1486941195321,
     "over_8k_per_1000_calls": 4.326229770870053,
     "cap_hits_per_1000_calls": 0.9613843935266784,
     "t_first_iso": "2026-10-03T16:24:34-07:00",
     "t_last_iso": "2026-10-03T21:24:14-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard11of16",
     "attempt_tags": [
      "127343_0",
      "127343_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 37,
     "timeouts": 4,
     "zero_other": 2,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7065,
     "completion_sum": 3700808,
     "over_8k": 22,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069882.918,
     "t_last": 1791090114.671,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.81081081081081,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 523.8227883934891,
     "over_8k_per_1000_calls": 3.113941967445152,
     "cap_hits_per_1000_calls": 0.28308563340410475,
     "t_first_iso": "2026-10-03T16:24:42-07:00",
     "t_last_iso": "2026-10-03T22:01:54-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard12of16",
     "attempt_tags": [
      "127344_0",
      "127344_1",
      "129241_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 3,
     "zero_other": 4,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7517,
     "completion_sum": 4595848,
     "over_8k": 36,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 4,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069886.286,
     "t_last": 1791093681.568,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.894736842105263,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 611.3939071438074,
     "over_8k_per_1000_calls": 4.789144605560729,
     "cap_hits_per_1000_calls": 1.995476918983637,
     "t_first_iso": "2026-10-03T16:24:46-07:00",
     "t_last_iso": "2026-10-03T23:01:21-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard13of16",
     "attempt_tags": [
      "127345_0",
      "127345_1",
      "129222_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 35,
     "timeouts": 2,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 6830,
     "completion_sum": 4383961,
     "over_8k": 42,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069956.067,
     "t_last": 1791092838.433,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.714285714285714,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 641.8683748169839,
     "over_8k_per_1000_calls": 6.149341142020498,
     "cap_hits_per_1000_calls": 0.8784773060029283,
     "t_first_iso": "2026-10-03T16:25:56-07:00",
     "t_last_iso": "2026-10-03T22:47:18-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard14of16",
     "attempt_tags": [
      "127346_0",
      "127346_1",
      "129294_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 38,
     "timeouts": 8,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 4,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 6971,
     "completion_sum": 6125774,
     "over_8k": 130,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069986.783,
     "t_last": 1791096967.534,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 21.05263157894737,
     "first_timeouts_per_100_instances": 12.903225806451612,
     "completion_per_call": 878.7511117486731,
     "over_8k_per_1000_calls": 18.648687419308565,
     "cap_hits_per_1000_calls": 4.877349017357624,
     "t_first_iso": "2026-10-03T16:26:26-07:00",
     "t_last_iso": "2026-10-03T23:56:07-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 43,
     "unit": "shard15of16",
     "attempt_tags": [
      "127347_0",
      "127347_1",
      "129278_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 40,
     "timeouts": 6,
     "zero_other": 4,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 7679,
     "completion_sum": 5836490,
     "over_8k": 87,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 4,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070084.975,
     "t_last": 1791096337.015,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.0,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 760.058601380388,
     "over_8k_per_1000_calls": 11.329600208360464,
     "cap_hits_per_1000_calls": 3.6463081130355515,
     "t_first_iso": "2026-10-03T16:28:04-07:00",
     "t_last_iso": "2026-10-03T23:45:37-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard0of16",
     "attempt_tags": [
      "127320_0",
      "127320_1",
      "129240_0",
      "129540_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 43,
     "timeouts": 4,
     "zero_other": 7,
     "instances": 32,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 8117,
     "completion_sum": 5306358,
     "over_8k": 69,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 7,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069245.232,
     "t_last": 1791099003.334,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 9.30232558139535,
     "first_timeouts_per_100_instances": 6.25,
     "completion_per_call": 653.7338918319576,
     "over_8k_per_1000_calls": 8.5006775902427,
     "cap_hits_per_1000_calls": 2.217568067019835,
     "t_first_iso": "2026-10-03T16:14:05-07:00",
     "t_last_iso": "2026-10-04T00:30:03-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard1of16",
     "attempt_tags": [
      "127321_0",
      "127321_1",
      "129171_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 34,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 6459,
     "completion_sum": 4638127,
     "over_8k": 81,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069356.263,
     "t_last": 1791094215.933,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 3.125,
     "completion_per_call": 718.0874748413067,
     "over_8k_per_1000_calls": 12.540640966093823,
     "cap_hits_per_1000_calls": 7.895959126799815,
     "t_first_iso": "2026-10-03T16:15:56-07:00",
     "t_last_iso": "2026-10-03T23:10:15-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard2of16",
     "attempt_tags": [
      "127322_0",
      "127322_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6319,
     "completion_sum": 3566627,
     "over_8k": 20,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069348.252,
     "t_last": 1791085844.774,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 564.4290235796803,
     "over_8k_per_1000_calls": 3.165057762304162,
     "cap_hits_per_1000_calls": 0.3165057762304162,
     "t_first_iso": "2026-10-03T16:15:48-07:00",
     "t_last_iso": "2026-10-03T20:50:44-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard3of16",
     "attempt_tags": [
      "127323_0",
      "127323_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 32,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6400,
     "completion_sum": 3691516,
     "over_8k": 35,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791069315.551,
     "t_last": 1791087602.906,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 576.799375,
     "over_8k_per_1000_calls": 5.46875,
     "cap_hits_per_1000_calls": 0.9375,
     "t_first_iso": "2026-10-03T16:15:15-07:00",
     "t_last_iso": "2026-10-03T21:20:02-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard4of16",
     "attempt_tags": [
      "127348_0",
      "127348_1",
      "129224_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 36,
     "timeouts": 1,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 7085,
     "completion_sum": 4218484,
     "over_8k": 30,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070147.083,
     "t_last": 1791092678.509,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 2.7777777777777777,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 595.4105857445307,
     "over_8k_per_1000_calls": 4.234297812279464,
     "cap_hits_per_1000_calls": 1.4114326040931546,
     "t_first_iso": "2026-10-03T16:29:07-07:00",
     "t_last_iso": "2026-10-03T22:44:38-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard5of16",
     "attempt_tags": [
      "127349_0",
      "127349_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6376,
     "completion_sum": 3121587,
     "over_8k": 19,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070163.271,
     "t_last": 1791086859.944,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 489.5839084065245,
     "over_8k_per_1000_calls": 2.9799247176913424,
     "cap_hits_per_1000_calls": 0.3136762860727729,
     "t_first_iso": "2026-10-03T16:29:23-07:00",
     "t_last_iso": "2026-10-03T21:07:39-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard6of16",
     "attempt_tags": [
      "127350_0",
      "127350_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 34,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6767,
     "completion_sum": 4238727,
     "over_8k": 50,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 1,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070193.031,
     "t_last": 1791088223.339,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.882352941176471,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 626.3820008866559,
     "over_8k_per_1000_calls": 7.388798581350672,
     "cap_hits_per_1000_calls": 1.329983744643121,
     "t_first_iso": "2026-10-03T16:29:53-07:00",
     "t_last_iso": "2026-10-03T21:30:23-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard7of16",
     "attempt_tags": [
      "127351_0",
      "127351_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 33,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6295,
     "completion_sum": 3507261,
     "over_8k": 33,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070203.542,
     "t_last": 1791088279.358,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 557.1502779984114,
     "over_8k_per_1000_calls": 5.242255758538523,
     "cap_hits_per_1000_calls": 2.8594122319301034,
     "t_first_iso": "2026-10-03T16:30:03-07:00",
     "t_last_iso": "2026-10-03T21:31:19-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard8of16",
     "attempt_tags": [
      "127352_0",
      "127352_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 32,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6340,
     "completion_sum": 3613258,
     "over_8k": 34,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070254.989,
     "t_last": 1791088775.323,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 569.9145110410095,
     "over_8k_per_1000_calls": 5.3627760252365935,
     "cap_hits_per_1000_calls": 1.8927444794952681,
     "t_first_iso": "2026-10-03T16:30:54-07:00",
     "t_last_iso": "2026-10-03T21:39:35-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard9of16",
     "attempt_tags": [
      "127353_0",
      "127353_1",
      "129172_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 35,
     "timeouts": 0,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 0,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 6902,
     "completion_sum": 3820393,
     "over_8k": 17,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070391.734,
     "t_last": 1791092145.164,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 553.5197044334975,
     "over_8k_per_1000_calls": 2.4630541871921183,
     "cap_hits_per_1000_calls": 1.0141987829614605,
     "t_first_iso": "2026-10-03T16:33:11-07:00",
     "t_last_iso": "2026-10-03T22:35:45-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard10of16",
     "attempt_tags": [
      "127354_0",
      "127354_1",
      "129173_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 34,
     "timeouts": 1,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 6707,
     "completion_sum": 3732019,
     "over_8k": 33,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070393.815,
     "t_last": 1791091665.738,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 2.9411764705882355,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 556.4364097211868,
     "over_8k_per_1000_calls": 4.920232592813479,
     "cap_hits_per_1000_calls": 0.8945877441479052,
     "t_first_iso": "2026-10-03T16:33:13-07:00",
     "t_last_iso": "2026-10-03T22:27:45-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard11of16",
     "attempt_tags": [
      "127355_0",
      "127355_1",
      "129242_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 39,
     "timeouts": 3,
     "zero_other": 5,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 7109,
     "completion_sum": 3863019,
     "over_8k": 35,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 5,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070402.026,
     "t_last": 1791093878.407,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.6923076923076925,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 543.3983682655788,
     "over_8k_per_1000_calls": 4.923336615557743,
     "cap_hits_per_1000_calls": 0.8440005626670418,
     "t_first_iso": "2026-10-03T16:33:22-07:00",
     "t_last_iso": "2026-10-03T23:04:38-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard12of16",
     "attempt_tags": [
      "127356_0",
      "127356_1",
      "129244_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 36,
     "timeouts": 3,
     "zero_other": 2,
     "instances": 31,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6925,
     "completion_sum": 4198998,
     "over_8k": 43,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 2,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070432.413,
     "t_last": 1791093636.374,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.333333333333334,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 606.3535018050542,
     "over_8k_per_1000_calls": 6.209386281588448,
     "cap_hits_per_1000_calls": 1.7328519855595668,
     "t_first_iso": "2026-10-03T16:33:52-07:00",
     "t_last_iso": "2026-10-03T23:00:36-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard13of16",
     "attempt_tags": [
      "127357_0",
      "127357_1",
      "129243_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 34,
     "timeouts": 1,
     "zero_other": 3,
     "instances": 31,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 0,
     "calls": 6563,
     "completion_sum": 4267313,
     "over_8k": 49,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 3,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070380.78,
     "t_last": 1791094744.88,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 2.9411764705882355,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 650.2076794149017,
     "over_8k_per_1000_calls": 7.466097821118391,
     "cap_hits_per_1000_calls": 1.2189547463050434,
     "t_first_iso": "2026-10-03T16:33:00-07:00",
     "t_last_iso": "2026-10-03T23:19:04-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard14of16",
     "attempt_tags": [
      "127358_0",
      "127358_1",
      "129386_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 43,
     "timeouts": 6,
     "zero_other": 9,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 3,
     "counted_timeouts": 1,
     "calls": 7766,
     "completion_sum": 5707970,
     "over_8k": 108,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 9,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070491.62,
     "t_last": 1791097891.104,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 13.953488372093023,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 734.9948493432913,
     "over_8k_per_1000_calls": 13.90677311357198,
     "cap_hits_per_1000_calls": 3.347926860674736,
     "t_first_iso": "2026-10-03T16:34:51-07:00",
     "t_last_iso": "2026-10-04T00:11:31-07:00"
    },
    {
     "arm": "quest_b2048_s1",
     "seed": 44,
     "unit": "shard15of16",
     "attempt_tags": [
      "127359_0",
      "127359_1",
      "129279_0",
      "129498_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 38,
     "timeouts": 3,
     "zero_other": 6,
     "instances": 31,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 0,
     "calls": 7080,
     "completion_sum": 5231727,
     "over_8k": 76,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 6,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791070438.281,
     "t_last": 1791097415.451,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.894736842105263,
     "first_timeouts_per_100_instances": 9.67741935483871,
     "completion_per_call": 738.9444915254237,
     "over_8k_per_1000_calls": 10.734463276836157,
     "cap_hits_per_1000_calls": 3.1073446327683616,
     "t_first_iso": "2026-10-03T16:33:58-07:00",
     "t_last_iso": "2026-10-04T00:03:35-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293505_0",
      "293505_1",
      "299541_0",
      "307818_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5001,
     "completion_sum": 8555154,
     "over_8k": 246,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793026848.637,
     "t_last": 1793191172.284,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1710.6886622675465,
     "over_8k_per_1000_calls": 49.19016196760648,
     "cap_hits_per_1000_calls": 6.598680263947211,
     "t_first_iso": "2026-10-26T08:00:48-07:00",
     "t_last_iso": "2026-10-28T05:39:32-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293553_0",
      "293553_1",
      "301270_0",
      "307891_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5224,
     "completion_sum": 8619240,
     "over_8k": 207,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793058575.716,
     "t_last": 1793188321.711,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1649.9310872894334,
     "over_8k_per_1000_calls": 39.62480857580398,
     "cap_hits_per_1000_calls": 7.656967840735069,
     "t_first_iso": "2026-10-26T16:49:35-07:00",
     "t_last_iso": "2026-10-28T04:52:01-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293713_0",
      "293713_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4537,
     "completion_sum": 6844934,
     "over_8k": 168,
     "cap_hits": 45,
     "length_finish": 45,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114450.928,
     "t_last": 1793138114.17,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1508.69164646242,
     "over_8k_per_1000_calls": 37.02887370509147,
     "cap_hits_per_1000_calls": 9.918448313863786,
     "t_first_iso": "2026-10-27T08:20:50-07:00",
     "t_last_iso": "2026-10-27T14:55:14-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293638_0",
      "293638_1",
      "303068_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5321,
     "completion_sum": 7966731,
     "over_8k": 185,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087572.368,
     "t_last": 1793162695.729,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1497.224393910919,
     "over_8k_per_1000_calls": 34.76790077053185,
     "cap_hits_per_1000_calls": 5.262168765269686,
     "t_first_iso": "2026-10-27T00:52:52-07:00",
     "t_last_iso": "2026-10-27T21:44:55-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293536_0",
      "293536_1",
      "300387_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5106,
     "completion_sum": 7922012,
     "over_8k": 195,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793033010.467,
     "t_last": 1793158098.875,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1551.5103799451626,
     "over_8k_per_1000_calls": 38.190364277320796,
     "cap_hits_per_1000_calls": 7.442224833529181,
     "t_first_iso": "2026-10-26T09:43:30-07:00",
     "t_last_iso": "2026-10-27T20:28:18-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293751_0",
      "293751_1",
      "306499_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4216,
     "completion_sum": 6036751,
     "over_8k": 145,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117756.822,
     "t_last": 1793190040.76,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1431.866935483871,
     "over_8k_per_1000_calls": 34.39278937381404,
     "cap_hits_per_1000_calls": 6.878557874762809,
     "t_first_iso": "2026-10-27T09:15:56-07:00",
     "t_last_iso": "2026-10-28T05:20:40-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293674_0",
      "293674_1",
      "304977_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5657,
     "completion_sum": 7785200,
     "over_8k": 160,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793112654.377,
     "t_last": 1793162155.78,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1376.20646986035,
     "over_8k_per_1000_calls": 28.283542513699842,
     "cap_hits_per_1000_calls": 6.1870249248718405,
     "t_first_iso": "2026-10-27T07:50:54-07:00",
     "t_last_iso": "2026-10-27T21:35:55-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293609_0",
      "293609_1",
      "302882_0",
      "307955_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5032,
     "completion_sum": 8936460,
     "over_8k": 264,
     "cap_hits": 95,
     "length_finish": 95,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082081.223,
     "t_last": 1793192668.653,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1775.9260731319555,
     "over_8k_per_1000_calls": 52.46422893481717,
     "cap_hits_per_1000_calls": 18.879173290937995,
     "t_first_iso": "2026-10-26T23:21:21-07:00",
     "t_last_iso": "2026-10-28T06:04:28-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293495_0",
      "293495_1",
      "298111_0",
      "307771_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4814,
     "completion_sum": 6683035,
     "over_8k": 158,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792988537.671,
     "t_last": 1793191957.795,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1388.2498961362692,
     "over_8k_per_1000_calls": 32.820938928126296,
     "cap_hits_per_1000_calls": 8.309098462816785,
     "t_first_iso": "2026-10-25T21:22:17-07:00",
     "t_last_iso": "2026-10-28T05:52:37-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293526_0",
      "293526_1",
      "299951_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5231,
     "completion_sum": 6807369,
     "over_8k": 137,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031477.351,
     "t_last": 1793157827.744,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1301.3513668514624,
     "over_8k_per_1000_calls": 26.190021028484036,
     "cap_hits_per_1000_calls": 6.4997132479449435,
     "t_first_iso": "2026-10-26T09:17:57-07:00",
     "t_last_iso": "2026-10-27T20:23:47-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293597_0",
      "293597_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4877,
     "completion_sum": 6312847,
     "over_8k": 131,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793081571.063,
     "t_last": 1793107952.794,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1294.4119335657167,
     "over_8k_per_1000_calls": 26.860775066639327,
     "cap_hits_per_1000_calls": 4.921058027475907,
     "t_first_iso": "2026-10-26T23:12:51-07:00",
     "t_last_iso": "2026-10-27T06:32:32-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293564_0",
      "293564_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4940,
     "completion_sum": 5914619,
     "over_8k": 100,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793066198.509,
     "t_last": 1793084898.827,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1197.2912955465588,
     "over_8k_per_1000_calls": 20.242914979757085,
     "cap_hits_per_1000_calls": 4.251012145748988,
     "t_first_iso": "2026-10-26T18:56:38-07:00",
     "t_last_iso": "2026-10-27T00:08:18-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293575_0",
      "301521_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4419,
     "completion_sum": 4966531,
     "over_8k": 76,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793070760.086,
     "t_last": 1793155374.337,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1123.9038243946595,
     "over_8k_per_1000_calls": 17.19846119031455,
     "cap_hits_per_1000_calls": 3.6207286716451685,
     "t_first_iso": "2026-10-26T20:12:40-07:00",
     "t_last_iso": "2026-10-27T19:42:54-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293629_0",
      "293629_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3912,
     "completion_sum": 4684659,
     "over_8k": 88,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086699.348,
     "t_last": 1793108092.519,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1197.5099693251534,
     "over_8k_per_1000_calls": 22.494887525562373,
     "cap_hits_per_1000_calls": 2.556237218813906,
     "t_first_iso": "2026-10-27T00:38:19-07:00",
     "t_last_iso": "2026-10-27T06:34:52-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293489_0",
      "293489_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5222,
     "completion_sum": 5263369,
     "over_8k": 79,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987806.377,
     "t_last": 1793027057.342,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1007.9220605132133,
     "over_8k_per_1000_calls": 15.128303332056683,
     "cap_hits_per_1000_calls": 3.0639601685178093,
     "t_first_iso": "2026-10-25T21:10:06-07:00",
     "t_last_iso": "2026-10-26T08:04:17-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293766_0",
      "293766_1",
      "308247_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4874,
     "completion_sum": 6878560,
     "over_8k": 184,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793142490.752,
     "t_last": 1793190071.817,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1411.276159212146,
     "over_8k_per_1000_calls": 37.75133360689372,
     "cap_hits_per_1000_calls": 9.848173984407058,
     "t_first_iso": "2026-10-27T16:08:10-07:00",
     "t_last_iso": "2026-10-28T05:21:11-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293666_0",
      "293666_1",
      "305151_0",
      "308569_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 70,
     "timeouts": 9,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5391,
     "completion_sum": 9698288,
     "over_8k": 298,
     "cap_hits": 82,
     "length_finish": 82,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110891.785,
     "t_last": 1793195618.942,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.857142857142858,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1798.9775551845669,
     "over_8k_per_1000_calls": 55.27731404192172,
     "cap_hits_per_1000_calls": 15.210536078649602,
     "t_first_iso": "2026-10-27T07:21:31-07:00",
     "t_last_iso": "2026-10-28T06:53:38-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293657_0",
      "293657_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4598,
     "completion_sum": 5983090,
     "over_8k": 124,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108671.942,
     "t_last": 1793130670.37,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1301.2374945628535,
     "over_8k_per_1000_calls": 26.968247063940844,
     "cap_hits_per_1000_calls": 4.349717268377556,
     "t_first_iso": "2026-10-27T06:44:31-07:00",
     "t_last_iso": "2026-10-27T12:51:10-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293698_0",
      "293698_1",
      "305259_0",
      "309286_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 8,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5469,
     "completion_sum": 10108989,
     "over_8k": 326,
     "cap_hits": 68,
     "length_finish": 68,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113554.807,
     "t_last": 1793194156.19,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.267605633802816,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 1848.4163466812945,
     "over_8k_per_1000_calls": 59.60870360212105,
     "cap_hits_per_1000_calls": 12.43371731577985,
     "t_first_iso": "2026-10-27T08:05:54-07:00",
     "t_last_iso": "2026-10-28T06:29:16-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293774_0",
      "293774_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5347,
     "completion_sum": 7289156,
     "over_8k": 172,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793144232.204,
     "t_last": 1793162954.859,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1363.2234898073687,
     "over_8k_per_1000_calls": 32.16757060033664,
     "cap_hits_per_1000_calls": 6.358705816345615,
     "t_first_iso": "2026-10-27T16:37:12-07:00",
     "t_last_iso": "2026-10-27T21:49:14-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293450_0",
      "293450_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4416,
     "completion_sum": 5149846,
     "over_8k": 85,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792967349.264,
     "t_last": 1792985800.033,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1166.1788949275362,
     "over_8k_per_1000_calls": 19.2481884057971,
     "cap_hits_per_1000_calls": 2.943840579710145,
     "t_first_iso": "2026-10-25T15:29:09-07:00",
     "t_last_iso": "2026-10-25T20:36:40-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293463_0",
      "293463_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4238,
     "completion_sum": 6566797,
     "over_8k": 170,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792970063.567,
     "t_last": 1792989378.64,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1549.5037753657386,
     "over_8k_per_1000_calls": 40.11326097215668,
     "cap_hits_per_1000_calls": 9.438414346389807,
     "t_first_iso": "2026-10-25T16:14:23-07:00",
     "t_last_iso": "2026-10-25T21:36:18-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293729_0",
      "293729_1",
      "306735_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5751,
     "completion_sum": 7454425,
     "over_8k": 169,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116013.356,
     "t_last": 1793189985.335,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1296.1963136845766,
     "over_8k_per_1000_calls": 29.386193705442533,
     "cap_hits_per_1000_calls": 4.694835680751174,
     "t_first_iso": "2026-10-27T08:46:53-07:00",
     "t_last_iso": "2026-10-28T05:19:45-07:00"
    },
    {
     "arm": "sparq_c8_s1_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293728_0",
      "293728_1",
      "305888_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4925,
     "completion_sum": 8398864,
     "over_8k": 268,
     "cap_hits": 68,
     "length_finish": 68,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115657.346,
     "t_last": 1793190620.913,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1705.3530964467004,
     "over_8k_per_1000_calls": 54.41624365482234,
     "cap_hits_per_1000_calls": 13.807106598984772,
     "t_first_iso": "2026-10-27T08:40:57-07:00",
     "t_last_iso": "2026-10-28T05:30:20-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "125961_0",
      "125961_1",
      "128360_0",
      "128868_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 10,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5490,
     "completion_sum": 8947671,
     "over_8k": 226,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060268.679,
     "t_last": 1791091514.601,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 14.084507042253522,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1629.812568306011,
     "over_8k_per_1000_calls": 41.16575591985428,
     "cap_hits_per_1000_calls": 9.289617486338798,
     "t_first_iso": "2026-10-03T13:44:28-07:00",
     "t_last_iso": "2026-10-03T22:25:14-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "125962_0",
      "125962_1",
      "128366_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5001,
     "completion_sum": 6487165,
     "over_8k": 113,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060281.662,
     "t_last": 1791083590.339,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1297.1735652869427,
     "over_8k_per_1000_calls": 22.595480903819237,
     "cap_hits_per_1000_calls": 1.9996000799840032,
     "t_first_iso": "2026-10-03T13:44:41-07:00",
     "t_last_iso": "2026-10-03T20:13:10-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "125963_0",
      "125963_1",
      "128364_0",
      "128867_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 70,
     "timeouts": 5,
     "zero_other": 2,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5122,
     "completion_sum": 7695587,
     "over_8k": 201,
     "cap_hits": 29,
     "length_finish": 29,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060269.974,
     "t_last": 1791088935.994,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.142857142857143,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1502.4574385005858,
     "over_8k_per_1000_calls": 39.24248340491995,
     "cap_hits_per_1000_calls": 5.6618508395158145,
     "t_first_iso": "2026-10-03T13:44:29-07:00",
     "t_last_iso": "2026-10-03T21:42:15-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "125964_0",
      "125964_1",
      "128361_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 71,
     "timeouts": 11,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 3,
     "counted_timeouts": 3,
     "calls": 5704,
     "completion_sum": 8483657,
     "over_8k": 231,
     "cap_hits": 47,
     "length_finish": 47,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060266.33,
     "t_last": 1791085375.526,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 15.492957746478874,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 1487.3171458625527,
     "over_8k_per_1000_calls": 40.49789621318373,
     "cap_hits_per_1000_calls": 8.239831697054699,
     "t_first_iso": "2026-10-03T13:44:26-07:00",
     "t_last_iso": "2026-10-03T20:42:55-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "125997_0",
      "125997_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4811,
     "completion_sum": 5801775,
     "over_8k": 88,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060792.938,
     "t_last": 1791077896.008,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1205.9395136146331,
     "over_8k_per_1000_calls": 18.29141550613178,
     "cap_hits_per_1000_calls": 2.2864269382664726,
     "t_first_iso": "2026-10-03T13:53:12-07:00",
     "t_last_iso": "2026-10-03T18:38:16-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "125998_0",
      "125998_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4238,
     "completion_sum": 4947410,
     "over_8k": 98,
     "cap_hits": 10,
     "length_finish": 10,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060809.658,
     "t_last": 1791075750.798,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1167.3926380368098,
     "over_8k_per_1000_calls": 23.124115148655026,
     "cap_hits_per_1000_calls": 2.359603586597452,
     "t_first_iso": "2026-10-03T13:53:29-07:00",
     "t_last_iso": "2026-10-03T18:02:30-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "125999_0",
      "125999_1",
      "128455_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 2,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 6035,
     "completion_sum": 8282787,
     "over_8k": 193,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060810.8,
     "t_last": 1791085978.895,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1372.458492129246,
     "over_8k_per_1000_calls": 31.980115990057996,
     "cap_hits_per_1000_calls": 1.9884009942004972,
     "t_first_iso": "2026-10-03T13:53:30-07:00",
     "t_last_iso": "2026-10-03T20:52:58-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "126000_0",
      "126000_1",
      "128457_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4541,
     "completion_sum": 6486071,
     "over_8k": 156,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060823.253,
     "t_last": 1791083588.812,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1428.3353886809073,
     "over_8k_per_1000_calls": 34.353666593261394,
     "cap_hits_per_1000_calls": 4.184100418410042,
     "t_first_iso": "2026-10-03T13:53:43-07:00",
     "t_last_iso": "2026-10-03T20:13:08-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "125965_0",
      "127737_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4879,
     "completion_sum": 4744379,
     "over_8k": 79,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060280.168,
     "t_last": 1791076345.858,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 972.408075425292,
     "over_8k_per_1000_calls": 16.191842590694815,
     "cap_hits_per_1000_calls": 2.8694404591104736,
     "t_first_iso": "2026-10-03T13:44:40-07:00",
     "t_last_iso": "2026-10-03T18:12:25-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "125966_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5065,
     "completion_sum": 4258163,
     "over_8k": 52,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060269.462,
     "t_last": 1791071839.812,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 840.7034550839091,
     "over_8k_per_1000_calls": 10.266535044422508,
     "cap_hits_per_1000_calls": 2.566633761105627,
     "t_first_iso": "2026-10-03T13:44:29-07:00",
     "t_last_iso": "2026-10-03T16:57:19-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "125967_0",
      "127945_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4719,
     "completion_sum": 4870486,
     "over_8k": 88,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060245.814,
     "t_last": 1791075152.764,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1032.1012926467472,
     "over_8k_per_1000_calls": 18.64801864801865,
     "cap_hits_per_1000_calls": 2.966730239457512,
     "t_first_iso": "2026-10-03T13:44:05-07:00",
     "t_last_iso": "2026-10-03T17:52:32-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "125968_0",
      "127735_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5524,
     "completion_sum": 4679420,
     "over_8k": 69,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060282.232,
     "t_last": 1791074805.51,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 847.10716871832,
     "over_8k_per_1000_calls": 12.490948587979725,
     "cap_hits_per_1000_calls": 1.2671976828385227,
     "t_first_iso": "2026-10-03T13:44:42-07:00",
     "t_last_iso": "2026-10-03T17:46:45-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "126001_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4892,
     "completion_sum": 4150140,
     "over_8k": 54,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060881.281,
     "t_last": 1791072949.08,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 848.35241210139,
     "over_8k_per_1000_calls": 11.038430089942764,
     "cap_hits_per_1000_calls": 0.4088307440719542,
     "t_first_iso": "2026-10-03T13:54:41-07:00",
     "t_last_iso": "2026-10-03T17:15:49-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "126002_0",
      "127738_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4571,
     "completion_sum": 3872294,
     "over_8k": 48,
     "cap_hits": 6,
     "length_finish": 6,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060888.372,
     "t_last": 1791075252.053,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 847.1437322248961,
     "over_8k_per_1000_calls": 10.500984467293808,
     "cap_hits_per_1000_calls": 1.312623058411726,
     "t_first_iso": "2026-10-03T13:54:48-07:00",
     "t_last_iso": "2026-10-03T17:54:12-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "126003_0",
      "126003_1",
      "128458_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5754,
     "completion_sum": 5368928,
     "over_8k": 82,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060895.043,
     "t_last": 1791081131.389,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 933.0775112964894,
     "over_8k_per_1000_calls": 14.250955856795272,
     "cap_hits_per_1000_calls": 1.3903371567605145,
     "t_first_iso": "2026-10-03T13:54:55-07:00",
     "t_last_iso": "2026-10-03T19:32:11-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "126004_0",
      "126004_1",
      "128459_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4789,
     "completion_sum": 5055357,
     "over_8k": 92,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060961.179,
     "t_last": 1791082247.255,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1055.6185007308416,
     "over_8k_per_1000_calls": 19.2106911672583,
     "cap_hits_per_1000_calls": 3.3409897682188348,
     "t_first_iso": "2026-10-03T13:56:01-07:00",
     "t_last_iso": "2026-10-03T19:50:47-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "125969_0",
      "125969_1",
      "128367_0",
      "128869_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4855,
     "completion_sum": 6868067,
     "over_8k": 173,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060295.878,
     "t_last": 1791091451.527,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1414.6378990731205,
     "over_8k_per_1000_calls": 35.633367662203916,
     "cap_hits_per_1000_calls": 9.062821833161689,
     "t_first_iso": "2026-10-03T13:44:55-07:00",
     "t_last_iso": "2026-10-03T22:24:11-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "125970_0",
      "125970_1",
      "128368_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5382,
     "completion_sum": 6914723,
     "over_8k": 138,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060289.046,
     "t_last": 1791085544.19,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1284.7868821999257,
     "over_8k_per_1000_calls": 25.641025641025642,
     "cap_hits_per_1000_calls": 2.6012634708286884,
     "t_first_iso": "2026-10-03T13:44:49-07:00",
     "t_last_iso": "2026-10-03T20:45:44-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "125971_0",
      "125971_1",
      "128369_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4818,
     "completion_sum": 6412326,
     "over_8k": 145,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060286.477,
     "t_last": 1791082123.448,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1330.9103362391033,
     "over_8k_per_1000_calls": 30.095475300954753,
     "cap_hits_per_1000_calls": 3.5284350352843505,
     "t_first_iso": "2026-10-03T13:44:46-07:00",
     "t_last_iso": "2026-10-03T19:48:43-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "125972_0",
      "125972_1",
      "128370_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5729,
     "completion_sum": 7054072,
     "over_8k": 156,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060332.419,
     "t_last": 1791081647.11,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.352941176470588,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1231.2920230406703,
     "over_8k_per_1000_calls": 27.229883051143307,
     "cap_hits_per_1000_calls": 5.9347181008902075,
     "t_first_iso": "2026-10-03T13:45:32-07:00",
     "t_last_iso": "2026-10-03T19:40:47-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "126005_0",
      "126005_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4703,
     "completion_sum": 5767938,
     "over_8k": 83,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060996.18,
     "t_last": 1791077551.64,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1226.4380182862003,
     "over_8k_per_1000_calls": 17.648309589623643,
     "cap_hits_per_1000_calls": 1.701041888156496,
     "t_first_iso": "2026-10-03T13:56:36-07:00",
     "t_last_iso": "2026-10-03T18:32:31-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "126006_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3971,
     "completion_sum": 4330825,
     "over_8k": 74,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061010.319,
     "t_last": 1791071796.361,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1090.6131956685974,
     "over_8k_per_1000_calls": 18.635104507680683,
     "cap_hits_per_1000_calls": 2.770083102493075,
     "t_first_iso": "2026-10-03T13:56:50-07:00",
     "t_last_iso": "2026-10-03T16:56:36-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "126007_0",
      "126007_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5575,
     "completion_sum": 6102457,
     "over_8k": 100,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061077.782,
     "t_last": 1791076526.53,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1094.611121076233,
     "over_8k_per_1000_calls": 17.937219730941703,
     "cap_hits_per_1000_calls": 2.8699551569506725,
     "t_first_iso": "2026-10-03T13:57:57-07:00",
     "t_last_iso": "2026-10-03T18:15:26-07:00"
    },
    {
     "arm": "sparq_c8_s1",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "126008_0",
      "126008_1",
      "128460_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4836,
     "completion_sum": 6830152,
     "over_8k": 151,
     "cap_hits": 43,
     "length_finish": 43,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061076.04,
     "t_last": 1791084903.081,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1412.3556658395369,
     "over_8k_per_1000_calls": 31.224152191894127,
     "cap_hits_per_1000_calls": 8.891645988420182,
     "t_first_iso": "2026-10-03T13:57:56-07:00",
     "t_last_iso": "2026-10-03T20:35:03-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293509_0",
      "293509_1",
      "299680_0",
      "307822_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4590,
     "completion_sum": 8188739,
     "over_8k": 272,
     "cap_hits": 79,
     "length_finish": 79,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028070.422,
     "t_last": 1793191854.503,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1784.0389978213507,
     "over_8k_per_1000_calls": 59.25925925925926,
     "cap_hits_per_1000_calls": 17.21132897603486,
     "t_first_iso": "2026-10-26T08:21:10-07:00",
     "t_last_iso": "2026-10-28T05:50:54-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293552_0",
      "293552_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4892,
     "completion_sum": 8122248,
     "over_8k": 209,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793058541.299,
     "t_last": 1793079588.265,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1660.312346688471,
     "over_8k_per_1000_calls": 42.722812755519215,
     "cap_hits_per_1000_calls": 7.1545380212591985,
     "t_first_iso": "2026-10-26T16:49:01-07:00",
     "t_last_iso": "2026-10-26T22:39:48-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293714_0",
      "293714_1",
      "305787_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4801,
     "completion_sum": 9026202,
     "over_8k": 290,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114490.892,
     "t_last": 1793190145.073,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1880.0670693605498,
     "over_8k_per_1000_calls": 60.40408248281608,
     "cap_hits_per_1000_calls": 11.039366798583629,
     "t_first_iso": "2026-10-27T08:21:30-07:00",
     "t_last_iso": "2026-10-28T05:22:25-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293633_0",
      "293633_1",
      "303283_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 71,
     "timeouts": 9,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 6,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5706,
     "completion_sum": 9939831,
     "over_8k": 320,
     "cap_hits": 65,
     "length_finish": 65,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087300.109,
     "t_last": 1793162904.385,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.67605633802817,
     "first_timeouts_per_100_instances": 9.523809523809524,
     "completion_per_call": 1741.9963196635122,
     "over_8k_per_1000_calls": 56.08131791097091,
     "cap_hits_per_1000_calls": 11.391517700665966,
     "t_first_iso": "2026-10-27T00:48:20-07:00",
     "t_last_iso": "2026-10-27T21:48:24-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293545_0",
      "298982_0",
      "298982_1"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4619,
     "completion_sum": 6619203,
     "over_8k": 148,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [
      "293545_0"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793037537.975,
     "t_last": 1793173037.857,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1433.038103485603,
     "over_8k_per_1000_calls": 32.04156743883958,
     "cap_hits_per_1000_calls": 4.113444468499675,
     "t_first_iso": "2026-10-26T10:58:57-07:00",
     "t_last_iso": "2026-10-28T00:37:17-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293746_0",
      "293746_1",
      "306498_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4346,
     "completion_sum": 7029202,
     "over_8k": 191,
     "cap_hits": 41,
     "length_finish": 41,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117327.2,
     "t_last": 1793191842.729,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1617.3957662218131,
     "over_8k_per_1000_calls": 43.948458352508055,
     "cap_hits_per_1000_calls": 9.433962264150944,
     "t_first_iso": "2026-10-27T09:08:47-07:00",
     "t_last_iso": "2026-10-28T05:50:42-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293675_0",
      "293675_1",
      "305199_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5462,
     "completion_sum": 8261117,
     "over_8k": 208,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793112858.262,
     "t_last": 1793165608.77,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1512.4710728670816,
     "over_8k_per_1000_calls": 38.08128890516294,
     "cap_hits_per_1000_calls": 5.858659831563529,
     "t_first_iso": "2026-10-27T07:54:18-07:00",
     "t_last_iso": "2026-10-27T22:33:28-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293606_0",
      "293606_1",
      "303198_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 72,
     "timeouts": 10,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 7,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5339,
     "completion_sum": 10561744,
     "over_8k": 362,
     "cap_hits": 94,
     "length_finish": 93,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082013.111,
     "t_last": 1793161275.349,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 13.88888888888889,
     "first_timeouts_per_100_instances": 11.290322580645162,
     "completion_per_call": 1978.2251357932198,
     "over_8k_per_1000_calls": 67.80295935568458,
     "cap_hits_per_1000_calls": 17.60629331335456,
     "t_first_iso": "2026-10-26T23:20:13-07:00",
     "t_last_iso": "2026-10-27T21:21:15-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293503_0",
      "293503_1",
      "299481_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4798,
     "completion_sum": 6860672,
     "over_8k": 181,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793026374.959,
     "t_last": 1793155123.735,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1429.902459358066,
     "over_8k_per_1000_calls": 37.72405168820342,
     "cap_hits_per_1000_calls": 7.7115464776990414,
     "t_first_iso": "2026-10-26T07:52:54-07:00",
     "t_last_iso": "2026-10-27T19:38:43-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293519_0",
      "293519_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4868,
     "completion_sum": 6216207,
     "over_8k": 140,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793030112.326,
     "t_last": 1793054596.242,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1276.952958093673,
     "over_8k_per_1000_calls": 28.75924404272802,
     "cap_hits_per_1000_calls": 5.341002465078061,
     "t_first_iso": "2026-10-26T08:55:12-07:00",
     "t_last_iso": "2026-10-26T15:43:16-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293591_0",
      "293591_1",
      "302748_0",
      "307952_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5093,
     "completion_sum": 7557694,
     "over_8k": 202,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079612.007,
     "t_last": 1793189188.635,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.352941176470588,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1483.9375613587276,
     "over_8k_per_1000_calls": 39.66228156292951,
     "cap_hits_per_1000_calls": 8.639308855291576,
     "t_first_iso": "2026-10-26T22:40:12-07:00",
     "t_last_iso": "2026-10-28T05:06:28-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293562_0",
      "293562_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5208,
     "completion_sum": 6490201,
     "over_8k": 135,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065642.362,
     "t_last": 1793082707.737,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1246.1983486943163,
     "over_8k_per_1000_calls": 25.921658986175114,
     "cap_hits_per_1000_calls": 3.8402457757296466,
     "t_first_iso": "2026-10-26T18:47:22-07:00",
     "t_last_iso": "2026-10-26T23:31:47-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293586_0",
      "293586_1",
      "302725_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4838,
     "completion_sum": 6441634,
     "over_8k": 141,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079414.788,
     "t_last": 1793156067.143,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1331.4663083918974,
     "over_8k_per_1000_calls": 29.144274493592395,
     "cap_hits_per_1000_calls": 4.133939644481191,
     "t_first_iso": "2026-10-26T22:36:54-07:00",
     "t_last_iso": "2026-10-27T19:54:27-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293619_0",
      "302381_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3984,
     "completion_sum": 5137171,
     "over_8k": 130,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086428.733,
     "t_last": 1793155084.028,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1289.4505522088352,
     "over_8k_per_1000_calls": 32.630522088353416,
     "cap_hits_per_1000_calls": 5.271084337349397,
     "t_first_iso": "2026-10-27T00:33:48-07:00",
     "t_last_iso": "2026-10-27T19:38:04-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293487_0",
      "293487_1",
      "298022_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5443,
     "completion_sum": 6167090,
     "over_8k": 115,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987671.147,
     "t_last": 1793153573.081,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1133.0314164982547,
     "over_8k_per_1000_calls": 21.128054381774756,
     "cap_hits_per_1000_calls": 4.593055300385816,
     "t_first_iso": "2026-10-25T21:07:51-07:00",
     "t_last_iso": "2026-10-27T19:12:53-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293764_0",
      "293764_1",
      "306607_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5058,
     "completion_sum": 7053129,
     "over_8k": 187,
     "cap_hits": 71,
     "length_finish": 71,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793121206.126,
     "t_last": 1793191179.042,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1394.450177935943,
     "over_8k_per_1000_calls": 36.97113483590352,
     "cap_hits_per_1000_calls": 14.037168841439303,
     "t_first_iso": "2026-10-27T10:13:26-07:00",
     "t_last_iso": "2026-10-28T05:39:39-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293665_0",
      "293665_1",
      "304973_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4529,
     "completion_sum": 7101274,
     "over_8k": 192,
     "cap_hits": 46,
     "length_finish": 46,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110893.463,
     "t_last": 1793164354.623,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1567.9562817398985,
     "over_8k_per_1000_calls": 42.39346434091411,
     "cap_hits_per_1000_calls": 10.156767498344005,
     "t_first_iso": "2026-10-27T07:21:33-07:00",
     "t_last_iso": "2026-10-27T22:12:34-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293654_0",
      "293654_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4653,
     "completion_sum": 6991843,
     "over_8k": 165,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108472.405,
     "t_last": 1793127721.99,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1502.6526971846122,
     "over_8k_per_1000_calls": 35.46099290780142,
     "cap_hits_per_1000_calls": 6.877283473028154,
     "t_first_iso": "2026-10-27T06:41:12-07:00",
     "t_last_iso": "2026-10-27T12:02:01-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293692_0",
      "293692_1",
      "305369_0",
      "310070_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 72,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5426,
     "completion_sum": 9750361,
     "over_8k": 301,
     "cap_hits": 77,
     "length_finish": 77,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113546.63,
     "t_last": 1793193209.786,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 9.722222222222221,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1796.970328050129,
     "over_8k_per_1000_calls": 55.47364541098415,
     "cap_hits_per_1000_calls": 14.190932546995946,
     "t_first_iso": "2026-10-27T08:05:46-07:00",
     "t_last_iso": "2026-10-28T06:13:29-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293778_0",
      "293778_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4930,
     "completion_sum": 7156976,
     "over_8k": 184,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150277.307,
     "t_last": 1793168908.148,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1451.7192697768762,
     "over_8k_per_1000_calls": 37.32251521298174,
     "cap_hits_per_1000_calls": 4.056795131845842,
     "t_first_iso": "2026-10-27T18:17:57-07:00",
     "t_last_iso": "2026-10-27T23:28:28-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293458_0",
      "293458_1",
      "295719_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4890,
     "completion_sum": 7228291,
     "over_8k": 167,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792969554.785,
     "t_last": 1793153369.533,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1478.178118609407,
     "over_8k_per_1000_calls": 34.151329243353786,
     "cap_hits_per_1000_calls": 2.8629856850715747,
     "t_first_iso": "2026-10-25T16:05:54-07:00",
     "t_last_iso": "2026-10-27T19:09:29-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293466_0",
      "293466_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4147,
     "completion_sum": 5965800,
     "over_8k": 136,
     "cap_hits": 36,
     "length_finish": 36,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792983047.689,
     "t_last": 1793026376.428,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1438.582107547625,
     "over_8k_per_1000_calls": 32.79479141548107,
     "cap_hits_per_1000_calls": 8.680974198215578,
     "t_first_iso": "2026-10-25T19:50:47-07:00",
     "t_last_iso": "2026-10-26T07:52:56-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293733_0",
      "293733_1",
      "306106_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5456,
     "completion_sum": 7429333,
     "over_8k": 180,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116333.234,
     "t_last": 1793190942.165,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1361.6812683284456,
     "over_8k_per_1000_calls": 32.99120234604106,
     "cap_hits_per_1000_calls": 4.765395894428153,
     "t_first_iso": "2026-10-27T08:52:13-07:00",
     "t_last_iso": "2026-10-28T05:35:42-07:00"
    },
    {
     "arm": "loki_k25_d25_s1_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293719_0",
      "293719_1",
      "306039_0",
      "310103_0",
      "310437_0"
     ],
     "units": 1,
     "attempts": 5,
     "episodes": 69,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5420,
     "completion_sum": 8960538,
     "over_8k": 268,
     "cap_hits": 66,
     "length_finish": 66,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [
      "310103_0"
     ],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115161.946,
     "t_last": 1793201953.532,
     "attempts_listed": 5,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "306039_0"
     ],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.695652173913043,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1653.2357933579335,
     "over_8k_per_1000_calls": 49.44649446494465,
     "cap_hits_per_1000_calls": 12.177121771217712,
     "t_first_iso": "2026-10-27T08:32:41-07:00",
     "t_last_iso": "2026-10-28T08:39:13-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "125973_0",
      "125973_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4530,
     "completion_sum": 6169394,
     "over_8k": 146,
     "cap_hits": 39,
     "length_finish": 39,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060297.189,
     "t_last": 1791077771.97,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1361.8971302428256,
     "over_8k_per_1000_calls": 32.22958057395144,
     "cap_hits_per_1000_calls": 8.609271523178808,
     "t_first_iso": "2026-10-03T13:44:57-07:00",
     "t_last_iso": "2026-10-03T18:36:11-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "125974_0",
      "125974_1",
      "128371_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4857,
     "completion_sum": 6509052,
     "over_8k": 148,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060317.383,
     "t_last": 1791083010.981,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1340.1383570105004,
     "over_8k_per_1000_calls": 30.47148445542516,
     "cap_hits_per_1000_calls": 3.5001029442042415,
     "t_first_iso": "2026-10-03T13:45:17-07:00",
     "t_last_iso": "2026-10-03T20:03:30-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "125975_0",
      "125975_1",
      "128365_0",
      "128870_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4849,
     "completion_sum": 8367804,
     "over_8k": 262,
     "cap_hits": 75,
     "length_finish": 75,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060329.651,
     "t_last": 1791091527.549,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1725.6762219014229,
     "over_8k_per_1000_calls": 54.031759125592906,
     "cap_hits_per_1000_calls": 15.467106619921633,
     "t_first_iso": "2026-10-03T13:45:29-07:00",
     "t_last_iso": "2026-10-03T22:25:27-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "125976_0",
      "125976_1",
      "128372_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5405,
     "completion_sum": 7112537,
     "over_8k": 167,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060362.713,
     "t_last": 1791083619.282,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.352941176470588,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1315.918038852914,
     "over_8k_per_1000_calls": 30.89731729879741,
     "cap_hits_per_1000_calls": 3.515263644773358,
     "t_first_iso": "2026-10-03T13:46:02-07:00",
     "t_last_iso": "2026-10-03T20:13:39-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "126009_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4539,
     "completion_sum": 5315996,
     "over_8k": 77,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061077.997,
     "t_last": 1791074014.217,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1171.1821987221856,
     "over_8k_per_1000_calls": 16.964089006389074,
     "cap_hits_per_1000_calls": 1.1015642211940957,
     "t_first_iso": "2026-10-03T13:57:57-07:00",
     "t_last_iso": "2026-10-03T17:33:34-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "126010_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3856,
     "completion_sum": 4878271,
     "over_8k": 108,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061149.246,
     "t_last": 1791072450.965,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1265.1117738589212,
     "over_8k_per_1000_calls": 28.008298755186722,
     "cap_hits_per_1000_calls": 4.408713692946058,
     "t_first_iso": "2026-10-03T13:59:09-07:00",
     "t_last_iso": "2026-10-03T17:07:30-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "126011_0",
      "126011_1",
      "128461_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5459,
     "completion_sum": 7018876,
     "over_8k": 160,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061211.886,
     "t_last": 1791086144.397,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.6875,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1285.7439091408683,
     "over_8k_per_1000_calls": 29.309397325517494,
     "cap_hits_per_1000_calls": 4.762777065396593,
     "t_first_iso": "2026-10-03T14:00:11-07:00",
     "t_last_iso": "2026-10-03T20:55:44-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "126012_0",
      "126012_1",
      "128527_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4720,
     "completion_sum": 7468570,
     "over_8k": 227,
     "cap_hits": 57,
     "length_finish": 57,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061195.282,
     "t_last": 1791086819.211,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1582.324152542373,
     "over_8k_per_1000_calls": 48.09322033898305,
     "cap_hits_per_1000_calls": 12.076271186440678,
     "t_first_iso": "2026-10-03T13:59:55-07:00",
     "t_last_iso": "2026-10-03T21:06:59-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "125977_0",
      "127832_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4669,
     "completion_sum": 5216893,
     "over_8k": 118,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060408.402,
     "t_last": 1791077095.894,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1117.3469693724567,
     "over_8k_per_1000_calls": 25.273077746840865,
     "cap_hits_per_1000_calls": 5.997001499250374,
     "t_first_iso": "2026-10-03T13:46:48-07:00",
     "t_last_iso": "2026-10-03T18:24:55-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "125978_0",
      "127834_0",
      "128304_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5264,
     "completion_sum": 5187007,
     "over_8k": 94,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060380.788,
     "t_last": 1791084329.014,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 985.373670212766,
     "over_8k_per_1000_calls": 17.857142857142858,
     "cap_hits_per_1000_calls": 2.6595744680851063,
     "t_first_iso": "2026-10-03T13:46:20-07:00",
     "t_last_iso": "2026-10-03T20:25:29-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "125979_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4721,
     "completion_sum": 4632003,
     "over_8k": 94,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060400.417,
     "t_last": 1791072722.958,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 981.148697309892,
     "over_8k_per_1000_calls": 19.911035797500528,
     "cap_hits_per_1000_calls": 2.753653886888371,
     "t_first_iso": "2026-10-03T13:46:40-07:00",
     "t_last_iso": "2026-10-03T17:12:02-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "125980_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5175,
     "completion_sum": 4236983,
     "over_8k": 72,
     "cap_hits": 11,
     "length_finish": 11,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060451.867,
     "t_last": 1791073085.229,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 818.7406763285024,
     "over_8k_per_1000_calls": 13.91304347826087,
     "cap_hits_per_1000_calls": 2.1256038647342996,
     "t_first_iso": "2026-10-03T13:47:31-07:00",
     "t_last_iso": "2026-10-03T17:18:05-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "126013_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4684,
     "completion_sum": 4196880,
     "over_8k": 55,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061259.987,
     "t_last": 1791072735.129,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 896.0034158838599,
     "over_8k_per_1000_calls": 11.742100768573868,
     "cap_hits_per_1000_calls": 0.6404782237403929,
     "t_first_iso": "2026-10-03T14:00:59-07:00",
     "t_last_iso": "2026-10-03T17:12:15-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "126014_1"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 50,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 50,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3012,
     "completion_sum": 2373650,
     "over_8k": 30,
     "cap_hits": 2,
     "length_finish": 2,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791064357.604,
     "t_last": 1791070647.332,
     "attempts_listed": 2,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "126014_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 788.0644090305445,
     "over_8k_per_1000_calls": 9.9601593625498,
     "cap_hits_per_1000_calls": 0.6640106241699867,
     "t_first_iso": "2026-10-03T14:52:37-07:00",
     "t_last_iso": "2026-10-03T16:37:27-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "126015_0",
      "127979_0",
      "128531_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5944,
     "completion_sum": 5260042,
     "over_8k": 59,
     "cap_hits": 3,
     "length_finish": 3,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061271.668,
     "t_last": 1791085564.901,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 884.9330417227457,
     "over_8k_per_1000_calls": 9.925975773889636,
     "cap_hits_per_1000_calls": 0.5047106325706595,
     "t_first_iso": "2026-10-03T14:01:11-07:00",
     "t_last_iso": "2026-10-03T20:46:04-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "126016_0",
      "126016_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4935,
     "completion_sum": 4909492,
     "over_8k": 95,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061432.4,
     "t_last": 1791080202.757,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 994.8312056737589,
     "over_8k_per_1000_calls": 19.250253292806484,
     "cap_hits_per_1000_calls": 5.268490374873354,
     "t_first_iso": "2026-10-03T14:03:52-07:00",
     "t_last_iso": "2026-10-03T19:16:42-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "125981_0",
      "125981_1",
      "128362_0",
      "128871_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 9,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5613,
     "completion_sum": 8737770,
     "over_8k": 230,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060442.927,
     "t_last": 1791091190.766,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.67605633802817,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1556.7022982362373,
     "over_8k_per_1000_calls": 40.97630500623553,
     "cap_hits_per_1000_calls": 10.689470871191876,
     "t_first_iso": "2026-10-03T13:47:22-07:00",
     "t_last_iso": "2026-10-03T22:19:50-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "125982_0",
      "125982_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5136,
     "completion_sum": 6870881,
     "over_8k": 152,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060436.578,
     "t_last": 1791077850.038,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1337.7883566978194,
     "over_8k_per_1000_calls": 29.595015576323988,
     "cap_hits_per_1000_calls": 5.062305295950155,
     "t_first_iso": "2026-10-03T13:47:16-07:00",
     "t_last_iso": "2026-10-03T18:37:30-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "125983_0",
      "125983_1",
      "128373_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4900,
     "completion_sum": 7449788,
     "over_8k": 205,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060524.729,
     "t_last": 1791083839.405,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1520.3648979591837,
     "over_8k_per_1000_calls": 41.83673469387755,
     "cap_hits_per_1000_calls": 4.285714285714286,
     "t_first_iso": "2026-10-03T13:48:44-07:00",
     "t_last_iso": "2026-10-03T20:17:19-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "125984_0",
      "127946_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4889,
     "completion_sum": 5741946,
     "over_8k": 111,
     "cap_hits": 7,
     "length_finish": 7,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060575.854,
     "t_last": 1791078753.348,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1174.462262221313,
     "over_8k_per_1000_calls": 22.70402945387605,
     "cap_hits_per_1000_calls": 1.4317856412354264,
     "t_first_iso": "2026-10-03T13:49:35-07:00",
     "t_last_iso": "2026-10-03T18:52:33-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "126018_0",
      "126018_1",
      "128532_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4603,
     "completion_sum": 5696066,
     "over_8k": 112,
     "cap_hits": 14,
     "length_finish": 14,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061433.005,
     "t_last": 1791083468.156,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1237.4681729306974,
     "over_8k_per_1000_calls": 24.331957419074516,
     "cap_hits_per_1000_calls": 3.0414946773843146,
     "t_first_iso": "2026-10-03T14:03:53-07:00",
     "t_last_iso": "2026-10-03T20:11:08-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "126020_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3992,
     "completion_sum": 4881564,
     "over_8k": 105,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061417.803,
     "t_last": 1791073598.05,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1222.8366733466935,
     "over_8k_per_1000_calls": 26.302605210420843,
     "cap_hits_per_1000_calls": 3.256513026052104,
     "t_first_iso": "2026-10-03T14:03:37-07:00",
     "t_last_iso": "2026-10-03T17:26:38-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "126021_0",
      "126021_1",
      "128526_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5725,
     "completion_sum": 7609058,
     "over_8k": 179,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061600.791,
     "t_last": 1791086944.455,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.575757575757576,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1329.0931004366812,
     "over_8k_per_1000_calls": 31.266375545851528,
     "cap_hits_per_1000_calls": 5.93886462882096,
     "t_first_iso": "2026-10-03T14:06:40-07:00",
     "t_last_iso": "2026-10-03T21:09:04-07:00"
    },
    {
     "arm": "loki_k25_d25_s1",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "126022_0",
      "126022_1",
      "128533_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4285,
     "completion_sum": 5777530,
     "over_8k": 154,
     "cap_hits": 45,
     "length_finish": 45,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061591.31,
     "t_last": 1791084628.478,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1348.3150525087515,
     "over_8k_per_1000_calls": 35.93932322053676,
     "cap_hits_per_1000_calls": 10.501750291715286,
     "t_first_iso": "2026-10-03T14:06:31-07:00",
     "t_last_iso": "2026-10-03T20:30:28-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293508_0",
      "293508_1",
      "299570_0",
      "307821_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 73,
     "timeouts": 12,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 7,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5486,
     "completion_sum": 12032957,
     "over_8k": 457,
     "cap_hits": 205,
     "length_finish": 205,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028044.258,
     "t_last": 1793191905.288,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 16.438356164383563,
     "first_timeouts_per_100_instances": 11.11111111111111,
     "completion_per_call": 2193.393547211083,
     "over_8k_per_1000_calls": 83.30295297119942,
     "cap_hits_per_1000_calls": 37.367845424717466,
     "t_first_iso": "2026-10-26T08:20:44-07:00",
     "t_last_iso": "2026-10-28T05:51:45-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293559_0",
      "293559_1",
      "301603_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5202,
     "completion_sum": 9137716,
     "over_8k": 282,
     "cap_hits": 80,
     "length_finish": 80,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065274.693,
     "t_last": 1793158682.12,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1756.5774702037677,
     "over_8k_per_1000_calls": 54.20991926182238,
     "cap_hits_per_1000_calls": 15.378700499807767,
     "t_first_iso": "2026-10-26T18:41:14-07:00",
     "t_last_iso": "2026-10-27T20:38:02-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293705_0",
      "293705_1",
      "305702_0",
      "310161_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 9,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 6,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5270,
     "completion_sum": 11865974,
     "over_8k": 478,
     "cap_hits": 196,
     "length_finish": 196,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114138.354,
     "t_last": 1793197981.81,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.67605633802817,
     "first_timeouts_per_100_instances": 9.523809523809524,
     "completion_per_call": 2251.6079696394686,
     "over_8k_per_1000_calls": 90.70208728652752,
     "cap_hits_per_1000_calls": 37.191650853889946,
     "t_first_iso": "2026-10-27T08:15:38-07:00",
     "t_last_iso": "2026-10-28T07:33:01-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293632_0",
      "293632_1",
      "303007_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5153,
     "completion_sum": 8279629,
     "over_8k": 239,
     "cap_hits": 75,
     "length_finish": 75,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087209.662,
     "t_last": 1793160541.609,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1606.7589753541627,
     "over_8k_per_1000_calls": 46.38074907820687,
     "cap_hits_per_1000_calls": 14.55462837182224,
     "t_first_iso": "2026-10-27T00:46:49-07:00",
     "t_last_iso": "2026-10-27T21:09:01-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293532_0",
      "293532_1",
      "300033_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4981,
     "completion_sum": 9208326,
     "over_8k": 276,
     "cap_hits": 93,
     "length_finish": 93,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031972.727,
     "t_last": 1793158208.138,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.575757575757576,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1848.690222846818,
     "over_8k_per_1000_calls": 55.41056012848826,
     "cap_hits_per_1000_calls": 18.67094960851235,
     "t_first_iso": "2026-10-26T09:26:12-07:00",
     "t_last_iso": "2026-10-27T20:30:08-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293752_0",
      "293752_1",
      "306500_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4738,
     "completion_sum": 8760528,
     "over_8k": 290,
     "cap_hits": 83,
     "length_finish": 83,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793117747.628,
     "t_last": 1793191752.564,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1848.9928239763613,
     "over_8k_per_1000_calls": 61.20726044744618,
     "cap_hits_per_1000_calls": 17.517940059096667,
     "t_first_iso": "2026-10-27T09:15:47-07:00",
     "t_last_iso": "2026-10-28T05:49:12-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293680_0",
      "293680_1",
      "305006_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5297,
     "completion_sum": 7910909,
     "over_8k": 209,
     "cap_hits": 81,
     "length_finish": 81,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113171.314,
     "t_last": 1793163499.568,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1493.4696998300924,
     "over_8k_per_1000_calls": 39.45629601661318,
     "cap_hits_per_1000_calls": 15.291674532754389,
     "t_first_iso": "2026-10-27T07:59:31-07:00",
     "t_last_iso": "2026-10-27T21:58:19-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293614_0",
      "293614_1",
      "303108_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5140,
     "completion_sum": 10631890,
     "over_8k": 375,
     "cap_hits": 155,
     "length_finish": 155,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082165.029,
     "t_last": 1793162298.612,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 8.064516129032258,
     "completion_per_call": 2068.4610894941634,
     "over_8k_per_1000_calls": 72.95719844357977,
     "cap_hits_per_1000_calls": 30.155642023346303,
     "t_first_iso": "2026-10-26T23:22:45-07:00",
     "t_last_iso": "2026-10-27T21:38:18-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293490_0",
      "293490_1",
      "298058_0",
      "307770_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4799,
     "completion_sum": 8700042,
     "over_8k": 305,
     "cap_hits": 150,
     "length_finish": 150,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987870.643,
     "t_last": 1793187669.547,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1812.8864346738903,
     "over_8k_per_1000_calls": 63.55490727234841,
     "cap_hits_per_1000_calls": 31.2565117732861,
     "t_first_iso": "2026-10-25T21:11:10-07:00",
     "t_last_iso": "2026-10-28T04:41:09-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293527_0",
      "293527_1",
      "299952_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5085,
     "completion_sum": 6745371,
     "over_8k": 173,
     "cap_hits": 55,
     "length_finish": 55,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031553.844,
     "t_last": 1793154616.351,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1326.5233038348083,
     "over_8k_per_1000_calls": 34.021632251720746,
     "cap_hits_per_1000_calls": 10.816125860373647,
     "t_first_iso": "2026-10-26T09:19:13-07:00",
     "t_last_iso": "2026-10-27T19:30:16-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293594_0",
      "293594_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4735,
     "completion_sum": 6903781,
     "over_8k": 191,
     "cap_hits": 64,
     "length_finish": 64,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793080093.658,
     "t_last": 1793105664.824,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1458.0318901795142,
     "over_8k_per_1000_calls": 40.33790918690602,
     "cap_hits_per_1000_calls": 13.51636747624076,
     "t_first_iso": "2026-10-26T22:48:13-07:00",
     "t_last_iso": "2026-10-27T05:54:24-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293563_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4898,
     "completion_sum": 6107399,
     "over_8k": 151,
     "cap_hits": 45,
     "length_finish": 45,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793065979.769,
     "t_last": 1793078998.845,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1246.9169048591261,
     "over_8k_per_1000_calls": 30.82890975908534,
     "cap_hits_per_1000_calls": 9.187423438138016,
     "t_first_iso": "2026-10-26T18:52:59-07:00",
     "t_last_iso": "2026-10-26T22:29:58-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293578_0",
      "293578_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4860,
     "completion_sum": 6341041,
     "over_8k": 140,
     "cap_hits": 43,
     "length_finish": 43,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793071029.195,
     "t_last": 1793089801.229,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1304.7409465020576,
     "over_8k_per_1000_calls": 28.80658436213992,
     "cap_hits_per_1000_calls": 8.847736625514404,
     "t_first_iso": "2026-10-26T20:17:09-07:00",
     "t_last_iso": "2026-10-27T01:30:01-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293621_0",
      "302356_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3907,
     "completion_sum": 5328882,
     "over_8k": 139,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086470.482,
     "t_last": 1793155650.921,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1363.9319170719223,
     "over_8k_per_1000_calls": 35.577169183516766,
     "cap_hits_per_1000_calls": 10.238034297414897,
     "t_first_iso": "2026-10-27T00:34:30-07:00",
     "t_last_iso": "2026-10-27T19:47:30-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293484_0",
      "293484_1",
      "298001_0",
      "307769_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5361,
     "completion_sum": 6898286,
     "over_8k": 173,
     "cap_hits": 54,
     "length_finish": 54,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987660.488,
     "t_last": 1793189192.716,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1286.7535907479948,
     "over_8k_per_1000_calls": 32.27009886215259,
     "cap_hits_per_1000_calls": 10.072747621712367,
     "t_first_iso": "2026-10-25T21:07:40-07:00",
     "t_last_iso": "2026-10-28T05:06:32-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293767_0",
      "293767_1",
      "308248_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4912,
     "completion_sum": 7968611,
     "over_8k": 271,
     "cap_hits": 96,
     "length_finish": 96,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793142497.233,
     "t_last": 1793191836.625,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1622.2742263843647,
     "over_8k_per_1000_calls": 55.171009771986974,
     "cap_hits_per_1000_calls": 19.54397394136808,
     "t_first_iso": "2026-10-27T16:08:17-07:00",
     "t_last_iso": "2026-10-28T05:50:36-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293669_0",
      "293669_1",
      "305110_0",
      "308570_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5011,
     "completion_sum": 9817381,
     "over_8k": 360,
     "cap_hits": 137,
     "length_finish": 137,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110939.916,
     "t_last": 1793195638.241,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1959.1660347236082,
     "over_8k_per_1000_calls": 71.84194771502695,
     "cap_hits_per_1000_calls": 27.339852324885253,
     "t_first_iso": "2026-10-27T07:22:19-07:00",
     "t_last_iso": "2026-10-28T06:53:58-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293658_0",
      "293658_1",
      "304967_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5461,
     "completion_sum": 9411434,
     "over_8k": 288,
     "cap_hits": 106,
     "length_finish": 106,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793108729.451,
     "t_last": 1793163893.364,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.695652173913043,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1723.3902215711407,
     "over_8k_per_1000_calls": 52.73759384728072,
     "cap_hits_per_1000_calls": 19.410364402124152,
     "t_first_iso": "2026-10-27T06:45:29-07:00",
     "t_last_iso": "2026-10-27T22:04:53-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293688_0",
      "293688_1",
      "305424_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4873,
     "completion_sum": 10201481,
     "over_8k": 380,
     "cap_hits": 123,
     "length_finish": 122,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113360.235,
     "t_last": 1793185261.585,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.882352941176471,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 2093.4703468089474,
     "over_8k_per_1000_calls": 77.9807100348861,
     "cap_hits_per_1000_calls": 25.241124563923663,
     "t_first_iso": "2026-10-27T08:02:40-07:00",
     "t_last_iso": "2026-10-28T04:01:01-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293781_0",
      "293781_1",
      "309064_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4840,
     "completion_sum": 7444878,
     "over_8k": 214,
     "cap_hits": 80,
     "length_finish": 80,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150264.736,
     "t_last": 1793192983.985,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1538.1979338842975,
     "over_8k_per_1000_calls": 44.21487603305785,
     "cap_hits_per_1000_calls": 16.52892561983471,
     "t_first_iso": "2026-10-27T18:17:44-07:00",
     "t_last_iso": "2026-10-28T06:09:43-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293461_0",
      "293461_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4727,
     "completion_sum": 7496125,
     "over_8k": 222,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792969676.808,
     "t_last": 1792988690.1,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1585.810239052253,
     "over_8k_per_1000_calls": 46.964247937381,
     "cap_hits_per_1000_calls": 12.693039983075947,
     "t_first_iso": "2026-10-25T16:07:56-07:00",
     "t_last_iso": "2026-10-25T21:24:50-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293464_0",
      "294754_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4128,
     "completion_sum": 6264199,
     "over_8k": 186,
     "cap_hits": 63,
     "length_finish": 63,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792970126.539,
     "t_last": 1793155617.977,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1517.4900678294573,
     "over_8k_per_1000_calls": 45.05813953488372,
     "cap_hits_per_1000_calls": 15.261627906976743,
     "t_first_iso": "2026-10-25T16:15:26-07:00",
     "t_last_iso": "2026-10-27T19:46:57-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293742_0",
      "293742_1",
      "306736_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5764,
     "completion_sum": 10557961,
     "over_8k": 381,
     "cap_hits": 144,
     "length_finish": 144,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116923.011,
     "t_last": 1793188264.005,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1831.7073213046494,
     "over_8k_per_1000_calls": 66.0999306037474,
     "cap_hits_per_1000_calls": 24.98265093684941,
     "t_first_iso": "2026-10-27T09:02:03-07:00",
     "t_last_iso": "2026-10-28T04:51:04-07:00"
    },
    {
     "arm": "tri_b4096_s1_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293724_1",
      "306297_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 34,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 30,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 2647,
     "completion_sum": 5961589,
     "over_8k": 233,
     "cap_hits": 87,
     "length_finish": 87,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793134989.614,
     "t_last": 1793191810.421,
     "attempts_listed": 3,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "293724_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 14.705882352941176,
     "first_timeouts_per_100_instances": 13.333333333333334,
     "completion_per_call": 2252.205893464299,
     "over_8k_per_1000_calls": 88.02417831507367,
     "cap_hits_per_1000_calls": 32.86739705326785,
     "t_first_iso": "2026-10-27T14:03:09-07:00",
     "t_last_iso": "2026-10-28T05:50:10-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "126317_0",
      "126317_1",
      "128253_0",
      "128782_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5021,
     "completion_sum": 9564740,
     "over_8k": 317,
     "cap_hits": 154,
     "length_finish": 154,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791059397.39,
     "t_last": 1791090060.059,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1904.9472216689903,
     "over_8k_per_1000_calls": 63.134833698466444,
     "cap_hits_per_1000_calls": 30.671181039633538,
     "t_first_iso": "2026-10-03T13:29:57-07:00",
     "t_last_iso": "2026-10-03T22:01:00-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "126460_0",
      "127977_0",
      "128528_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5009,
     "completion_sum": 8612789,
     "over_8k": 286,
     "cap_hits": 123,
     "length_finish": 123,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060598.646,
     "t_last": 1791086851.443,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1719.4627670193652,
     "over_8k_per_1000_calls": 57.097224995008986,
     "cap_hits_per_1000_calls": 24.555799560790575,
     "t_first_iso": "2026-10-03T13:49:58-07:00",
     "t_last_iso": "2026-10-03T21:07:31-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "126461_0",
      "126461_1",
      "128374_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4537,
     "completion_sum": 7737396,
     "over_8k": 245,
     "cap_hits": 70,
     "length_finish": 70,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060613.824,
     "t_last": 1791083282.862,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1705.3991624421424,
     "over_8k_per_1000_calls": 54.00044081992506,
     "cap_hits_per_1000_calls": 15.428697377121447,
     "t_first_iso": "2026-10-03T13:50:13-07:00",
     "t_last_iso": "2026-10-03T20:08:02-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "126462_0",
      "126462_1",
      "128375_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5338,
     "completion_sum": 7523317,
     "over_8k": 195,
     "cap_hits": 72,
     "length_finish": 72,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060587.919,
     "t_last": 1791085591.515,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1409.388722367928,
     "over_8k_per_1000_calls": 36.53053578119146,
     "cap_hits_per_1000_calls": 13.48819782690146,
     "t_first_iso": "2026-10-03T13:49:47-07:00",
     "t_last_iso": "2026-10-03T20:46:31-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "126471_1",
      "128305_0",
      "128822_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 50,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 49,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3664,
     "completion_sum": 4804259,
     "over_8k": 106,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791065278.7,
     "t_last": 1791087035.27,
     "attempts_listed": 4,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "126471_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 2.0,
     "first_timeouts_per_100_instances": 2.0408163265306123,
     "completion_per_call": 1311.2060589519651,
     "over_8k_per_1000_calls": 28.930131004366814,
     "cap_hits_per_1000_calls": 7.096069868995633,
     "t_first_iso": "2026-10-03T15:07:58-07:00",
     "t_last_iso": "2026-10-03T21:10:35-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "126472_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4081,
     "completion_sum": 5486490,
     "over_8k": 129,
     "cap_hits": 31,
     "length_finish": 31,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061695.224,
     "t_last": 1791073094.633,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1344.3984317569223,
     "over_8k_per_1000_calls": 31.609899534427836,
     "cap_hits_per_1000_calls": 7.596177407498162,
     "t_first_iso": "2026-10-03T14:08:15-07:00",
     "t_last_iso": "2026-10-03T17:18:14-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "126473_0",
      "126473_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5608,
     "completion_sum": 7416859,
     "over_8k": 172,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061754.46,
     "t_last": 1791079671.059,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1322.5497503566335,
     "over_8k_per_1000_calls": 30.670470756062766,
     "cap_hits_per_1000_calls": 7.489300998573467,
     "t_first_iso": "2026-10-03T14:09:14-07:00",
     "t_last_iso": "2026-10-03T19:07:51-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "126474_0",
      "126474_1",
      "128529_0",
      "129022_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4911,
     "completion_sum": 9180737,
     "over_8k": 329,
     "cap_hits": 153,
     "length_finish": 153,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061784.526,
     "t_last": 1791093087.134,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1869.4231317450622,
     "over_8k_per_1000_calls": 66.9924658928935,
     "cap_hits_per_1000_calls": 31.154551007941357,
     "t_first_iso": "2026-10-03T14:09:44-07:00",
     "t_last_iso": "2026-10-03T22:51:27-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "126463_0",
      "127947_0",
      "128376_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4881,
     "completion_sum": 5163519,
     "over_8k": 111,
     "cap_hits": 59,
     "length_finish": 59,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791060592.023,
     "t_last": 1791083786.505,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1057.8813767670558,
     "over_8k_per_1000_calls": 22.741241548862938,
     "cap_hits_per_1000_calls": 12.087686949395616,
     "t_first_iso": "2026-10-03T13:49:52-07:00",
     "t_last_iso": "2026-10-03T20:16:26-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "126464_0",
      "127978_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5191,
     "completion_sum": 5709246,
     "over_8k": 124,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061648.99,
     "t_last": 1791078566.498,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1099.8354844923906,
     "over_8k_per_1000_calls": 23.88749759198613,
     "cap_hits_per_1000_calls": 6.742438836447698,
     "t_first_iso": "2026-10-03T14:07:28-07:00",
     "t_last_iso": "2026-10-03T18:49:26-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "126465_0",
      "127948_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4953,
     "completion_sum": 5246598,
     "over_8k": 121,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061613.409,
     "t_last": 1791076591.609,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1059.2768019382193,
     "over_8k_per_1000_calls": 24.429638602866948,
     "cap_hits_per_1000_calls": 6.86452654956592,
     "t_first_iso": "2026-10-03T14:06:53-07:00",
     "t_last_iso": "2026-10-03T18:16:31-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "126466_0",
      "128001_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5296,
     "completion_sum": 5266998,
     "over_8k": 123,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061645.212,
     "t_last": 1791079046.79,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 994.5237915407855,
     "over_8k_per_1000_calls": 23.225075528700906,
     "cap_hits_per_1000_calls": 6.231117824773414,
     "t_first_iso": "2026-10-03T14:07:25-07:00",
     "t_last_iso": "2026-10-03T18:57:26-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "126475_1"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 52,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 52,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4111,
     "completion_sum": 4501753,
     "over_8k": 96,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791064520.042,
     "t_last": 1791077474.783,
     "attempts_listed": 2,
     "attempts_without_snapshot": 1,
     "attempt_tags_without_snapshot": [
      "126475_0"
     ],
     "units_first_attempt_without_snapshot": 1,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1095.050595962053,
     "over_8k_per_1000_calls": 23.351982486013135,
     "cap_hits_per_1000_calls": 5.35149598637801,
     "t_first_iso": "2026-10-03T14:55:20-07:00",
     "t_last_iso": "2026-10-03T18:31:14-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "126476_0",
      "128002_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4449,
     "completion_sum": 4871957,
     "over_8k": 124,
     "cap_hits": 45,
     "length_finish": 45,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061760.355,
     "t_last": 1791076534.919,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1095.0678804225668,
     "over_8k_per_1000_calls": 27.871431782423016,
     "cap_hits_per_1000_calls": 10.114632501685772,
     "t_first_iso": "2026-10-03T14:09:20-07:00",
     "t_last_iso": "2026-10-03T18:15:34-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "126477_0",
      "127943_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5239,
     "completion_sum": 5999343,
     "over_8k": 149,
     "cap_hits": 41,
     "length_finish": 41,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061772.538,
     "t_last": 1791078724.847,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1145.1313227715214,
     "over_8k_per_1000_calls": 28.440542088184767,
     "cap_hits_per_1000_calls": 7.825920977285741,
     "t_first_iso": "2026-10-03T14:09:32-07:00",
     "t_last_iso": "2026-10-03T18:52:04-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "126478_0",
      "127980_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4576,
     "completion_sum": 5327814,
     "over_8k": 135,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061766.398,
     "t_last": 1791078141.449,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1164.2950174825176,
     "over_8k_per_1000_calls": 29.501748251748253,
     "cap_hits_per_1000_calls": 10.48951048951049,
     "t_first_iso": "2026-10-03T14:09:26-07:00",
     "t_last_iso": "2026-10-03T18:42:21-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "126467_0",
      "126467_1",
      "128530_0",
      "129023_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4912,
     "completion_sum": 9505673,
     "over_8k": 317,
     "cap_hits": 157,
     "length_finish": 157,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061598.519,
     "t_last": 1791093002.219,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1935.1940146579805,
     "over_8k_per_1000_calls": 64.5358306188925,
     "cap_hits_per_1000_calls": 31.962540716612377,
     "t_first_iso": "2026-10-03T14:06:38-07:00",
     "t_last_iso": "2026-10-03T22:50:02-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "126468_0",
      "126468_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5056,
     "completion_sum": 6504680,
     "over_8k": 157,
     "cap_hits": 43,
     "length_finish": 43,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061667.147,
     "t_last": 1791079991.837,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1286.5268987341772,
     "over_8k_per_1000_calls": 31.05221518987342,
     "cap_hits_per_1000_calls": 8.504746835443038,
     "t_first_iso": "2026-10-03T14:07:47-07:00",
     "t_last_iso": "2026-10-03T19:13:11-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "126469_0",
      "126469_1",
      "128534_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5058,
     "completion_sum": 8560161,
     "over_8k": 266,
     "cap_hits": 91,
     "length_finish": 91,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061685.446,
     "t_last": 1791086978.101,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1692.4003558718862,
     "over_8k_per_1000_calls": 52.58995650454725,
     "cap_hits_per_1000_calls": 17.991300909450377,
     "t_first_iso": "2026-10-03T14:08:05-07:00",
     "t_last_iso": "2026-10-03T21:09:38-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "126470_0",
      "126470_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5323,
     "completion_sum": 7267574,
     "over_8k": 193,
     "cap_hits": 61,
     "length_finish": 61,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061690.29,
     "t_last": 1791080589.397,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1365.3154236332896,
     "over_8k_per_1000_calls": 36.25774938944205,
     "cap_hits_per_1000_calls": 11.459703174901371,
     "t_first_iso": "2026-10-03T14:08:10-07:00",
     "t_last_iso": "2026-10-03T19:23:09-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "126479_0",
      "126479_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4714,
     "completion_sum": 5902106,
     "over_8k": 124,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791061774.886,
     "t_last": 1791080028.583,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1252.0377598642342,
     "over_8k_per_1000_calls": 26.304624522698344,
     "cap_hits_per_1000_calls": 5.515485787017395,
     "t_first_iso": "2026-10-03T14:09:34-07:00",
     "t_last_iso": "2026-10-03T19:13:48-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "126480_0",
      "126480_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4240,
     "completion_sum": 5715222,
     "over_8k": 137,
     "cap_hits": 52,
     "length_finish": 52,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791062156.964,
     "t_last": 1791077372.483,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1347.929716981132,
     "over_8k_per_1000_calls": 32.31132075471698,
     "cap_hits_per_1000_calls": 12.264150943396226,
     "t_first_iso": "2026-10-03T14:15:56-07:00",
     "t_last_iso": "2026-10-03T18:29:32-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "126481_0",
      "126481_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5844,
     "completion_sum": 8205120,
     "over_8k": 209,
     "cap_hits": 66,
     "length_finish": 66,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791062113.037,
     "t_last": 1791079933.177,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1404.024640657084,
     "over_8k_per_1000_calls": 35.76317590691308,
     "cap_hits_per_1000_calls": 11.293634496919918,
     "t_first_iso": "2026-10-03T14:15:13-07:00",
     "t_last_iso": "2026-10-03T19:12:13-07:00"
    },
    {
     "arm": "tri_b4096_s1",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "126482_0",
      "126482_1",
      "128577_0",
      "129024_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4461,
     "completion_sum": 7384835,
     "over_8k": 244,
     "cap_hits": 132,
     "length_finish": 132,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1791062126.071,
     "t_last": 1791093253.334,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1655.421430172607,
     "over_8k_per_1000_calls": 54.696256444743334,
     "cap_hits_per_1000_calls": 29.589778076664427,
     "t_first_iso": "2026-10-03T14:15:26-07:00",
     "t_last_iso": "2026-10-03T22:54:13-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293504_0",
      "293504_1",
      "299540_0",
      "307817_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 70,
     "timeouts": 8,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5372,
     "completion_sum": 10202208,
     "over_8k": 352,
     "cap_hits": 120,
     "length_finish": 120,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793026512.643,
     "t_last": 1793191857.689,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.428571428571429,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 1899.1451973194341,
     "over_8k_per_1000_calls": 65.52494415487715,
     "cap_hits_per_1000_calls": 22.338049143708115,
     "t_first_iso": "2026-10-26T07:55:12-07:00",
     "t_last_iso": "2026-10-28T05:50:57-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293555_0",
      "293555_1",
      "301315_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 70,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5454,
     "completion_sum": 9859392,
     "over_8k": 292,
     "cap_hits": 77,
     "length_finish": 77,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793061519.617,
     "t_last": 1793157400.393,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.571428571428571,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1807.7359735973598,
     "over_8k_per_1000_calls": 53.53868720205354,
     "cap_hits_per_1000_calls": 14.118078474514117,
     "t_first_iso": "2026-10-26T17:38:39-07:00",
     "t_last_iso": "2026-10-27T20:16:40-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293703_0",
      "293703_1",
      "305372_0",
      "310071_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 70,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5165,
     "completion_sum": 11090492,
     "over_8k": 424,
     "cap_hits": 94,
     "length_finish": 94,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114102.27,
     "t_last": 1793195917.656,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.714285714285714,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 2147.2394966118104,
     "over_8k_per_1000_calls": 82.09099709583737,
     "cap_hits_per_1000_calls": 18.19941916747338,
     "t_first_iso": "2026-10-27T08:15:02-07:00",
     "t_last_iso": "2026-10-28T06:58:37-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293640_0",
      "293640_1",
      "303142_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5384,
     "completion_sum": 10028969,
     "over_8k": 320,
     "cap_hits": 73,
     "length_finish": 73,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087619.511,
     "t_last": 1793162682.968,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1862.7356983655275,
     "over_8k_per_1000_calls": 59.43536404160476,
     "cap_hits_per_1000_calls": 13.558692421991084,
     "t_first_iso": "2026-10-27T00:53:39-07:00",
     "t_last_iso": "2026-10-27T21:44:42-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293534_0",
      "293534_1",
      "300184_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 74,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5565,
     "completion_sum": 9608363,
     "over_8k": 256,
     "cap_hits": 44,
     "length_finish": 44,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793032148.27,
     "t_last": 1793155767.785,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.108108108108109,
     "first_timeouts_per_100_instances": 8.064516129032258,
     "completion_per_call": 1726.5701707097933,
     "over_8k_per_1000_calls": 46.00179694519317,
     "cap_hits_per_1000_calls": 7.9065588499550765,
     "t_first_iso": "2026-10-26T09:29:08-07:00",
     "t_last_iso": "2026-10-27T19:49:27-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293755_0",
      "293755_1",
      "306603_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4382,
     "completion_sum": 8164001,
     "over_8k": 290,
     "cap_hits": 73,
     "length_finish": 73,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119081.733,
     "t_last": 1793189387.502,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1863.0764491099953,
     "over_8k_per_1000_calls": 66.17982656321314,
     "cap_hits_per_1000_calls": 16.659059790050204,
     "t_first_iso": "2026-10-27T09:38:01-07:00",
     "t_last_iso": "2026-10-28T05:09:47-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293685_0",
      "293685_1",
      "305368_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5814,
     "completion_sum": 10363880,
     "over_8k": 324,
     "cap_hits": 67,
     "length_finish": 66,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113108.251,
     "t_last": 1793186491.06,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1782.5730994152048,
     "over_8k_per_1000_calls": 55.72755417956656,
     "cap_hits_per_1000_calls": 11.52390780873753,
     "t_first_iso": "2026-10-27T07:58:28-07:00",
     "t_last_iso": "2026-10-28T04:21:31-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293613_0",
      "293613_1",
      "302921_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4632,
     "completion_sum": 8756536,
     "over_8k": 311,
     "cap_hits": 90,
     "length_finish": 90,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793082087.285,
     "t_last": 1793159706.146,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.153846153846154,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1890.4438687392055,
     "over_8k_per_1000_calls": 67.14162348877375,
     "cap_hits_per_1000_calls": 19.430051813471504,
     "t_first_iso": "2026-10-26T23:21:27-07:00",
     "t_last_iso": "2026-10-27T20:55:06-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293491_0",
      "293491_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4802,
     "completion_sum": 7263483,
     "over_8k": 209,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987841.854,
     "t_last": 1793027837.196,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1512.5953769262808,
     "over_8k_per_1000_calls": 43.52353186172428,
     "cap_hits_per_1000_calls": 11.037067888379841,
     "t_first_iso": "2026-10-25T21:10:41-07:00",
     "t_last_iso": "2026-10-26T08:17:17-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293525_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4631,
     "completion_sum": 5215846,
     "over_8k": 106,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031200.272,
     "t_last": 1793041808.976,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1126.289354351112,
     "over_8k_per_1000_calls": 22.889224789462318,
     "cap_hits_per_1000_calls": 6.478082487583675,
     "t_first_iso": "2026-10-26T09:13:20-07:00",
     "t_last_iso": "2026-10-26T12:10:08-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293593_0",
      "302039_0",
      "307895_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4895,
     "completion_sum": 7332147,
     "over_8k": 210,
     "cap_hits": 59,
     "length_finish": 59,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079969.407,
     "t_last": 1793188428.259,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1497.8849846782432,
     "over_8k_per_1000_calls": 42.90091930541369,
     "cap_hits_per_1000_calls": 12.053115423901941,
     "t_first_iso": "2026-10-26T22:46:09-07:00",
     "t_last_iso": "2026-10-28T04:53:48-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293568_0",
      "293568_1",
      "301717_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5023,
     "completion_sum": 6301925,
     "over_8k": 142,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793067492.838,
     "t_last": 1793156223.205,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1254.6137766275135,
     "over_8k_per_1000_calls": 28.26995819231535,
     "cap_hits_per_1000_calls": 3.9816842524387814,
     "t_first_iso": "2026-10-26T19:18:12-07:00",
     "t_last_iso": "2026-10-27T19:57:03-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293583_0",
      "301940_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4504,
     "completion_sum": 5646949,
     "over_8k": 128,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793078958.083,
     "t_last": 1793156188.722,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1253.7630994671404,
     "over_8k_per_1000_calls": 28.41918294849023,
     "cap_hits_per_1000_calls": 3.774422735346359,
     "t_first_iso": "2026-10-26T22:29:18-07:00",
     "t_last_iso": "2026-10-27T19:56:28-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293624_0",
      "302425_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4061,
     "completion_sum": 5699636,
     "over_8k": 153,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086527.058,
     "t_last": 1793154907.899,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1403.5055405072642,
     "over_8k_per_1000_calls": 37.67544939670032,
     "cap_hits_per_1000_calls": 5.9098744151686775,
     "t_first_iso": "2026-10-27T00:35:27-07:00",
     "t_last_iso": "2026-10-27T19:35:07-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293476_0",
      "293476_1",
      "298000_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5197,
     "completion_sum": 6607546,
     "over_8k": 145,
     "cap_hits": 18,
     "length_finish": 18,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987407.177,
     "t_last": 1793152967.331,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1271.4154319799884,
     "over_8k_per_1000_calls": 27.90071194920146,
     "cap_hits_per_1000_calls": 3.4635366557629403,
     "t_first_iso": "2026-10-25T21:03:27-07:00",
     "t_last_iso": "2026-10-27T19:02:47-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293770_0",
      "293770_1",
      "308250_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4855,
     "completion_sum": 7275132,
     "over_8k": 206,
     "cap_hits": 74,
     "length_finish": 74,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793143232.237,
     "t_last": 1793193425.932,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1498.4823892893924,
     "over_8k_per_1000_calls": 42.43048403707518,
     "cap_hits_per_1000_calls": 15.242018537590113,
     "t_first_iso": "2026-10-27T16:20:32-07:00",
     "t_last_iso": "2026-10-28T06:17:05-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293670_0",
      "293670_1",
      "304975_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5109,
     "completion_sum": 9861535,
     "over_8k": 361,
     "cap_hits": 101,
     "length_finish": 101,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110905.466,
     "t_last": 1793164584.082,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 1930.228028968487,
     "over_8k_per_1000_calls": 70.65962027794089,
     "cap_hits_per_1000_calls": 19.76903503621061,
     "t_first_iso": "2026-10-27T07:21:45-07:00",
     "t_last_iso": "2026-10-27T22:16:24-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293646_0",
      "293646_1",
      "303109_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5306,
     "completion_sum": 9579679,
     "over_8k": 308,
     "cap_hits": 79,
     "length_finish": 79,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793088813.773,
     "t_last": 1793162635.633,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1805.442706370147,
     "over_8k_per_1000_calls": 58.047493403693935,
     "cap_hits_per_1000_calls": 14.888805126272144,
     "t_first_iso": "2026-10-27T01:13:33-07:00",
     "t_last_iso": "2026-10-27T21:43:55-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293695_0",
      "293695_1",
      "305114_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4841,
     "completion_sum": 9367243,
     "over_8k": 305,
     "cap_hits": 89,
     "length_finish": 89,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113472.996,
     "t_last": 1793161633.468,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1934.9809956620534,
     "over_8k_per_1000_calls": 63.00351167114233,
     "cap_hits_per_1000_calls": 18.384631274530054,
     "t_first_iso": "2026-10-27T08:04:32-07:00",
     "t_last_iso": "2026-10-27T21:27:13-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293776_0",
      "293776_1",
      "308574_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 71,
     "timeouts": 9,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5891,
     "completion_sum": 10875727,
     "over_8k": 363,
     "cap_hits": 105,
     "length_finish": 105,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793146667.895,
     "t_last": 1793196058.522,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.67605633802817,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1846.1597351892717,
     "over_8k_per_1000_calls": 61.619419453403495,
     "cap_hits_per_1000_calls": 17.823799015447293,
     "t_first_iso": "2026-10-27T17:17:47-07:00",
     "t_last_iso": "2026-10-28T07:00:58-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293459_0",
      "293459_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4785,
     "completion_sum": 6678149,
     "over_8k": 138,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792969576.423,
     "t_last": 1792987198.243,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1395.6424242424243,
     "over_8k_per_1000_calls": 28.84012539184953,
     "cap_hits_per_1000_calls": 2.5078369905956115,
     "t_first_iso": "2026-10-25T16:06:16-07:00",
     "t_last_iso": "2026-10-25T20:59:58-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293475_0",
      "293475_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4407,
     "completion_sum": 7023981,
     "over_8k": 185,
     "cap_hits": 43,
     "length_finish": 43,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987396.338,
     "t_last": 1793026097.39,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1593.8236895847515,
     "over_8k_per_1000_calls": 41.97867029725437,
     "cap_hits_per_1000_calls": 9.757204447469935,
     "t_first_iso": "2026-10-25T21:03:16-07:00",
     "t_last_iso": "2026-10-26T07:48:17-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293739_0",
      "293739_1",
      "306109_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5921,
     "completion_sum": 9102834,
     "over_8k": 248,
     "cap_hits": 39,
     "length_finish": 39,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116744.524,
     "t_last": 1793191920.008,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.575757575757576,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1537.3811856105388,
     "over_8k_per_1000_calls": 41.8848167539267,
     "cap_hits_per_1000_calls": 6.586725215335248,
     "t_first_iso": "2026-10-27T08:59:04-07:00",
     "t_last_iso": "2026-10-28T05:52:00-07:00"
    },
    {
     "arm": "fp8kv_s1_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293718_0",
      "293718_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4182,
     "completion_sum": 6901246,
     "over_8k": 197,
     "cap_hits": 41,
     "length_finish": 41,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793114894.664,
     "t_last": 1793138953.016,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1650.2262075561932,
     "over_8k_per_1000_calls": 47.10664753706361,
     "cap_hits_per_1000_calls": 9.803921568627452,
     "t_first_iso": "2026-10-27T08:28:14-07:00",
     "t_last_iso": "2026-10-27T15:09:13-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "276557_0",
      "276557_1",
      "278070_0",
      "278453_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 4605,
     "completion_sum": 8655071,
     "over_8k": 289,
     "cap_hits": 77,
     "length_finish": 77,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792678641.624,
     "t_last": 1792709523.486,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.294117647058824,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1879.4942453854505,
     "over_8k_per_1000_calls": 62.757871878393054,
     "cap_hits_per_1000_calls": 16.720955483170467,
     "t_first_iso": "2026-10-22T07:17:21-07:00",
     "t_last_iso": "2026-10-22T15:52:03-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "276951_0",
      "276951_1",
      "278419_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4758,
     "completion_sum": 8134596,
     "over_8k": 240,
     "cap_hits": 49,
     "length_finish": 49,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792683566.414,
     "t_last": 1792705152.381,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.477611940298507,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1709.6670870113494,
     "over_8k_per_1000_calls": 50.441361916771754,
     "cap_hits_per_1000_calls": 10.298444724674233,
     "t_first_iso": "2026-10-22T08:39:26-07:00",
     "t_last_iso": "2026-10-22T14:39:12-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "276952_0",
      "276952_1",
      "278417_0",
      "278794_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4602,
     "completion_sum": 8780726,
     "over_8k": 298,
     "cap_hits": 82,
     "length_finish": 82,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792683957.467,
     "t_last": 1792713437.611,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1908.0239026510212,
     "over_8k_per_1000_calls": 64.75445458496306,
     "cap_hits_per_1000_calls": 17.818339852238157,
     "t_first_iso": "2026-10-22T08:45:57-07:00",
     "t_last_iso": "2026-10-22T16:57:17-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "276953_0",
      "276953_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 68,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4975,
     "completion_sum": 7258069,
     "over_8k": 193,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792683948.222,
     "t_last": 1792701273.698,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.882352941176471,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1458.9083417085428,
     "over_8k_per_1000_calls": 38.79396984924623,
     "cap_hits_per_1000_calls": 6.432160804020101,
     "t_first_iso": "2026-10-22T08:45:48-07:00",
     "t_last_iso": "2026-10-22T13:34:33-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "276962_0",
      "276962_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4407,
     "completion_sum": 6395950,
     "over_8k": 148,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684443.907,
     "t_last": 1792700339.593,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1451.3160880417518,
     "over_8k_per_1000_calls": 33.582936237803494,
     "cap_hits_per_1000_calls": 4.992058089403222,
     "t_first_iso": "2026-10-22T08:54:03-07:00",
     "t_last_iso": "2026-10-22T13:18:59-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "276963_0",
      "276963_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3947,
     "completion_sum": 5044710,
     "over_8k": 105,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684654.872,
     "t_last": 1792701236.02,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1278.1124904991132,
     "over_8k_per_1000_calls": 26.60248289840385,
     "cap_hits_per_1000_calls": 4.307068659741576,
     "t_first_iso": "2026-10-22T08:57:34-07:00",
     "t_last_iso": "2026-10-22T13:33:56-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "276964_0",
      "276964_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5119,
     "completion_sum": 6960394,
     "over_8k": 156,
     "cap_hits": 25,
     "length_finish": 25,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684668.63,
     "t_last": 1792701616.57,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1359.717522953702,
     "over_8k_per_1000_calls": 30.474702090252002,
     "cap_hits_per_1000_calls": 4.883766360617308,
     "t_first_iso": "2026-10-22T08:57:48-07:00",
     "t_last_iso": "2026-10-22T13:40:16-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "276965_0",
      "276965_1",
      "278454_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4331,
     "completion_sum": 6919656,
     "over_8k": 196,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684665.159,
     "t_last": 1792707499.437,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1597.7039944585547,
     "over_8k_per_1000_calls": 45.255137381667055,
     "cap_hits_per_1000_calls": 8.773955206649735,
     "t_first_iso": "2026-10-22T08:57:45-07:00",
     "t_last_iso": "2026-10-22T15:18:19-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "276954_0",
      "276954_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4491,
     "completion_sum": 4984480,
     "over_8k": 108,
     "cap_hits": 28,
     "length_finish": 28,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684431.381,
     "t_last": 1792699130.942,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1109.8819861946115,
     "over_8k_per_1000_calls": 24.04809619238477,
     "cap_hits_per_1000_calls": 6.234691605433088,
     "t_first_iso": "2026-10-22T08:53:51-07:00",
     "t_last_iso": "2026-10-22T12:58:50-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "276955_0",
      "278071_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4824,
     "completion_sum": 4954700,
     "over_8k": 88,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684457.159,
     "t_last": 1792698482.417,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1027.0936981757877,
     "over_8k_per_1000_calls": 18.24212271973466,
     "cap_hits_per_1000_calls": 3.5240464344941955,
     "t_first_iso": "2026-10-22T08:54:17-07:00",
     "t_last_iso": "2026-10-22T12:48:02-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "276956_0",
      "276956_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4704,
     "completion_sum": 4989696,
     "over_8k": 88,
     "cap_hits": 21,
     "length_finish": 21,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684415.333,
     "t_last": 1792703036.833,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1060.734693877551,
     "over_8k_per_1000_calls": 18.707482993197278,
     "cap_hits_per_1000_calls": 4.464285714285714,
     "t_first_iso": "2026-10-22T08:53:35-07:00",
     "t_last_iso": "2026-10-22T14:03:56-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "276957_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4706,
     "completion_sum": 4363944,
     "over_8k": 56,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684453.251,
     "t_last": 1792696192.192,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 927.3149171270718,
     "over_8k_per_1000_calls": 11.899702507437315,
     "cap_hits_per_1000_calls": 1.6999575010624735,
     "t_first_iso": "2026-10-22T08:54:13-07:00",
     "t_last_iso": "2026-10-22T12:09:52-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "276966_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4384,
     "completion_sum": 4195666,
     "over_8k": 55,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684691.975,
     "t_last": 1792696904.823,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 957.040602189781,
     "over_8k_per_1000_calls": 12.545620437956204,
     "cap_hits_per_1000_calls": 1.1405109489051095,
     "t_first_iso": "2026-10-22T08:58:11-07:00",
     "t_last_iso": "2026-10-22T12:21:44-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "276967_0",
      "278072_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4212,
     "completion_sum": 4442452,
     "over_8k": 67,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684686.959,
     "t_last": 1792701903.986,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1054.713200379867,
     "over_8k_per_1000_calls": 15.90693257359924,
     "cap_hits_per_1000_calls": 4.036087369420703,
     "t_first_iso": "2026-10-22T08:58:06-07:00",
     "t_last_iso": "2026-10-22T13:45:03-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "276968_0",
      "276968_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5006,
     "completion_sum": 4348780,
     "over_8k": 68,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792686146.671,
     "t_last": 1792699893.562,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 868.713543747503,
     "over_8k_per_1000_calls": 13.583699560527368,
     "cap_hits_per_1000_calls": 2.9964043148222133,
     "t_first_iso": "2026-10-22T09:22:26-07:00",
     "t_last_iso": "2026-10-22T13:11:33-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "276969_0",
      "276969_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4745,
     "completion_sum": 6221180,
     "over_8k": 146,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792687022.489,
     "t_last": 1792704650.673,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1311.1022128556376,
     "over_8k_per_1000_calls": 30.76923076923077,
     "cap_hits_per_1000_calls": 6.322444678609062,
     "t_first_iso": "2026-10-22T09:37:02-07:00",
     "t_last_iso": "2026-10-22T14:30:50-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "276958_0",
      "276958_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4507,
     "completion_sum": 6558619,
     "over_8k": 182,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684435.107,
     "t_last": 1792700543.016,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1455.2072331928111,
     "over_8k_per_1000_calls": 40.38162857776792,
     "cap_hits_per_1000_calls": 7.100066563124029,
     "t_first_iso": "2026-10-22T08:53:55-07:00",
     "t_last_iso": "2026-10-22T13:22:23-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "276959_0",
      "276959_1",
      "278455_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5025,
     "completion_sum": 7486253,
     "over_8k": 192,
     "cap_hits": 34,
     "length_finish": 34,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684457.533,
     "t_last": 1792707978.505,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 2.985074626865672,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1489.801592039801,
     "over_8k_per_1000_calls": 38.208955223880594,
     "cap_hits_per_1000_calls": 6.766169154228856,
     "t_first_iso": "2026-10-22T08:54:17-07:00",
     "t_last_iso": "2026-10-22T15:26:18-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "276960_0",
      "276960_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4148,
     "completion_sum": 6212123,
     "over_8k": 173,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684419.162,
     "t_last": 1792701130.622,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1497.6188524590164,
     "over_8k_per_1000_calls": 41.70684667309547,
     "cap_hits_per_1000_calls": 7.955641272902604,
     "t_first_iso": "2026-10-22T08:53:39-07:00",
     "t_last_iso": "2026-10-22T13:32:10-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "276961_0",
      "276961_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4733,
     "completion_sum": 6400487,
     "over_8k": 161,
     "cap_hits": 31,
     "length_finish": 31,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792684442.226,
     "t_last": 1792701270.471,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1352.3107965349673,
     "over_8k_per_1000_calls": 34.016480033805195,
     "cap_hits_per_1000_calls": 6.549757025142616,
     "t_first_iso": "2026-10-22T08:54:02-07:00",
     "t_last_iso": "2026-10-22T13:34:30-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "276970_0",
      "276970_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4309,
     "completion_sum": 6057884,
     "over_8k": 123,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792687059.194,
     "t_last": 1792703990.884,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1405.8677187282433,
     "over_8k_per_1000_calls": 28.54490601067533,
     "cap_hits_per_1000_calls": 3.7131585054537015,
     "t_first_iso": "2026-10-22T09:37:39-07:00",
     "t_last_iso": "2026-10-22T14:19:50-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "276971_0",
      "278326_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3975,
     "completion_sum": 5293186,
     "over_8k": 124,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792690545.313,
     "t_last": 1792703666.402,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1331.6191194968553,
     "over_8k_per_1000_calls": 31.19496855345912,
     "cap_hits_per_1000_calls": 5.031446540880503,
     "t_first_iso": "2026-10-22T10:35:45-07:00",
     "t_last_iso": "2026-10-22T14:14:26-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "276972_0",
      "276972_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5171,
     "completion_sum": 7530013,
     "over_8k": 197,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792690596.648,
     "t_last": 1792707692.53,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1456.2005414813382,
     "over_8k_per_1000_calls": 38.09707986849739,
     "cap_hits_per_1000_calls": 7.735447689035003,
     "t_first_iso": "2026-10-22T10:36:36-07:00",
     "t_last_iso": "2026-10-22T15:21:32-07:00"
    },
    {
     "arm": "fp8kv_s1",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "276973_0",
      "276973_1",
      "278823_0",
      "279137_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 4,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4744,
     "completion_sum": 8453297,
     "over_8k": 278,
     "cap_hits": 106,
     "length_finish": 106,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792690661.107,
     "t_last": 1792721420.93,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 6.451612903225806,
     "completion_per_call": 1781.8922849915682,
     "over_8k_per_1000_calls": 58.600337268128165,
     "cap_hits_per_1000_calls": 22.344013490725125,
     "t_first_iso": "2026-10-22T10:37:41-07:00",
     "t_last_iso": "2026-10-22T19:10:20-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "293514_0",
      "293514_1",
      "299999_0",
      "307827_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 71,
     "timeouts": 10,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5380,
     "completion_sum": 11128681,
     "over_8k": 410,
     "cap_hits": 103,
     "length_finish": 103,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793028135.819,
     "t_last": 1793192014.809,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 14.084507042253522,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 2068.528066914498,
     "over_8k_per_1000_calls": 76.2081784386617,
     "cap_hits_per_1000_calls": 19.144981412639407,
     "t_first_iso": "2026-10-26T08:22:15-07:00",
     "t_last_iso": "2026-10-28T05:53:34-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "293551_0",
      "293551_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5012,
     "completion_sum": 8906415,
     "over_8k": 254,
     "cap_hits": 65,
     "length_finish": 65,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793058382.297,
     "t_last": 1793079075.963,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1777.018156424581,
     "over_8k_per_1000_calls": 50.67837190742219,
     "cap_hits_per_1000_calls": 12.968874700718276,
     "t_first_iso": "2026-10-26T16:46:22-07:00",
     "t_last_iso": "2026-10-26T22:31:15-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "293702_0",
      "293702_1",
      "305371_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 75,
     "timeouts": 5,
     "zero_other": 8,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4974,
     "completion_sum": 10298586,
     "over_8k": 372,
     "cap_hits": 104,
     "length_finish": 104,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113927.855,
     "t_last": 1793187190.177,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.666666666666667,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 2070.483715319662,
     "over_8k_per_1000_calls": 74.78890229191798,
     "cap_hits_per_1000_calls": 20.908725371934057,
     "t_first_iso": "2026-10-27T08:12:07-07:00",
     "t_last_iso": "2026-10-28T04:33:10-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "293637_0",
      "293637_1",
      "303010_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 5,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5420,
     "completion_sum": 8999385,
     "over_8k": 263,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793087520.781,
     "t_last": 1793162628.766,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.144927536231885,
     "first_timeouts_per_100_instances": 7.936507936507937,
     "completion_per_call": 1660.4031365313654,
     "over_8k_per_1000_calls": 48.5239852398524,
     "cap_hits_per_1000_calls": 11.07011070110701,
     "t_first_iso": "2026-10-27T00:52:00-07:00",
     "t_last_iso": "2026-10-27T21:43:48-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "293544_0",
      "293544_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4967,
     "completion_sum": 7826644,
     "over_8k": 184,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793035485.066,
     "t_last": 1793061736.936,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1575.7286088182002,
     "over_8k_per_1000_calls": 37.04449365814375,
     "cap_hits_per_1000_calls": 5.234548016911616,
     "t_first_iso": "2026-10-26T10:24:45-07:00",
     "t_last_iso": "2026-10-26T17:42:16-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "293756_0",
      "293756_1",
      "306604_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4196,
     "completion_sum": 6893865,
     "over_8k": 203,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119036.19,
     "t_last": 1793187683.429,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1642.9611534795042,
     "over_8k_per_1000_calls": 48.37940896091516,
     "cap_hits_per_1000_calls": 8.817921830314585,
     "t_first_iso": "2026-10-27T09:37:16-07:00",
     "t_last_iso": "2026-10-28T04:41:23-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "293677_0",
      "293677_1",
      "305200_0",
      "308795_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 6054,
     "completion_sum": 9171903,
     "over_8k": 210,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793112851.799,
     "t_last": 1793192559.004,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1515.0153617443013,
     "over_8k_per_1000_calls": 34.68780971258672,
     "cap_hits_per_1000_calls": 5.450941526263628,
     "t_first_iso": "2026-10-27T07:54:11-07:00",
     "t_last_iso": "2026-10-28T06:02:39-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "293615_0",
      "293615_1",
      "302936_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 5,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5037,
     "completion_sum": 9234113,
     "over_8k": 327,
     "cap_hits": 78,
     "length_finish": 78,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793083945.334,
     "t_last": 1793158905.692,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.352941176470588,
     "first_timeouts_per_100_instances": 8.064516129032258,
     "completion_per_call": 1833.2565018860432,
     "over_8k_per_1000_calls": 64.91959499702203,
     "cap_hits_per_1000_calls": 15.485407980941037,
     "t_first_iso": "2026-10-26T23:52:25-07:00",
     "t_last_iso": "2026-10-27T20:41:45-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "293493_0",
      "293493_1",
      "298060_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4714,
     "completion_sum": 6899132,
     "over_8k": 190,
     "cap_hits": 47,
     "length_finish": 47,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987874.455,
     "t_last": 1793157360.266,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1463.5409418752652,
     "over_8k_per_1000_calls": 40.30547305897327,
     "cap_hits_per_1000_calls": 9.970301230377599,
     "t_first_iso": "2026-10-25T21:11:14-07:00",
     "t_last_iso": "2026-10-27T20:16:00-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "293531_0",
      "293531_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4929,
     "completion_sum": 6760588,
     "over_8k": 153,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793031764.315,
     "t_last": 1793056544.649,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1371.5942381821872,
     "over_8k_per_1000_calls": 31.040779062690202,
     "cap_hits_per_1000_calls": 8.52099817407182,
     "t_first_iso": "2026-10-26T09:22:44-07:00",
     "t_last_iso": "2026-10-26T16:15:44-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "293589_0",
      "302012_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4569,
     "completion_sum": 6412764,
     "over_8k": 173,
     "cap_hits": 46,
     "length_finish": 46,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793079464.277,
     "t_last": 1793154016.906,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1403.537754432042,
     "over_8k_per_1000_calls": 37.86386517837601,
     "cap_hits_per_1000_calls": 10.067848544539286,
     "t_first_iso": "2026-10-26T22:37:44-07:00",
     "t_last_iso": "2026-10-27T19:20:16-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "293572_0",
      "293572_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5078,
     "completion_sum": 6038605,
     "over_8k": 122,
     "cap_hits": 23,
     "length_finish": 23,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793069095.291,
     "t_last": 1793087091.572,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1189.1699487987396,
     "over_8k_per_1000_calls": 24.025206774320598,
     "cap_hits_per_1000_calls": 4.529342260732572,
     "t_first_iso": "2026-10-26T19:44:55-07:00",
     "t_last_iso": "2026-10-27T00:44:51-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "293579_0",
      "301851_0",
      "307894_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4669,
     "completion_sum": 6124240,
     "over_8k": 146,
     "cap_hits": 19,
     "length_finish": 19,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793077059.683,
     "t_last": 1793189786.671,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1311.6813022060398,
     "over_8k_per_1000_calls": 31.27007924609124,
     "cap_hits_per_1000_calls": 4.069393874491325,
     "t_first_iso": "2026-10-26T21:57:39-07:00",
     "t_last_iso": "2026-10-28T05:16:26-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "293627_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4008,
     "completion_sum": 4776783,
     "over_8k": 95,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793086572.994,
     "t_last": 1793097061.027,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1191.812125748503,
     "over_8k_per_1000_calls": 23.702594810379242,
     "cap_hits_per_1000_calls": 3.7425149700598803,
     "t_first_iso": "2026-10-27T00:36:12-07:00",
     "t_last_iso": "2026-10-27T03:31:01-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "293488_0",
      "293488_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5334,
     "completion_sum": 5829271,
     "over_8k": 103,
     "cap_hits": 16,
     "length_finish": 16,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987679.166,
     "t_last": 1793027145.162,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1092.8517060367453,
     "over_8k_per_1000_calls": 19.310086239220098,
     "cap_hits_per_1000_calls": 2.9996250468691414,
     "t_first_iso": "2026-10-25T21:07:59-07:00",
     "t_last_iso": "2026-10-26T08:05:45-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "293760_0",
      "293760_1",
      "306606_0",
      "310288_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5132,
     "completion_sum": 9206518,
     "over_8k": 329,
     "cap_hits": 141,
     "length_finish": 141,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793119948.666,
     "t_last": 1793198497.992,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.955223880597014,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1793.9434918160562,
     "over_8k_per_1000_calls": 64.10756040530008,
     "cap_hits_per_1000_calls": 27.474668745128604,
     "t_first_iso": "2026-10-27T09:52:28-07:00",
     "t_last_iso": "2026-10-28T07:41:37-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "293663_0",
      "293663_1",
      "304971_0",
      "308423_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4740,
     "completion_sum": 8224325,
     "over_8k": 249,
     "cap_hits": 90,
     "length_finish": 90,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793110749.601,
     "t_last": 1793195326.342,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1735.0896624472573,
     "over_8k_per_1000_calls": 52.53164556962025,
     "cap_hits_per_1000_calls": 18.9873417721519,
     "t_first_iso": "2026-10-27T07:19:09-07:00",
     "t_last_iso": "2026-10-28T06:48:46-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "293649_0",
      "293649_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4917,
     "completion_sum": 7354916,
     "over_8k": 173,
     "cap_hits": 42,
     "length_finish": 42,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793107824.266,
     "t_last": 1793126979.276,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1495.8137075452512,
     "over_8k_per_1000_calls": 35.184055318283505,
     "cap_hits_per_1000_calls": 8.541793776693105,
     "t_first_iso": "2026-10-27T06:30:24-07:00",
     "t_last_iso": "2026-10-27T11:49:39-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "293691_0",
      "293691_1",
      "305113_0",
      "308573_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 6,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5330,
     "completion_sum": 10582652,
     "over_8k": 377,
     "cap_hits": 116,
     "length_finish": 116,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793113297.609,
     "t_last": 1793195799.534,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 8.823529411764707,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1985.4881801125703,
     "over_8k_per_1000_calls": 70.73170731707317,
     "cap_hits_per_1000_calls": 21.76360225140713,
     "t_first_iso": "2026-10-27T08:01:37-07:00",
     "t_last_iso": "2026-10-28T06:56:39-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "293783_0",
      "293783_1",
      "309137_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 5,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5523,
     "completion_sum": 9062581,
     "over_8k": 267,
     "cap_hits": 60,
     "length_finish": 60,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793150213.636,
     "t_last": 1793194749.465,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.246376811594203,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1640.8801376063734,
     "over_8k_per_1000_calls": 48.34329168929929,
     "cap_hits_per_1000_calls": 10.863661053775122,
     "t_first_iso": "2026-10-27T18:16:53-07:00",
     "t_last_iso": "2026-10-28T06:39:09-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "293455_0",
      "293455_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4837,
     "completion_sum": 7744354,
     "over_8k": 211,
     "cap_hits": 31,
     "length_finish": 31,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792968887.868,
     "t_last": 1792989441.769,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1601.0655364895597,
     "over_8k_per_1000_calls": 43.62207980152987,
     "cap_hits_per_1000_calls": 6.408931155675005,
     "t_first_iso": "2026-10-25T15:54:47-07:00",
     "t_last_iso": "2026-10-25T21:37:21-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "293471_0",
      "293471_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4289,
     "completion_sum": 6872671,
     "over_8k": 197,
     "cap_hits": 40,
     "length_finish": 40,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792987149.155,
     "t_last": 1793024948.761,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1602.3947307064584,
     "over_8k_per_1000_calls": 45.93145255304267,
     "cap_hits_per_1000_calls": 9.326183259501049,
     "t_first_iso": "2026-10-25T20:59:09-07:00",
     "t_last_iso": "2026-10-26T07:29:08-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "293737_0",
      "293737_1",
      "306108_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5621,
     "completion_sum": 8184070,
     "over_8k": 184,
     "cap_hits": 39,
     "length_finish": 39,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793116646.043,
     "t_last": 1793187138.482,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1455.9811421455256,
     "over_8k_per_1000_calls": 32.73438889877246,
     "cap_hits_per_1000_calls": 6.938267212239815,
     "t_first_iso": "2026-10-27T08:57:26-07:00",
     "t_last_iso": "2026-10-28T04:32:18-07:00"
    },
    {
     "arm": "blasst_t50_s1_sxs",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "293725_0",
      "293725_1",
      "305790_0",
      "310183_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4595,
     "completion_sum": 8638714,
     "over_8k": 280,
     "cap_hits": 75,
     "length_finish": 75,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1793115310.153,
     "t_last": 1793194606.277,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1880.0248095756256,
     "over_8k_per_1000_calls": 60.93579978237214,
     "cap_hits_per_1000_calls": 16.32208922742111,
     "t_first_iso": "2026-10-27T08:35:10-07:00",
     "t_last_iso": "2026-10-28T06:36:46-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "276558_0",
      "276558_1",
      "278133_0",
      "278589_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 72,
     "timeouts": 8,
     "zero_other": 3,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 5275,
     "completion_sum": 9786080,
     "over_8k": 328,
     "cap_hits": 107,
     "length_finish": 107,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792678745.153,
     "t_last": 1792711899.304,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 11.11111111111111,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1855.1810426540285,
     "over_8k_per_1000_calls": 62.18009478672986,
     "cap_hits_per_1000_calls": 20.28436018957346,
     "t_first_iso": "2026-10-22T07:19:05-07:00",
     "t_last_iso": "2026-10-22T16:31:39-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "276693_0",
      "276693_1",
      "278203_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 69,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5030,
     "completion_sum": 8664833,
     "over_8k": 249,
     "cap_hits": 48,
     "length_finish": 48,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680276.408,
     "t_last": 1792704583.857,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.246376811594203,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1722.630815109344,
     "over_8k_per_1000_calls": 49.50298210735586,
     "cap_hits_per_1000_calls": 9.542743538767395,
     "t_first_iso": "2026-10-22T07:44:36-07:00",
     "t_last_iso": "2026-10-22T14:29:43-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "276694_0",
      "276694_1",
      "278254_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4479,
     "completion_sum": 8423366,
     "over_8k": 278,
     "cap_hits": 53,
     "length_finish": 53,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680598.421,
     "t_last": 1792707142.422,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.076923076923077,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1880.6354096896628,
     "over_8k_per_1000_calls": 62.06742576467962,
     "cap_hits_per_1000_calls": 11.832998437151149,
     "t_first_iso": "2026-10-22T07:49:58-07:00",
     "t_last_iso": "2026-10-22T15:12:22-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "276695_0",
      "276695_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4626,
     "completion_sum": 6597357,
     "over_8k": 161,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680599.44,
     "t_last": 1792697184.383,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1426.1472114137484,
     "over_8k_per_1000_calls": 34.80328577604842,
     "cap_hits_per_1000_calls": 3.6748811067877214,
     "t_first_iso": "2026-10-22T07:49:59-07:00",
     "t_last_iso": "2026-10-22T12:26:24-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "276716_0",
      "276716_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4527,
     "completion_sum": 6438382,
     "over_8k": 137,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681367.262,
     "t_last": 1792701839.397,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1422.2182460790812,
     "over_8k_per_1000_calls": 30.262867240998453,
     "cap_hits_per_1000_calls": 2.8716589352772255,
     "t_first_iso": "2026-10-22T08:02:47-07:00",
     "t_last_iso": "2026-10-22T13:43:59-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "276717_0",
      "276717_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3778,
     "completion_sum": 5237250,
     "over_8k": 119,
     "cap_hits": 27,
     "length_finish": 27,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681396.513,
     "t_last": 1792698198.439,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1386.249338274219,
     "over_8k_per_1000_calls": 31.49814716781366,
     "cap_hits_per_1000_calls": 7.146638433033351,
     "t_first_iso": "2026-10-22T08:03:16-07:00",
     "t_last_iso": "2026-10-22T12:43:18-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "276718_0",
      "276718_1",
      "278322_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5594,
     "completion_sum": 8213959,
     "over_8k": 210,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681463.377,
     "t_last": 1792704790.04,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.545454545454546,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1468.3516267429388,
     "over_8k_per_1000_calls": 37.54022166607079,
     "cap_hits_per_1000_calls": 6.256703611011798,
     "t_first_iso": "2026-10-22T08:04:23-07:00",
     "t_last_iso": "2026-10-22T14:33:10-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "276719_0",
      "276719_1",
      "278360_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4486,
     "completion_sum": 8207351,
     "over_8k": 273,
     "cap_hits": 96,
     "length_finish": 96,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681464.552,
     "t_last": 1792705376.8,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.970149253731344,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1829.5477039679001,
     "over_8k_per_1000_calls": 60.855996433348196,
     "cap_hits_per_1000_calls": 21.39991083370486,
     "t_first_iso": "2026-10-22T08:04:24-07:00",
     "t_last_iso": "2026-10-22T14:42:56-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "276696_0",
      "276696_1",
      "278176_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4523,
     "completion_sum": 5411442,
     "over_8k": 128,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680642.457,
     "t_last": 1792704564.234,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1196.4275923059915,
     "over_8k_per_1000_calls": 28.299801017024098,
     "cap_hits_per_1000_calls": 8.401503426929029,
     "t_first_iso": "2026-10-22T07:50:42-07:00",
     "t_last_iso": "2026-10-22T14:29:24-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "276697_0",
      "276697_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4519,
     "completion_sum": 4796800,
     "over_8k": 85,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680669.831,
     "t_last": 1792696503.394,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1061.4737773843772,
     "over_8k_per_1000_calls": 18.80947112192963,
     "cap_hits_per_1000_calls": 4.868333702146493,
     "t_first_iso": "2026-10-22T07:51:09-07:00",
     "t_last_iso": "2026-10-22T12:15:03-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "276698_0",
      "276698_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4684,
     "completion_sum": 5681616,
     "over_8k": 144,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680693.258,
     "t_last": 1792698225.2,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1212.9837745516652,
     "over_8k_per_1000_calls": 30.742954739538856,
     "cap_hits_per_1000_calls": 6.4047822374039285,
     "t_first_iso": "2026-10-22T07:51:33-07:00",
     "t_last_iso": "2026-10-22T12:43:45-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "276699_0",
      "276699_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5141,
     "completion_sum": 5671742,
     "over_8k": 122,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680631.876,
     "t_last": 1792697915.679,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1103.2371134020618,
     "over_8k_per_1000_calls": 23.730791674771446,
     "cap_hits_per_1000_calls": 4.279323088893212,
     "t_first_iso": "2026-10-22T07:50:31-07:00",
     "t_last_iso": "2026-10-22T12:38:35-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "276720_0",
      "276720_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4980,
     "completion_sum": 5141951,
     "over_8k": 74,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681466.369,
     "t_last": 1792698990.714,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1032.520281124498,
     "over_8k_per_1000_calls": 14.859437751004016,
     "cap_hits_per_1000_calls": 2.4096385542168677,
     "t_first_iso": "2026-10-22T08:04:26-07:00",
     "t_last_iso": "2026-10-22T12:56:30-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "276721_0",
      "277874_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3923,
     "completion_sum": 4231740,
     "over_8k": 88,
     "cap_hits": 8,
     "length_finish": 8,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681460.53,
     "t_last": 1792698703.313,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1078.6999745093042,
     "over_8k_per_1000_calls": 22.431812388478207,
     "cap_hits_per_1000_calls": 2.039255671679837,
     "t_first_iso": "2026-10-22T08:04:20-07:00",
     "t_last_iso": "2026-10-22T12:51:43-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "276722_0",
      "276722_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4937,
     "completion_sum": 4379498,
     "over_8k": 70,
     "cap_hits": 13,
     "length_finish": 13,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681462.885,
     "t_last": 1792697562.299,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 887.0767672675714,
     "over_8k_per_1000_calls": 14.178651002633178,
     "cap_hits_per_1000_calls": 2.633178043346162,
     "t_first_iso": "2026-10-22T08:04:22-07:00",
     "t_last_iso": "2026-10-22T12:32:42-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "276723_0",
      "276723_1",
      "278323_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4696,
     "completion_sum": 6300296,
     "over_8k": 163,
     "cap_hits": 47,
     "length_finish": 47,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681642.651,
     "t_last": 1792706094.091,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1341.6303236797273,
     "over_8k_per_1000_calls": 34.71039182282794,
     "cap_hits_per_1000_calls": 10.008517887563885,
     "t_first_iso": "2026-10-22T08:07:22-07:00",
     "t_last_iso": "2026-10-22T14:54:54-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "276700_0",
      "276700_1",
      "278175_0",
      "278590_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 68,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 2,
     "counted_timeouts": 2,
     "calls": 4981,
     "completion_sum": 8749184,
     "over_8k": 260,
     "cap_hits": 77,
     "length_finish": 77,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680646.327,
     "t_last": 1792711816.3,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.294117647058824,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1756.5115438666935,
     "over_8k_per_1000_calls": 52.198353744228065,
     "cap_hits_per_1000_calls": 15.458743224252158,
     "t_first_iso": "2026-10-22T07:50:46-07:00",
     "t_last_iso": "2026-10-22T16:30:16-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "276701_0",
      "276701_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 65,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4797,
     "completion_sum": 6932965,
     "over_8k": 171,
     "cap_hits": 35,
     "length_finish": 35,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680634.166,
     "t_last": 1792698386.335,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5384615384615385,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1445.271002710027,
     "over_8k_per_1000_calls": 35.647279549718576,
     "cap_hits_per_1000_calls": 7.29622680842193,
     "t_first_iso": "2026-10-22T07:50:34-07:00",
     "t_last_iso": "2026-10-22T12:46:26-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "276702_0",
      "276702_1",
      "278483_0",
      "278839_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 72,
     "timeouts": 9,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 7,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5314,
     "completion_sum": 10843600,
     "over_8k": 405,
     "cap_hits": 101,
     "length_finish": 101,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680656.5,
     "t_last": 1792713982.355,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 12.5,
     "first_timeouts_per_100_instances": 11.11111111111111,
     "completion_per_call": 2040.572073767407,
     "over_8k_per_1000_calls": 76.21377493413624,
     "cap_hits_per_1000_calls": 19.00639819345126,
     "t_first_iso": "2026-10-22T07:50:56-07:00",
     "t_last_iso": "2026-10-22T17:06:22-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "276703_0",
      "276703_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4637,
     "completion_sum": 6402270,
     "over_8k": 141,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680706.174,
     "t_last": 1792698431.521,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1380.6922579253828,
     "over_8k_per_1000_calls": 30.407591114945006,
     "cap_hits_per_1000_calls": 3.6661634677593273,
     "t_first_iso": "2026-10-22T07:51:46-07:00",
     "t_last_iso": "2026-10-22T12:47:11-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "276724_0",
      "276724_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4868,
     "completion_sum": 6692464,
     "over_8k": 155,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681669.153,
     "t_last": 1792700671.284,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1374.787181594084,
     "over_8k_per_1000_calls": 31.840591618734592,
     "cap_hits_per_1000_calls": 3.4921939194741167,
     "t_first_iso": "2026-10-22T08:07:49-07:00",
     "t_last_iso": "2026-10-22T13:24:31-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "276725_0",
      "276725_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3752,
     "completion_sum": 4474194,
     "over_8k": 100,
     "cap_hits": 17,
     "length_finish": 17,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681736.268,
     "t_last": 1792698584.227,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1192.482409381663,
     "over_8k_per_1000_calls": 26.652452025586353,
     "cap_hits_per_1000_calls": 4.53091684434968,
     "t_first_iso": "2026-10-22T08:08:56-07:00",
     "t_last_iso": "2026-10-22T12:49:44-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "276726_0",
      "276726_1",
      "278324_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5455,
     "completion_sum": 7395012,
     "over_8k": 172,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681914.236,
     "t_last": 1792706208.732,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1355.6392300641612,
     "over_8k_per_1000_calls": 31.53070577451879,
     "cap_hits_per_1000_calls": 5.499541704857928,
     "t_first_iso": "2026-10-22T08:11:54-07:00",
     "t_last_iso": "2026-10-22T14:56:48-07:00"
    },
    {
     "arm": "blasst_t50_s1",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "276727_0",
      "276727_1",
      "278361_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 65,
     "timeouts": 3,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4658,
     "completion_sum": 7324016,
     "over_8k": 206,
     "cap_hits": 54,
     "length_finish": 54,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682425.987,
     "t_last": 1792706115.202,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 4.615384615384615,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1572.352082438815,
     "over_8k_per_1000_calls": 44.22498926577931,
     "cap_hits_per_1000_calls": 11.592958351223702,
     "t_first_iso": "2026-10-22T08:20:25-07:00",
     "t_last_iso": "2026-10-22T14:55:15-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard0of8",
     "attempt_tags": [
      "276704_0",
      "276704_1",
      "278204_0",
      "278618_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4656,
     "completion_sum": 8029733,
     "over_8k": 272,
     "cap_hits": 103,
     "length_finish": 103,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680702.169,
     "t_last": 1792712488.511,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1724.5990120274914,
     "over_8k_per_1000_calls": 58.419243986254294,
     "cap_hits_per_1000_calls": 22.121993127147768,
     "t_first_iso": "2026-10-22T07:51:42-07:00",
     "t_last_iso": "2026-10-22T16:41:28-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard1of8",
     "attempt_tags": [
      "276705_0",
      "276705_1",
      "278205_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 67,
     "timeouts": 5,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 3,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5138,
     "completion_sum": 8513777,
     "over_8k": 218,
     "cap_hits": 37,
     "length_finish": 37,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680686.026,
     "t_last": 1792706483.005,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 7.462686567164179,
     "first_timeouts_per_100_instances": 4.761904761904762,
     "completion_per_call": 1657.0216037368625,
     "over_8k_per_1000_calls": 42.428960685091475,
     "cap_hits_per_1000_calls": 7.2012456208641495,
     "t_first_iso": "2026-10-22T07:51:26-07:00",
     "t_last_iso": "2026-10-22T15:01:23-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard2of8",
     "attempt_tags": [
      "276706_0",
      "276706_1",
      "278206_0",
      "278619_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4689,
     "completion_sum": 8431190,
     "over_8k": 277,
     "cap_hits": 70,
     "length_finish": 70,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680763.719,
     "t_last": 1792712578.353,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1798.0784815525699,
     "over_8k_per_1000_calls": 59.07442951588825,
     "cap_hits_per_1000_calls": 14.92855619535082,
     "t_first_iso": "2026-10-22T07:52:43-07:00",
     "t_last_iso": "2026-10-22T16:42:58-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard3of8",
     "attempt_tags": [
      "276707_0",
      "276707_1",
      "278207_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4874,
     "completion_sum": 7150714,
     "over_8k": 200,
     "cap_hits": 46,
     "length_finish": 46,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680736.471,
     "t_last": 1792706473.069,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1467.114074681986,
     "over_8k_per_1000_calls": 41.03405826836274,
     "cap_hits_per_1000_calls": 9.43783340172343,
     "t_first_iso": "2026-10-22T07:52:16-07:00",
     "t_last_iso": "2026-10-22T15:01:13-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard4of8",
     "attempt_tags": [
      "276728_0",
      "276728_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4387,
     "completion_sum": 5956122,
     "over_8k": 103,
     "cap_hits": 4,
     "length_finish": 4,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682566.42,
     "t_last": 1792699108.937,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1357.6754046045132,
     "over_8k_per_1000_calls": 23.478459083656258,
     "cap_hits_per_1000_calls": 0.9117848187827673,
     "t_first_iso": "2026-10-22T08:22:46-07:00",
     "t_last_iso": "2026-10-22T12:58:28-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard5of8",
     "attempt_tags": [
      "276729_0",
      "276729_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3980,
     "completion_sum": 5811298,
     "over_8k": 149,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682646.128,
     "t_last": 1792701285.583,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1460.1251256281407,
     "over_8k_per_1000_calls": 37.437185929648244,
     "cap_hits_per_1000_calls": 8.040201005025125,
     "t_first_iso": "2026-10-22T08:24:06-07:00",
     "t_last_iso": "2026-10-22T13:34:45-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard6of8",
     "attempt_tags": [
      "276730_0",
      "276730_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5221,
     "completion_sum": 6822921,
     "over_8k": 141,
     "cap_hits": 20,
     "length_finish": 20,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682658.695,
     "t_last": 1792700853.779,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1306.8226393411223,
     "over_8k_per_1000_calls": 27.00632062823214,
     "cap_hits_per_1000_calls": 3.830683777054204,
     "t_first_iso": "2026-10-22T08:24:18-07:00",
     "t_last_iso": "2026-10-22T13:27:33-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 42,
     "unit": "shard7of8",
     "attempt_tags": [
      "276731_0",
      "276731_1",
      "278362_0",
      "278769_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4194,
     "completion_sum": 6787704,
     "over_8k": 207,
     "cap_hits": 78,
     "length_finish": 78,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682648.176,
     "t_last": 1792711336.505,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 1618.4320457796853,
     "over_8k_per_1000_calls": 49.35622317596567,
     "cap_hits_per_1000_calls": 18.59799713876967,
     "t_first_iso": "2026-10-22T08:24:08-07:00",
     "t_last_iso": "2026-10-22T16:22:16-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard0of8",
     "attempt_tags": [
      "276708_0",
      "276708_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4442,
     "completion_sum": 5542282,
     "over_8k": 123,
     "cap_hits": 32,
     "length_finish": 32,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680861.356,
     "t_last": 1792699822.572,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1247.6996848266547,
     "over_8k_per_1000_calls": 27.69022962629446,
     "cap_hits_per_1000_calls": 7.203962179198559,
     "t_first_iso": "2026-10-22T07:54:21-07:00",
     "t_last_iso": "2026-10-22T13:10:22-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard1of8",
     "attempt_tags": [
      "276709_0",
      "276709_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5229,
     "completion_sum": 5379112,
     "over_8k": 81,
     "cap_hits": 12,
     "length_finish": 12,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680832.439,
     "t_last": 1792699106.026,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1028.7075922738572,
     "over_8k_per_1000_calls": 15.49053356282272,
     "cap_hits_per_1000_calls": 2.2948938611589216,
     "t_first_iso": "2026-10-22T07:53:52-07:00",
     "t_last_iso": "2026-10-22T12:58:26-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard2of8",
     "attempt_tags": [
      "276710_0",
      "276710_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4531,
     "completion_sum": 5500720,
     "over_8k": 140,
     "cap_hits": 30,
     "length_finish": 30,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792680818.764,
     "t_last": 1792699304.045,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1214.018980357537,
     "over_8k_per_1000_calls": 30.898256455528582,
     "cap_hits_per_1000_calls": 6.621054954756125,
     "t_first_iso": "2026-10-22T07:53:38-07:00",
     "t_last_iso": "2026-10-22T13:01:44-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard3of8",
     "attempt_tags": [
      "276711_0",
      "276711_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 66,
     "timeouts": 1,
     "zero_other": 1,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4956,
     "completion_sum": 4813628,
     "over_8k": 91,
     "cap_hits": 22,
     "length_finish": 22,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681312.958,
     "t_last": 1792697526.059,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5151515151515151,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 971.272800645682,
     "over_8k_per_1000_calls": 18.361581920903955,
     "cap_hits_per_1000_calls": 4.4390637610976595,
     "t_first_iso": "2026-10-22T08:01:52-07:00",
     "t_last_iso": "2026-10-22T12:32:06-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard4of8",
     "attempt_tags": [
      "276732_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4365,
     "completion_sum": 4238604,
     "over_8k": 64,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682639.933,
     "t_last": 1792694710.711,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 971.0432989690721,
     "over_8k_per_1000_calls": 14.662084765177548,
     "cap_hits_per_1000_calls": 2.0618556701030926,
     "t_first_iso": "2026-10-22T08:23:59-07:00",
     "t_last_iso": "2026-10-22T11:45:10-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard5of8",
     "attempt_tags": [
      "276733_0"
     ],
     "units": 1,
     "attempts": 1,
     "episodes": 62,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 3841,
     "completion_sum": 4078469,
     "over_8k": 73,
     "cap_hits": 9,
     "length_finish": 9,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682714.527,
     "t_last": 1792694170.353,
     "attempts_listed": 1,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1061.8247852121842,
     "over_8k_per_1000_calls": 19.00546732621713,
     "cap_hits_per_1000_calls": 2.343139807341838,
     "t_first_iso": "2026-10-22T08:25:14-07:00",
     "t_last_iso": "2026-10-22T11:36:10-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard6of8",
     "attempt_tags": [
      "276734_0",
      "277875_0"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4894,
     "completion_sum": 4337878,
     "over_8k": 64,
     "cap_hits": 15,
     "length_finish": 15,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682696.149,
     "t_last": 1792699971.791,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5873015873015872,
     "first_timeouts_per_100_instances": 1.6129032258064515,
     "completion_per_call": 886.3665713118104,
     "over_8k_per_1000_calls": 13.077237433592154,
     "cap_hits_per_1000_calls": 3.064977523498161,
     "t_first_iso": "2026-10-22T08:24:56-07:00",
     "t_last_iso": "2026-10-22T13:12:51-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 43,
     "unit": "shard7of8",
     "attempt_tags": [
      "276735_0",
      "276735_1",
      "278363_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 64,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4681,
     "completion_sum": 5912963,
     "over_8k": 146,
     "cap_hits": 24,
     "length_finish": 24,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682772.87,
     "t_last": 1792705687.86,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.125,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1263.1837214270456,
     "over_8k_per_1000_calls": 31.189916684469132,
     "cap_hits_per_1000_calls": 5.127109591967528,
     "t_first_iso": "2026-10-22T08:26:12-07:00",
     "t_last_iso": "2026-10-22T14:48:07-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard0of8",
     "attempt_tags": [
      "276712_0",
      "276712_1",
      "278253_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 70,
     "timeouts": 7,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 4,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5001,
     "completion_sum": 8486316,
     "over_8k": 268,
     "cap_hits": 90,
     "length_finish": 89,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681334.437,
     "t_last": 1792705342.33,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 10.0,
     "first_timeouts_per_100_instances": 6.349206349206349,
     "completion_per_call": 1696.9238152369526,
     "over_8k_per_1000_calls": 53.58928214357129,
     "cap_hits_per_1000_calls": 17.99640071985603,
     "t_first_iso": "2026-10-22T08:02:14-07:00",
     "t_last_iso": "2026-10-22T14:42:22-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard1of8",
     "attempt_tags": [
      "276713_0",
      "276713_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 64,
     "timeouts": 1,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 1,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4618,
     "completion_sum": 6508252,
     "over_8k": 162,
     "cap_hits": 33,
     "length_finish": 33,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681328.697,
     "t_last": 1792698777.596,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 1.5625,
     "first_timeouts_per_100_instances": 1.5873015873015872,
     "completion_per_call": 1409.3226504980512,
     "over_8k_per_1000_calls": 35.080121264616714,
     "cap_hits_per_1000_calls": 7.14595062797748,
     "t_first_iso": "2026-10-22T08:02:08-07:00",
     "t_last_iso": "2026-10-22T12:52:57-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard2of8",
     "attempt_tags": [
      "276714_0",
      "276714_1",
      "278255_0",
      "278701_0"
     ],
     "units": 1,
     "attempts": 4,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 4828,
     "completion_sum": 9280065,
     "over_8k": 338,
     "cap_hits": 102,
     "length_finish": 102,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681333.674,
     "t_last": 1792713436.49,
     "attempts_listed": 4,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1922.134424192212,
     "over_8k_per_1000_calls": 70.00828500414251,
     "cap_hits_per_1000_calls": 21.12676056338028,
     "t_first_iso": "2026-10-22T08:02:13-07:00",
     "t_last_iso": "2026-10-22T16:57:16-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard3of8",
     "attempt_tags": [
      "276715_0",
      "276715_1",
      "278256_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 68,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 63,
     "first_timeouts": 2,
     "counted_zero": 1,
     "counted_timeouts": 1,
     "calls": 5153,
     "completion_sum": 7494360,
     "over_8k": 220,
     "cap_hits": 38,
     "length_finish": 38,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792681392.532,
     "t_last": 1792707358.194,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 5.882352941176471,
     "first_timeouts_per_100_instances": 3.1746031746031744,
     "completion_per_call": 1454.368329128663,
     "over_8k_per_1000_calls": 42.69357655734524,
     "cap_hits_per_1000_calls": 7.374345041723268,
     "t_first_iso": "2026-10-22T08:03:12-07:00",
     "t_last_iso": "2026-10-22T15:15:58-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard4of8",
     "attempt_tags": [
      "276736_0",
      "276736_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4296,
     "completion_sum": 5185265,
     "over_8k": 81,
     "cap_hits": 5,
     "length_finish": 5,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682934.567,
     "t_last": 1792698592.109,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1206.998370577281,
     "over_8k_per_1000_calls": 18.854748603351954,
     "cap_hits_per_1000_calls": 1.1638733705772812,
     "t_first_iso": "2026-10-22T08:28:54-07:00",
     "t_last_iso": "2026-10-22T12:49:52-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard5of8",
     "attempt_tags": [
      "276737_0",
      "276737_1"
     ],
     "units": 1,
     "attempts": 2,
     "episodes": 63,
     "timeouts": 0,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 0,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4169,
     "completion_sum": 5421896,
     "over_8k": 120,
     "cap_hits": 26,
     "length_finish": 26,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682942.247,
     "t_last": 1792699478.35,
     "attempts_listed": 2,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 0.0,
     "first_timeouts_per_100_instances": 0.0,
     "completion_per_call": 1300.5267450227873,
     "over_8k_per_1000_calls": 28.78388102662509,
     "cap_hits_per_1000_calls": 6.236507555768769,
     "t_first_iso": "2026-10-22T08:29:02-07:00",
     "t_last_iso": "2026-10-22T13:04:38-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard6of8",
     "attempt_tags": [
      "276738_0",
      "276738_1",
      "278418_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 4,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 3,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 5497,
     "completion_sum": 7846446,
     "over_8k": 213,
     "cap_hits": 51,
     "length_finish": 51,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792682911.533,
     "t_last": 1792708613.793,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 6.0606060606060606,
     "first_timeouts_per_100_instances": 4.838709677419355,
     "completion_per_call": 1427.4051300709477,
     "over_8k_per_1000_calls": 38.74840822266691,
     "cap_hits_per_1000_calls": 9.277787884300528,
     "t_first_iso": "2026-10-22T08:28:31-07:00",
     "t_last_iso": "2026-10-22T15:36:53-07:00"
    },
    {
     "arm": "dense_s1d",
     "seed": 44,
     "unit": "shard7of8",
     "attempt_tags": [
      "276739_0",
      "276739_1",
      "278420_0"
     ],
     "units": 1,
     "attempts": 3,
     "episodes": 66,
     "timeouts": 2,
     "zero_other": 0,
     "instances": 62,
     "first_timeouts": 2,
     "counted_zero": 0,
     "counted_timeouts": 0,
     "calls": 4471,
     "completion_sum": 7021643,
     "over_8k": 212,
     "cap_hits": 72,
     "length_finish": 72,
     "non200": 0,
     "excluded_episodes": 0,
     "excluded_calls": 0,
     "setasides": [],
     "setasides_without_snapshot": [],
     "bad_lines": 0,
     "t_first": 1792683141.317,
     "t_last": 1792705165.726,
     "attempts_listed": 3,
     "attempts_without_snapshot": 0,
     "attempt_tags_without_snapshot": [],
     "units_first_attempt_without_snapshot": 0,
     "timeouts_per_100_episodes": 3.0303030303030303,
     "first_timeouts_per_100_instances": 3.225806451612903,
     "completion_per_call": 1570.4860210243794,
     "over_8k_per_1000_calls": 47.41668530530083,
     "cap_hits_per_1000_calls": 16.103779915007827,
     "t_first_iso": "2026-10-22T08:32:21-07:00",
     "t_last_iso": "2026-10-22T14:39:25-07:00"
    }
   ],
   "files": 5474,
   "files_digest": "6d8ed57dbc54afafb027689d6c01c3fb",
   "bad_lines": {},
   "definitions": {
    "episode": "an inference_log row of an attempt snapshot attempts/<alloc>/ (one snapshot = one attempt: the next attempt truncates the live files); with live=True also a live row whose (problem_idx, repeat, latency_ms, tokens, completion_tokens) is in no snapshot (the running attempt)",
    "timeout": "an episode whose wall (latency_ms) >= 5400 s and completion_tokens == 0 (the run_timeout rows; = the diagnosis's strict definition)",
    "zero_other": "an episode with completion_tokens == 0 and a wall below run_timeout (a crash or another zero-token row)",
    "first_timeouts / instances": "per instance its first episode (the earliest attempt): a timeout or not",
    "counted_zero / counted_timeouts": "per instance its LAST episode (the row the analysis counts): zero completion tokens / a timeout",
    "calls": "model_traffic rows with status 200 and a completion token count (deduplicated by model_traffic_request_id)",
    "completion_per_call": "the mean completion tokens of those calls",
    "over_8k / cap_hits": "calls with completion > 8192 / with completion >= 16384 or finish 'length' (per 1,000 calls; the addendum v2's monitor.quantities)",
    "reference": "the published arm over the same units ((seed, shard) units the rerun arm has data for -- an episode or a call left after the set-asides, so a unit whose only attempt is void brings in no reference unit: the addendum v2's 'each against the published arm on the same units'), pooled and per seed",
    "set-asides": "the addendum v2's analysis_additions.set_asides and its executor-death rule: a void manifest's allocation (its alloc = the snapshot dir) counts nowhere (its whole attempt left out); an executor-death manifest leaves out, in its allocation, the instances it lists (set aside from the row files), its ledger instances and any row-fixed capture inside its window (the void episodes the row fix already re-ran: the rule's ledger restoration) -- their episodes and their traffic; a replica-OOM manifest its listed instances only (the registered OOM rule has no ledger restoration: a disclosed asymmetry)",
    "attempts_listed / attempts_without_snapshot": "the shard's .jqs_attempts tags (one per started attempt) / those with no non-empty attempts/<tag>/ inference_log and model_traffic snapshot (with live=True the last listed one is covered by the live files); a unit whose FIRST listed attempt has none counts in units_first_attempt_without_snapshot: its first episodes are a later attempt's (footnoted in the table)"
   },
   "setasides_applied": [
    "286984_0",
    "286984_1",
    "293540_1",
    "293545_0",
    "293577_1",
    "293623_0",
    "293641_0",
    "293716_0",
    "310103_0"
   ],
   "counted_zero_vs_item_table": {
    "dense_sxs": {
     "score_free_counted_zero": 4,
     "item_table_zero_token_rows": 4
    },
    "jqs_f_dense_sxs": {
     "score_free_counted_zero": 4,
     "item_table_zero_token_rows": 4
    },
    "jqs_f_r40_sxs": {
     "score_free_counted_zero": 6,
     "item_table_zero_token_rows": 6
    },
    "jqs_f_r60_sxs": {
     "score_free_counted_zero": 3,
     "item_table_zero_token_rows": 3
    },
    "jqs_f_u32_sxs": {
     "score_free_counted_zero": 1,
     "item_table_zero_token_rows": 1
    },
    "jqs_f_u64_sxs": {
     "score_free_counted_zero": 1,
     "item_table_zero_token_rows": 1
    },
    "jqs_f_u128_sxs": {
     "score_free_counted_zero": 1,
     "item_table_zero_token_rows": 1
    },
    "quest_b2048_s1_sxs": {
     "score_free_counted_zero": 83,
     "item_table_zero_token_rows": 83
    },
    "sparq_c8_s1_sxs": {
     "score_free_counted_zero": 5,
     "item_table_zero_token_rows": 5
    },
    "loki_k25_d25_s1_sxs": {
     "score_free_counted_zero": 3,
     "item_table_zero_token_rows": 3
    },
    "tri_b4096_s1_sxs": {
     "score_free_counted_zero": 9,
     "item_table_zero_token_rows": 9
    },
    "fp8kv_s1_sxs": {
     "score_free_counted_zero": 8,
     "item_table_zero_token_rows": 8
    },
    "blasst_t50_s1_sxs": {
     "score_free_counted_zero": 7,
     "item_table_zero_token_rows": 7
    }
   },
   "counted_zero_equal": true,
   "monitor_final": {
    "status": "not available",
    "why": "not verified before the START marker"
   },
   "note": "descriptive and score-free (keys, counts, times and token counts only); no test, no verdict (sxs addendum v2); 'reference' = the arm's published run (S1 window; FP8 KV / BLASST 10-22) over the same units and, for bf16, also dense_s1d (the bl2 window control)"
  },
  "runtime_s": 321.48039412498474
 },
 "setasides": {
  "manifests_all": 9,
  "used": [
   {
    "kind": "death",
    "alloc": "293623_0",
    "name": "jqs_swe_q38_jqs_f_r40_sxs_s43_sh5of8",
    "arm": "jqs_f_r40_sxs",
    "seed": 43,
    "shard": "shard5of8",
    "window": [
     "2026-10-27T02:58:23-07:00",
     "2026-10-27T03:00:19"
    ],
    "slack_s": 300.0,
    "whole_attempt": false,
    "n_instances": 0,
    "md5": "5c0701371cd41eb72377075c52d9b3b6",
    "reason": "executor death (node nvl72d059-T15; first 2026-10-27T02:58:23-07:00; addendum bl2_sxs_addendum_v2 executor_death_rule)",
    "schema": "jqs_bl2_sxs_death_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/death_setaside/293623_0.json",
    "instances": [],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "ledger_instances": [],
    "rowfixed_in_window": [],
    "left_out_of_score_free_table": []
   },
   {
    "kind": "death",
    "alloc": "293641_0",
    "name": "jqs_swe_q38_jqs_f_r60_sxs_s42_sh3of8",
    "arm": "jqs_f_r60_sxs",
    "seed": 42,
    "shard": "shard3of8",
    "window": [
     "2026-10-27T03:27:17-07:00",
     "2026-10-27T03:28:37"
    ],
    "slack_s": 300.0,
    "whole_attempt": false,
    "n_instances": 2,
    "md5": "be27c0b00a1fd886e292c78289b4dd6e",
    "reason": "executor death (node nvl72d017-T04; first 2026-10-27T03:27:17-07:00; addendum bl2_sxs_addendum_v2 executor_death_rule)",
    "schema": "jqs_bl2_sxs_death_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/death_setaside/293641_0.json",
    "instances": [
     "236_0",
     "243_0"
    ],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "ledger_instances": [],
    "rowfixed_in_window": [],
    "left_out_of_score_free_table": [
     "236_0",
     "243_0"
    ]
   },
   {
    "kind": "oom",
    "alloc": "293540_1",
    "name": "jqs_swe_q38_quest_b2048_s1_sxs_s42_sh8of16",
    "arm": "quest_b2048_s1_sxs",
    "seed": 42,
    "shard": "shard8of16",
    "window": [
     "2026-10-26T17:17:58",
     "2026-10-26T17:18:13"
    ],
    "slack_s": 0.0,
    "whole_attempt": false,
    "n_instances": 0,
    "md5": "9c2e28ef42c0b7166646bc741ad53e6f",
    "reason": null,
    "schema": "jqs_bl2_ctl2_oom_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293540_1.json",
    "instances": [],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": []
   },
   {
    "kind": "oom",
    "alloc": "293545_0",
    "name": "jqs_swe_q38_loki_k25_d25_s1_sxs_s42_sh4of8",
    "arm": "loki_k25_d25_s1_sxs",
    "seed": 42,
    "shard": "shard4of8",
    "window": [
     "2026-10-26T12:06:32",
     "2026-10-26T12:07:43"
    ],
    "slack_s": 0.0,
    "whole_attempt": false,
    "n_instances": 1,
    "md5": "8643f2f7470ca13d837056cf5af3db93",
    "reason": null,
    "schema": "jqs_bl2_ctl2_oom_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293545_0.json",
    "instances": [
     "270_0"
    ],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": [
     "270_0"
    ]
   },
   {
    "kind": "oom",
    "alloc": "293577_1",
    "name": "jqs_swe_q38_quest_b2048_s1_sxs_s43_sh8of16",
    "arm": "quest_b2048_s1_sxs",
    "seed": 43,
    "shard": "shard8of16",
    "window": [
     "2026-10-27T00:48:05",
     "2026-10-27T00:49:06"
    ],
    "slack_s": 0.0,
    "whole_attempt": false,
    "n_instances": 0,
    "md5": "ec51ce1e00d62fec46a765ec80ff6fbd",
    "reason": null,
    "schema": "jqs_bl2_ctl2_oom_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293577_1.json",
    "instances": [],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": []
   },
   {
    "kind": "oom",
    "alloc": "293716_0",
    "name": "jqs_swe_q38_jqs_f_u128_sxs_s44_sh7of8",
    "arm": "jqs_f_u128_sxs",
    "seed": 44,
    "shard": "shard7of8",
    "window": [
     "2026-10-27T10:51:11",
     "2026-10-27T10:52:19"
    ],
    "slack_s": 0.0,
    "whole_attempt": false,
    "n_instances": 2,
    "md5": "d818103fbb7ffba7975fce3273586d45",
    "reason": null,
    "schema": "jqs_bl2_ctl2_oom_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293716_0.json",
    "instances": [
     "472_0",
     "477_0"
    ],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": [
     "472_0",
     "477_0"
    ]
   },
   {
    "kind": "oom",
    "alloc": "310103_0",
    "name": "jqs_swe_q38_loki_k25_d25_s1_sxs_s44_sh7of8",
    "arm": "loki_k25_d25_s1_sxs",
    "seed": 44,
    "shard": "shard7of8",
    "window": [
     "2026-10-28T07:08:42",
     "2026-10-28T07:09:19"
    ],
    "slack_s": 0.0,
    "whole_attempt": false,
    "n_instances": 0,
    "md5": "0b54ec62c20df5cc4281331e0b6eeb50",
    "reason": null,
    "schema": "jqs_bl2_ctl2_oom_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/310103_0.json",
    "instances": [],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": []
   },
   {
    "kind": "void",
    "alloc": "286984_0",
    "name": "jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8",
    "arm": "jqs_f_dense_sxs",
    "seed": 44,
    "shard": "shard4of8",
    "window": [
     "2026-10-24T10:12:59",
     "2026-10-24T13:58:13"
    ],
    "slack_s": 300.0,
    "whole_attempt": true,
    "n_instances": 30,
    "md5": "714493d42e7c938c5e2b94b9005ebe27",
    "reason": "test gate FAIL (['TEST GATE jqs FAIL (job 286984 jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8, 2 attempt dir(s))'])",
    "schema": "jqs_bl2_sxs_void_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/void_setaside/286984_0.json",
    "instances": [
     "252_0",
     "253_0",
     "254_0",
     "257_0",
     "258_0",
     "260_0",
     "261_0",
     "262_0",
     "264_0",
     "265_0",
     "266_0",
     "267_0",
     "268_0",
     "269_0",
     "270_0",
     "272_0",
     "274_0",
     "275_0",
     "276_0",
     "277_0",
     "278_0",
     "280_0",
     "282_0",
     "283_0",
     "284_0",
     "285_0",
     "286_0",
     "289_0",
     "291_0",
     "292_0"
    ],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": "the whole attempt"
   },
   {
    "kind": "void",
    "alloc": "286984_1",
    "name": "jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8",
    "arm": "jqs_f_dense_sxs",
    "seed": 44,
    "shard": "shard4of8",
    "window": [
     "2026-10-24T14:07:19",
     "2026-10-24T16:42:52"
    ],
    "slack_s": 300.0,
    "whole_attempt": true,
    "n_instances": 32,
    "md5": "895bb933ee3f06557bd4e8433319cb9b",
    "reason": "test gate FAIL (['TEST GATE jqs FAIL (job 286984 jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8, 2 attempt dir(s))'])",
    "schema": "jqs_bl2_sxs_void_setaside_v1",
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/void_setaside/286984_1.json",
    "instances": [
     "255_0",
     "256_0",
     "259_0",
     "263_0",
     "271_0",
     "273_0",
     "279_0",
     "281_0",
     "287_0",
     "288_0",
     "290_0",
     "293_0",
     "294_0",
     "295_0",
     "296_0",
     "297_0",
     "298_0",
     "299_0",
     "300_0",
     "301_0",
     "302_0",
     "303_0",
     "304_0",
     "305_0",
     "306_0",
     "307_0",
     "308_0",
     "309_0",
     "310_0",
     "311_0",
     "312_0",
     "313_0"
    ],
    "live_captures_inside_window": [],
    "not_recaptured": [],
    "left_out_of_score_free_table": "the whole attempt"
   }
  ],
  "skipped": [],
  "problems": [],
  "clean_start": [
   {
    "manifest": "log/sparse/dev/bigmodels/bl2/sxs/retest/prep_1.json",
    "md5": "39f43fc30fbea2036e6af35612fb4361",
    "schema": "jqs_bl2_sxs_retest_prep_v1",
    "unit": "jqs_swe_q38_jqs_f_dense_sxs_s44_sh4of8"
   }
  ],
  "inside_window": [],
  "not_recaptured": [],
  "complete_line_counts": {},
  "stray_manifest_like_files": [],
  "void_allocs": [
   "286984_0",
   "286984_1"
  ],
  "void_jobs": [
   "286984"
  ],
  "rule": "the set-aside rows are out of the row files (AUDIT OK); no live capture inside a set-aside window [start, end + slack] (jqs_ctl2_audit.swe_select); the score-free table drops, from the attempts/<alloc>/ snapshots, a void allocation's whole attempt, an executor-death allocation's listed and ledger-restored (row-fixed) instances, a replica-OOM allocation's listed instances -- their episodes and calls"
 },
 "input_pins": {
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/prereg/bl2_tbp_addendum_v1.json": "62d73bec4b6b0d7e690dd62b8984598f",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/prereg/bl2_tbp_addendum_v2.json": "5455d76c1222a317382fc1e53a5f1730",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/death_setaside/293623_0.json": "5c0701371cd41eb72377075c52d9b3b6",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/death_setaside/293641_0.json": "be27c0b00a1fd886e292c78289b4dd6e",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293540_1.json": "9c2e28ef42c0b7166646bc741ad53e6f",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293545_0.json": "8643f2f7470ca13d837056cf5af3db93",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293577_1.json": "ec51ce1e00d62fec46a765ec80ff6fbd",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/293716_0.json": "d818103fbb7ffba7975fce3273586d45",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/oom_setaside/310103_0.json": "0b54ec62c20df5cc4281331e0b6eeb50",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/retest/prep_1.json": "39f43fc30fbea2036e6af35612fb4361",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/void_setaside/286984_0.json": "714493d42e7c938c5e2b94b9005ebe27",
  "/home/hcai/workspace/code/jet-qs/log/sparse/dev/bigmodels/bl2/sxs/void_setaside/286984_1.json": "895bb933ee3f06557bd4e8433319cb9b",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/bl2/jqs_ctl2_audit.py": "0bc8d630a57d8feeea693bb2dce939eb",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/bl2/jqs_ctl2_gate.py": "c7e42031e9b519993379a3a1164bb1bf",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/bl2/jqs_sxs_arms.py": "53824d8be5c31c3bc5ff5fa00c34440a",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/jqs_paired_agentic.py": "5fd95f3d0d4c5012deb1f0c14a1e68e7",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/jqs_paired_baselines.py": "d9cd97a3a80130edfd14842ce7c1507d",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/jqs_paired_baselines_h2h.py": "4e975a006d6d21f24c25ec43a9a50cc1",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/jqs_paired_stats.py": "ba041438ff83d640e639a6650537c8a6",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/jqs_swe_report.py": "b2d12c1ef103aeb8f308fa6884f54e4b",
  "/home/hcai/workspace/code/jet-qs/scripts/sparse/jqs_tb_report.py": "2d708656c1038007c3b2a9b0b30fd80a",
  "log/sparse/dev/bigmodels/bl2/ctl2/route_i_v1.json": "34ac3bdd21633be60c937c73db3a6f87",
  "log/sparse/dev/bigmodels/bl2/prereg/bl2_sxs_addendum_v2.json": "41a63efcd129833d50099f464ab4cf49",
  "log/sparse/dev/bigmodels/bl2/prereg/bl2_sxs_prereg_v1.json": "d4171c51270d2dcf36a9e27faeb6a3b9",
  "log/sparse/dev/bigmodels/bl2/prereg/bl2_tbp_addendum_v1.json": "62d73bec4b6b0d7e690dd62b8984598f",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/md/table1.md": "d4ee83ffd492e3111bbe2b8e2a01c6c1",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_agentic.json": "ba5976756220c5242f21e859f653599a",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines.json": "1ded660f60eb0e62be283230fcf20064",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2.json": "1b7ec7410db857f613ff3caa388d09f3",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_bl2_h2h.json": "5258d19c0bd01ddbb341475ae2058f16",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/paired_baselines_h2h.json": "a5ace5cf8d9b77731c7822221fcfcd34",
  "log/sparse/dev/bigmodels/bl2/stage_tbp/out/P/stats/verdicts_noruler.json": "c753ae5ba8b1e30924086bcd2edfa464",
  "log/sparse/dev/bigmodels/bl2/tbp/tb_rescore_P_v1.json": "31565bf537e54a7324cbc71f75ecda31",
  "log/sparse/dev/bigmodels/bl2/tbp/tb_rescore_P_v2.json": "d7db3b62a35b81050b4313ca13d55c28",
  "log/sparse/dev/stats/paired.json": "faa683e20930ba1f548dbe5fd543244f",
  "log/sparse/dev/stats/paired_agentic.json": "6f85b396e117c08063876003c01545fe",
  "log/sparse/dev/stats/paired_baselines.json": "43f941cb31291a43abf467ac32990a9e",
  "log/sparse/dev/stats/paired_baselines_bl2.json": "36c8c67e65e750babb97a5f8f94dace6",
  "log/sparse/dev/stats/paired_baselines_bl2_h2h.json": "0fbfda98ffb396326706eee16312b604",
  "log/sparse/dev/stats/paired_baselines_h2h.json": "792153c7bf7626f2826957459a10b6a4",
  "log/sparse/dev/stats/verdicts_noruler.json": "e41a15a47099cab0e07915792d268715",
  "scripts/sparse/bl2/jqs_bl2_h12.py": "8366055e25c0b963e96b7a55edb9afdd",
  "scripts/sparse/bl2/jqs_ctl2_gate.py": "c7e42031e9b519993379a3a1164bb1bf",
  "scripts/sparse/bl2/jqs_paired_bl2.py": "6ad7111f21dc91612b30f126ff1c31a9",
  "scripts/sparse/jqs_paired_baselines_h2h.py": "4e975a006d6d21f24c25ec43a9a50cc1",
  "scripts/sparse/jqs_table1_v2.py": "24f0020fcfe840c61ed9f294fac6989f",
  "scripts/sparse/jqs_verdicts_noruler.py": "c76e2839118520ee3a2510a8b4c7e159",
  "scripts/sparse/jqs_verdicts_noruler_v2.py": "5bd48afd1ec7694595e92ed89a9ea9fa"
 },
 "state_md5_at_read": "05215432c1cf717895523009243559b8",
 "state_size_at_read": 129883,
 "degraded": [],
 "runtime": {
  "host": "nsc-kef-slurm-1-login-03",
  "python": "3.12.14",
  "numpy": "2.5.3"
 },
 "scope": "Full rerun archived with original 500-task denominator; no subset applied; no main result superseded.",
 "earlier_baseline_swe_backup": {
  "status": "ARCHIVAL ONLY; distinct historical windows; no main promotion",
  "cells": [
   {
    "model": "qwen3.8-27b",
    "arm": "fp8kv_s1",
    "bench": "swe",
    "scores": [
     85.4,
     90.0,
     86.0
    ],
    "mean": 87.13333333333334,
    "sd": 2.500666577801472,
    "sd_manual": 2.5006665778014714,
    "mean_1dp": "87.1",
    "sd_1dp": "2.5",
    "mean_1dp_half_up": "87.1",
    "sd_1dp_half_up": "2.5",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 85.4,
      "resolved": 427,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 427,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 2,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 12,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 427,
      "run_summary_n_passed": 427,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 2,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 52,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 52
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 56
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 51,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 51
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 52,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 52
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 55
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 90.0,
      "resolved": 450,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 450,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 4,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 450,
      "run_summary_n_passed": 450,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 54,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 54
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 56
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 58,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 58
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 58,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 58
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 57,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 57
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 57,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 57
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 54,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 54
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 86.0,
      "resolved": 430,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 430,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 1,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 7,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 430,
      "run_summary_n_passed": 430,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 59,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 59
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 55
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 54,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 54
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 51,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 51
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 50,
        "zero_token_rows": 1,
        "summary_n_problems": 62,
        "summary_n_passed": 50
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "qwen3.8-27b|fp8kv_s1|swe",
    "table_row": [
     "Qwen3.8-27B",
     "TRT-LLM FP8 KV (FP8 attention, unit scale)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_fp8kv_s1",
    "b12_json_fields": {
     "fragment": "fp8kv_s1",
     "fragment_found": [
      "fp8kv_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "fp8kv_s1",
     "decode_only": false,
     "n_items": 1495,
     "mean_a": 87.4247491638796
    },
    "staged_text": "87.1 ± 2.5 (w)",
    "expected_mark": "(w)",
    "staged_mean": "87.1",
    "staged_sd": "2.5",
    "staged_mark": "(w)",
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.2914158305462564
   },
   {
    "model": "qwen3.8-27b",
    "arm": "blasst_t50_s1",
    "bench": "swe",
    "scores": [
     85.6,
     89.4,
     85.8
    ],
    "mean": 86.93333333333334,
    "sd": 2.138535324312731,
    "sd_manual": 2.138535324312731,
    "mean_1dp": "86.9",
    "sd_1dp": "2.1",
    "mean_1dp_half_up": "86.9",
    "sd_1dp_half_up": "2.1",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 85.6,
      "resolved": 428,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 428,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 2,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 12,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 428,
      "run_summary_n_passed": 428,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 54,
        "zero_token_rows": 2,
        "summary_n_problems": 63,
        "summary_n_passed": 54
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 54,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 54
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 55
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 51,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 51
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 89.4,
      "resolved": 447,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 447,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 7,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 447,
      "run_summary_n_passed": 447,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 59,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 59
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 58,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 58
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 57,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 57
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 85.8,
      "resolved": 429,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 429,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 2,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 13,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 429,
      "run_summary_n_passed": 429,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 2,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 52,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 52
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 54,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 54
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 52,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 52
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 54,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 54
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "qwen3.8-27b|blasst_t50_s1|swe",
    "table_row": [
     "Qwen3.8-27B",
     "BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_blasst_t50_s1",
    "b12_json_fields": {
     "fragment": "blasst_t50_s1",
     "fragment_found": [
      "blasst_t50_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "blasst_t50_s1",
     "decode_only": false,
     "n_items": 1495,
     "mean_a": 87.22408026755853
    },
    "staged_text": "86.9 ± 2.1 (w)",
    "expected_mark": "(w)",
    "staged_mean": "86.9",
    "staged_sd": "2.1",
    "staged_mark": "(w)",
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.29074693422519715
   },
   {
    "model": "qwen3.6-35b-a3b",
    "arm": "fp8kv_s1",
    "bench": "swe",
    "scores": [
     69.0,
     68.0,
     69.4
    ],
    "mean": 68.8,
    "sd": 0.7211102550928002,
    "sd_manual": 0.7211102550928002,
    "mean_1dp": "68.8",
    "sd_1dp": "0.7",
    "mean_1dp_half_up": "68.8",
    "sd_1dp_half_up": "0.7",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 69.0,
      "resolved": 345,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 345,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 345,
      "run_summary_n_passed": 345,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 42
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 48,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 48
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 43,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 43
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 41,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 41
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 46,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 46
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 40,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 40
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 43,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 43
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 42
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 68.0,
      "resolved": 340,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 340,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 340,
      "run_summary_n_passed": 340,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 44,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 44
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 46,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 46
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 39,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 39
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 45
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 44,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 44
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 45
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 40,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 40
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 37,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 37
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 69.4,
      "resolved": 347,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 347,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 347,
      "run_summary_n_passed": 347,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 44,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 44
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 50,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 50
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 39,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 39
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 46,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 46
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 45
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 42
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 41,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 41
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 40,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 40
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "qwen3.6-35b-a3b|fp8kv_s1|swe",
    "table_row": [
     "Qwen3.6-35B-A3B",
     "TRT-LLM FP8 KV (FP8 attention, unit scale)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_fp8kv_s1",
    "b12_json_fields": {
     "fragment": "fp8kv_s1",
     "fragment_found": [
      "fp8kv_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "fp8kv_s1",
     "decode_only": false,
     "n_items": 1500,
     "mean_a": 68.8
    },
    "staged_text": "68.8 ± 0.7",
    "expected_mark": null,
    "staged_mean": "68.8",
    "staged_sd": "0.7",
    "staged_mark": null,
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.0
   },
   {
    "model": "qwen3.6-35b-a3b",
    "arm": "blasst_t50_s1",
    "bench": "swe",
    "scores": [
     69.8,
     69.0,
     71.2
    ],
    "mean": 70.0,
    "sd": 1.1135528725660062,
    "sd_manual": 1.1135528725660062,
    "mean_1dp": "70.0",
    "sd_1dp": "1.1",
    "mean_1dp_half_up": "70.0",
    "sd_1dp_half_up": "1.1",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 69.8,
      "resolved": 349,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 349,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 349,
      "run_summary_n_passed": 349,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 42
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 47,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 47
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 40,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 40
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 48,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 48
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 45
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 45
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 43,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 43
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 39,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 39
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 69.0,
      "resolved": 345,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 345,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 345,
      "run_summary_n_passed": 345,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 42
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 47,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 47
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 42
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 44,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 44
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 44,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 44
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 42,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 42
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 45
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 39,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 39
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 71.2,
      "resolved": 356,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 356,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 356,
      "run_summary_n_passed": 356,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 45
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 47,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 47
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 45,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 45
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 48,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 48
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 46,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 46
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 44,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 44
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 41,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 41
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 40,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 40
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "qwen3.6-35b-a3b|blasst_t50_s1|swe",
    "table_row": [
     "Qwen3.6-35B-A3B",
     "BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_blasst_t50_s1",
    "b12_json_fields": {
     "fragment": "blasst_t50_s1",
     "fragment_found": [
      "blasst_t50_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "blasst_t50_s1",
     "decode_only": false,
     "n_items": 1500,
     "mean_a": 70.0
    },
    "staged_text": "70.0 ± 1.1",
    "expected_mark": null,
    "staged_mean": "70.0",
    "staged_sd": "1.1",
    "staged_mark": null,
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.0
   },
   {
    "model": "nemotron3-nano",
    "arm": "fp8kv_s1",
    "bench": "swe",
    "scores": [
     22.6,
     23.8,
     22.6
    ],
    "mean": 23.0,
    "sd": 0.6928203230275505,
    "sd_manual": 0.6928203230275505,
    "mean_1dp": "23.0",
    "sd_1dp": "0.7",
    "mean_1dp_half_up": "23.0",
    "sd_1dp_half_up": "0.7",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 22.6,
      "resolved": 113,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 113,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 113,
      "run_summary_n_passed": 113,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 12,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 12
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 15,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 15
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 10,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 10
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 18,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 18
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 15,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 15
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 17,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 17
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 11,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 11
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 15,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 15
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 23.8,
      "resolved": 119,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 119,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 119,
      "run_summary_n_passed": 119,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 15,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 15
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 13,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 13
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 11,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 11
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 17,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 17
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 18,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 18
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 19,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 19
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 12,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 12
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 14
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 22.6,
      "resolved": 113,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 113,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 113,
      "run_summary_n_passed": 113,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 13,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 13
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 12,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 12
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 14
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 22,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 22
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 12,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 12
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 18,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 18
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 8,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 8
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 14
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "nemotron3-nano|fp8kv_s1|swe",
    "table_row": [
     "Nemotron 3 Nano",
     "TRT-LLM FP8 KV (FP8 attention, unit scale)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_fp8kv_s1",
    "b12_json_fields": {
     "fragment": "fp8kv_s1",
     "fragment_found": [
      "fp8kv_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "fp8kv_s1",
     "decode_only": false,
     "n_items": 1500,
     "mean_a": 23.0
    },
    "staged_text": "23.0 ± 0.7",
    "expected_mark": null,
    "staged_mean": "23.0",
    "staged_sd": "0.7",
    "staged_mark": null,
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.0
   },
   {
    "model": "nemotron3-nano",
    "arm": "blasst_t50_s1",
    "bench": "swe",
    "scores": [
     24.2,
     23.0,
     20.6
    ],
    "mean": 22.6,
    "sd": 1.8330302779823349,
    "sd_manual": 1.8330302779823349,
    "mean_1dp": "22.6",
    "sd_1dp": "1.8",
    "mean_1dp_half_up": "22.6",
    "sd_1dp_half_up": "1.8",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 24.2,
      "resolved": 121,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 121,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 121,
      "run_summary_n_passed": 121,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 17,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 17
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 11,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 11
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 12,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 12
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 18,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 18
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 16,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 16
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 20,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 20
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 14
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 13,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 13
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 23.0,
      "resolved": 115,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 115,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 115,
      "run_summary_n_passed": 115,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 13,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 13
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 13,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 13
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 17,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 17
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 16,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 16
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 18,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 18
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 17,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 17
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 6,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 6
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 15,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 15
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 20.6,
      "resolved": 103,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 103,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 2,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 103,
      "run_summary_n_passed": 103,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 14
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 11,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 11
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 9,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 9
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 14
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 18,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 18
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 14,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 14
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 8,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 8
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 15,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 15
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "nemotron3-nano|blasst_t50_s1|swe",
    "table_row": [
     "Nemotron 3 Nano",
     "BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_blasst_t50_s1",
    "b12_json_fields": {
     "fragment": "blasst_t50_s1",
     "fragment_found": [
      "blasst_t50_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "blasst_t50_s1",
     "decode_only": false,
     "n_items": 1500,
     "mean_a": 22.6
    },
    "staged_text": "22.6 ± 1.8",
    "expected_mark": null,
    "staged_mean": "22.6",
    "staged_sd": "1.8",
    "staged_mark": null,
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.0
   },
   {
    "model": "nemotron3.5-lightning",
    "arm": "fp8kv_s1",
    "bench": "swe",
    "scores": [
     51.8,
     50.2,
     48.6
    ],
    "mean": 50.2,
    "sd": 1.5999999999999979,
    "sd_manual": 1.5999999999999979,
    "mean_1dp": "50.2",
    "sd_1dp": "1.6",
    "mean_1dp_half_up": "50.2",
    "sd_1dp_half_up": "1.6",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 51.8,
      "resolved": 259,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 259,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 259,
      "run_summary_n_passed": 259,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 34,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 34
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 34,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 34
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 29,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 29
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 34,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 34
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 35
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 37,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 37
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 28
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 28
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 50.2,
      "resolved": 251,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 251,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 251,
      "run_summary_n_passed": 251,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 29,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 29
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 30,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 30
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 28
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 35
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 33,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 33
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 34,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 34
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 30,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 30
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 32,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 32
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 48.6,
      "resolved": 243,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 243,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 243,
      "run_summary_n_passed": 243,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 28
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 28
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 26,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 26
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 32,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 32
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 35
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 34,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 34
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 28
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 32,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 32
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "nemotron3.5-lightning|fp8kv_s1|swe",
    "table_row": [
     "Nemotron 3.5 Lightning",
     "TRT-LLM FP8 KV (FP8 attention, unit scale)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_fp8kv_s1",
    "b12_json_fields": {
     "fragment": "fp8kv_s1",
     "fragment_found": [
      "fp8kv_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "fp8kv_s1",
     "decode_only": false,
     "n_items": 1500,
     "mean_a": 50.2
    },
    "staged_text": "50.2 ± 1.6",
    "expected_mark": null,
    "staged_mean": "50.2",
    "staged_sd": "1.6",
    "staged_mark": null,
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.0
   },
   {
    "model": "nemotron3.5-lightning",
    "arm": "blasst_t50_s1",
    "bench": "swe",
    "scores": [
     51.6,
     51.0,
     49.2
    ],
    "mean": 50.6,
    "sd": 1.2489995996796786,
    "sd_manual": 1.2489995996796786,
    "mean_1dp": "50.6",
    "sd_1dp": "1.2",
    "mean_1dp_half_up": "50.6",
    "sd_1dp_half_up": "1.2",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 51.6,
      "resolved": 258,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 258,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 2,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 258,
      "run_summary_n_passed": 258,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 33,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 33
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 30,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 30
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 28
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 34,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 34
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 35
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 35
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 30,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 30
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 33,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 33
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 51.0,
      "resolved": 255,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 255,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 0,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 255,
      "run_summary_n_passed": 255,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 30,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 30
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 32,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 32
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 29,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 29
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 31,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 31
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 37,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 37
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 35
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 29,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 29
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 32,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 32
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 49.2,
      "resolved": 246,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 246,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 1,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 246,
      "run_summary_n_passed": 246,
      "run_summary_complete": true,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 28,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 28
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 27,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 27
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 25,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 25
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 35
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 39,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 39
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 35,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 35
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 26,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 26
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 31,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 31
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "nemotron3.5-lightning|blasst_t50_s1|swe",
    "table_row": [
     "Nemotron 3.5 Lightning",
     "BLASST (TRT-LLM skip-softmax, Qwen3-30B t50 factors)"
    ],
    "table_col": "SWE-bench Verified",
    "source_dir_arm": "method_blasst_t50_s1",
    "b12_json_fields": {
     "fragment": "blasst_t50_s1",
     "fragment_found": [
      "blasst_t50_s1"
     ],
     "mapped": false,
     "source_note": null,
     "row_arm": "blasst_t50_s1",
     "decode_only": false,
     "n_items": 1500,
     "mean_a": 50.6
    },
    "staged_text": "50.6 ± 1.2",
    "expected_mark": null,
    "staged_mean": "50.6",
    "staged_sd": "1.2",
    "staged_mark": null,
    "match_mean": true,
    "match_sd": true,
    "match_mark": true,
    "match": true,
    "b12_mean_a_minus_ours": 0.0
   }
  ],
  "new_dense_control": [
   {
    "model": "qwen3.8-27b",
    "arm": "dense_s1d",
    "bench": "swe",
    "scores": [
     85.0,
     91.4,
     86.2
    ],
    "mean": 87.53333333333333,
    "sd": 3.4019602192461558,
    "sd_manual": 3.4019602192461558,
    "mean_1dp": "87.5",
    "sd_1dp": "3.4",
    "mean_1dp_half_up": "87.5",
    "sd_1dp_half_up": "3.4",
    "borderline": false,
    "all_seeds_complete": true,
    "per_seed": {
     "42": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 85.0,
      "resolved": 425,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 425,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 4,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 13,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 425,
      "run_summary_n_passed": null,
      "run_summary_complete": null,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 51,
        "zero_token_rows": 1,
        "summary_n_problems": 63,
        "summary_n_passed": 51
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 1,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 51,
        "zero_token_rows": 1,
        "summary_n_problems": 63,
        "summary_n_passed": 51
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 1,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 50,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 50
       }
      ],
      "complete_and_consistent": true
     },
     "43": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 91.4,
      "resolved": 457,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 457,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 0,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 5,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 457,
      "run_summary_n_passed": null,
      "run_summary_complete": null,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 55,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 55
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 59,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 59
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 57,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 57
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 58,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 58
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 59,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 59
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 58,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 58
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 58,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 58
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       }
      ],
      "complete_and_consistent": true
     },
     "44": {
      "dir": "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44",
      "layout": {
       "layout": [
        8
       ],
       "ok": true
      },
      "score": 86.2,
      "resolved": 431,
      "instances_with_rows": 500,
      "resolved_if_any_passing_row": 431,
      "instances_with_multiple_rows": 0,
      "cross_shard_overlap": 0,
      "zero_token_last_rows": 2,
      "zero_token_rows_below_rerun_cap": 0,
      "zero_token_rows_passing": 0,
      "rowfix_backup_logs_ignored": 11,
      "summary_sum_n_problems": 500,
      "summary_sum_n_passed": 431,
      "run_summary_n_passed": null,
      "run_summary_complete": null,
      "parts": [
       {
        "part": "shard0of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 52,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 52
       },
       {
        "part": "shard1of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 63,
        "summary_n_passed": 53
       },
       {
        "part": "shard2of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 54,
        "zero_token_rows": 1,
        "summary_n_problems": 63,
        "summary_n_passed": 54
       },
       {
        "part": "shard3of8",
        "rows": 63,
        "bad_lines": 0,
        "distinct": 63,
        "passed_last_row": 54,
        "zero_token_rows": 1,
        "summary_n_problems": 63,
        "summary_n_passed": 54
       },
       {
        "part": "shard4of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 53,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 53
       },
       {
        "part": "shard5of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 52,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 52
       },
       {
        "part": "shard6of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 57,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 57
       },
       {
        "part": "shard7of8",
        "rows": 62,
        "bad_lines": 0,
        "distinct": 62,
        "passed_last_row": 56,
        "zero_token_rows": 0,
        "summary_n_problems": 62,
        "summary_n_passed": 56
       }
      ],
      "complete_and_consistent": true
     }
    },
    "id": "qwen3.8-27b|dense_s1d|swe",
    "ctl_gate_rate_a": 87.53333333333335,
    "ctl_gate_rate_a_minus_ours": 1.4210854715202004e-14,
    "swe_report_row": [
     "85.0 (425/500) / 91.4 (457/500) / 86.2 (431/500)",
     "87.5 +/- 3.4"
    ],
    "swe_report_counts": [
     425,
     457,
     431
    ],
    "swe_report_counts_match": true,
    "swe_report_mean_sd_match": true,
    "preview_md_pass_at_1_dense_s1d": [
     "48.4",
     "82.7",
     "87.5"
    ]
   }
  ],
  "saved_B12_swe_members": [
   {
    "model": "qwen3.8-27b",
    "bench": "swe",
    "a": "fp8kv_s1",
    "b": "dense_s1",
    "label": "FP8 KV vs bf16",
    "n_items": 1495,
    "n_clusters": 500,
    "n_diff_items": 196,
    "a_only": 132,
    "b_only": 64,
    "mean_a": 87.4247491638796,
    "mean_b": 82.876254180602,
    "rate_a": 87.13333333333333,
    "rate_b": 82.73333333333333,
    "delta": 4.548494983277592,
    "ci95": [
     2.6109660555521392,
     6.495468280140329
    ],
    "ci95_bootstrap": [
     2.608695652173913,
     6.537691794529686
    ],
    "se": 0.9906628188877626,
    "p": 9.999000099990002e-05,
    "mid_p": 0.0,
    "per_seed": {
     "42": 4.819277108433735,
     "43": 3.0,
     "44": 5.835010060362173
    },
    "p_het": 0.4236576342365763,
    "family": "B12",
    "arm": "fp8kv_s1",
    "base": "fp8kv_s1",
    "row_arm": "fp8kv_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.776266323762853,
    "decode_only": false,
    "fragment": "fp8kv_s1",
    "bf16_level": 82.73333333333333,
    "floor_ceiling": false,
    "p_exact": 4.449824846949097e-06,
    "exact_clusters": 106,
    "exact_unit": 100.0,
    "exact_mc_z": -0.21094654886910041,
    "q": 0.001999800019998,
    "verdict": "gain_detected",
    "verdict_text": "above, detected (p 0.0001, q 0.00200)",
    "flags": [],
    "q_exact": 0.00016848478321130229,
    "verdict_exact": "gain_detected",
    "q_per_arm": 0.001999800019998,
    "verdict_per_arm": "gain_detected",
    "fragment_found": [
     "fp8kv_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "qwen3.8-27b",
    "bench": "swe",
    "a": "blasst_t50_s1",
    "b": "dense_s1",
    "label": "BLASST t50 vs bf16",
    "n_items": 1495,
    "n_clusters": 500,
    "n_diff_items": 176,
    "a_only": 120,
    "b_only": 56,
    "mean_a": 87.22408026755853,
    "mean_b": 82.94314381270902,
    "rate_a": 86.93333333333334,
    "rate_b": 82.73333333333333,
    "delta": 4.280936454849498,
    "ci95": [
     2.3999999981247946,
     6.143790851488853
    ],
    "ci95_bootstrap": [
     2.4079865147640085,
     6.216577540106952
    ],
    "se": 0.9723370029684938,
    "p": 9.999000099990002e-05,
    "mid_p": 0.0,
    "per_seed": {
     "42": 5.020080321285141,
     "43": 2.4,
     "44": 5.4325955734406435
    },
    "p_het": 0.2715728427157284,
    "family": "B12",
    "arm": "blasst_t50_s1",
    "base": "blasst_t50_s1",
    "row_arm": "blasst_t50_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.675699450914308,
    "decode_only": false,
    "fragment": "blasst_t50_s1",
    "bf16_level": 82.73333333333333,
    "floor_ceiling": false,
    "p_exact": 8.424239160565114e-06,
    "exact_clusters": 104,
    "exact_unit": 100.0,
    "exact_mc_z": -0.2902466214957274,
    "q": 0.001999800019998,
    "verdict": "gain_detected",
    "verdict_text": "above, detected (p 0.0001, q 0.00200)",
    "flags": [],
    "q_exact": 0.00016848478321130229,
    "verdict_exact": "gain_detected",
    "q_per_arm": 0.001999800019998,
    "verdict_per_arm": "gain_detected",
    "fragment_found": [
     "blasst_t50_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "qwen3.6-35b-a3b",
    "bench": "swe",
    "a": "fp8kv_s1",
    "b": "dense_s1",
    "label": "FP8 KV vs bf16",
    "n_items": 1500,
    "n_clusters": 500,
    "n_diff_items": 165,
    "a_only": 85,
    "b_only": 80,
    "mean_a": 68.8,
    "mean_b": 68.46666666666667,
    "rate_a": 68.8,
    "rate_b": 68.46666666666665,
    "delta": 0.3333333333333333,
    "ci95": [
     -1.2820512837723983,
     1.9531250015801054
    ],
    "ci95_bootstrap": [
     -1.2666666666666666,
     2.0
    ],
    "se": 0.8316688125097548,
    "p": 0.7468253174682532,
    "mid_p": 0.6885,
    "per_seed": {
     "42": 0.8,
     "43": -2.0,
     "44": 2.2
    },
    "p_het": 0.12808719128087193,
    "family": "B12",
    "arm": "fp8kv_s1",
    "base": "fp8kv_s1",
    "row_arm": "fp8kv_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.312190971498939,
    "decode_only": false,
    "fragment": "fp8kv_s1",
    "bf16_level": 68.46666666666665,
    "floor_ceiling": false,
    "p_exact": 0.7489943843521204,
    "exact_clusters": 98,
    "exact_unit": 100.0,
    "exact_mc_z": -0.5060945936515767,
    "q": 0.9521547845215478,
    "verdict": "no_detected_loss",
    "verdict_text": "no detected loss (MDD80 2.31)",
    "flags": [],
    "q_exact": 0.9517288208007812,
    "verdict_exact": "no_detected_loss",
    "q_per_arm": 0.9521547845215478,
    "verdict_per_arm": "no_detected_loss",
    "fragment_found": [
     "fp8kv_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "qwen3.6-35b-a3b",
    "bench": "swe",
    "a": "blasst_t50_s1",
    "b": "dense_s1",
    "label": "BLASST t50 vs bf16",
    "n_items": 1500,
    "n_clusters": 500,
    "n_diff_items": 171,
    "a_only": 97,
    "b_only": 74,
    "mean_a": 70.0,
    "mean_b": 68.46666666666667,
    "rate_a": 70.0,
    "rate_b": 68.46666666666665,
    "delta": 1.5333333333333334,
    "ci95": [
     -1.7301928840340625e-09,
     3.142076504377961
    ],
    "ci95_bootstrap": [
     -0.06666666666666667,
     3.2
    ],
    "se": 0.8193570190048219,
    "p": 0.07139286071392861,
    "mid_p": 0.06055,
    "per_seed": {
     "42": 1.6,
     "43": -1.0,
     "44": 4.0
    },
    "p_het": 0.07839216078392161,
    "family": "B12",
    "arm": "blasst_t50_s1",
    "base": "blasst_t50_s1",
    "row_arm": "blasst_t50_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.2456522576761544,
    "decode_only": false,
    "fragment": "blasst_t50_s1",
    "bf16_level": 68.46666666666665,
    "floor_ceiling": false,
    "p_exact": 0.0748949671195405,
    "exact_clusters": 95,
    "exact_unit": 100.0,
    "exact_mc_z": -1.3657558943146557,
    "q": 0.47595240475952405,
    "verdict": "no_detected_loss",
    "verdict_text": "no detected loss (MDD80 2.25)",
    "flags": [],
    "q_exact": 0.4992997807969366,
    "verdict_exact": "no_detected_loss",
    "q_per_arm": 0.47595240475952405,
    "verdict_per_arm": "no_detected_loss",
    "fragment_found": [
     "blasst_t50_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "nemotron3-nano",
    "bench": "swe",
    "a": "fp8kv_s1",
    "b": "dense_s1",
    "label": "FP8 KV vs bf16",
    "n_items": 1500,
    "n_clusters": 500,
    "n_diff_items": 266,
    "a_only": 141,
    "b_only": 125,
    "mean_a": 23.0,
    "mean_b": 21.933333333333334,
    "rate_a": 23.0,
    "rate_b": 21.933333333333334,
    "delta": 1.0666666666666667,
    "ci95": [
     -1.066666668799463,
     3.2000000021327972
    ],
    "ci95_bootstrap": [
     -1.0666666666666667,
     3.2
    ],
    "se": 1.0862486768982749,
    "p": 0.36446355364463556,
    "mid_p": 0.3344,
    "per_seed": {
     "42": 0.8,
     "43": 0.0,
     "44": 2.4
    },
    "p_het": 0.6678332166783322,
    "family": "B12",
    "arm": "fp8kv_s1",
    "base": "fp8kv_s1",
    "row_arm": "fp8kv_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 3.0494004915871473,
    "decode_only": false,
    "fragment": "fp8kv_s1",
    "bf16_level": 21.933333333333334,
    "floor_ceiling": false,
    "p_exact": 0.360478248544273,
    "exact_clusters": 149,
    "exact_unit": 100.0,
    "exact_mc_z": 0.8167946305687809,
    "q": 0.8506735533343217,
    "verdict": "no_detected_loss",
    "verdict_text": "no detected loss (MDD80 3.05)",
    "flags": [],
    "q_exact": 0.8416846702838766,
    "verdict_exact": "no_detected_loss",
    "q_per_arm": 0.851187608511876,
    "verdict_per_arm": "no_detected_loss",
    "fragment_found": [
     "fp8kv_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "nemotron3-nano",
    "bench": "swe",
    "a": "blasst_t50_s1",
    "b": "dense_s1",
    "label": "BLASST t50 vs bf16",
    "n_items": 1500,
    "n_clusters": 500,
    "n_diff_items": 254,
    "a_only": 132,
    "b_only": 122,
    "mean_a": 22.6,
    "mean_b": 21.933333333333334,
    "rate_a": 22.600000000000005,
    "rate_b": 21.933333333333334,
    "delta": 0.6666666666666666,
    "ci95": [
     -1.4048531309686005,
     2.7559055138627038
    ],
    "ci95_bootstrap": [
     -1.4,
     2.7333333333333334
    ],
    "se": 1.0523618775227612,
    "p": 0.5661433856614339,
    "mid_p": 0.525,
    "per_seed": {
     "42": 2.4,
     "43": -0.8,
     "44": 0.4
    },
    "p_het": 0.48075192480751927,
    "family": "B12",
    "arm": "blasst_t50_s1",
    "base": "blasst_t50_s1",
    "row_arm": "blasst_t50_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.9737076822436155,
    "decode_only": false,
    "fragment": "blasst_t50_s1",
    "bf16_level": 21.933333333333334,
    "floor_ceiling": false,
    "p_exact": 0.5700587829056846,
    "exact_clusters": 145,
    "exact_unit": 100.0,
    "exact_mc_z": -0.7996451820002446,
    "q": 0.8506735533343217,
    "verdict": "no_detected_loss",
    "verdict_text": "no detected loss (MDD80 2.97)",
    "flags": [],
    "q_exact": 0.8416846702838766,
    "verdict_exact": "no_detected_loss",
    "q_per_arm": 0.770922907709229,
    "verdict_per_arm": "no_detected_loss",
    "fragment_found": [
     "blasst_t50_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "nemotron3.5-lightning",
    "bench": "swe",
    "a": "fp8kv_s1",
    "b": "dense_s1",
    "label": "FP8 KV vs bf16",
    "n_items": 1500,
    "n_clusters": 500,
    "n_diff_items": 239,
    "a_only": 133,
    "b_only": 106,
    "mean_a": 50.2,
    "mean_b": 48.4,
    "rate_a": 50.199999999999996,
    "rate_b": 48.400000000000006,
    "delta": 1.8,
    "ci95": [
     -0.2583979348050569,
     3.8095238115667645
    ],
    "ci95_bootstrap": [
     -0.2,
     3.8
    ],
    "se": 1.0096563926531288,
    "p": 0.09419058094190581,
    "mid_p": 0.0818,
    "per_seed": {
     "42": 3.6,
     "43": 1.6,
     "44": 0.2
    },
    "p_het": 0.42525747425257476,
    "family": "B12",
    "arm": "fp8kv_s1",
    "base": "fp8kv_s1",
    "row_arm": "fp8kv_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.9073568501693776,
    "decode_only": false,
    "fragment": "fp8kv_s1",
    "bf16_level": 48.400000000000006,
    "floor_ceiling": false,
    "p_exact": 0.08969518895033743,
    "exact_clusters": 133,
    "exact_unit": 100.0,
    "exact_mc_z": 1.5415204480068339,
    "q": 0.5382318910966046,
    "verdict": "no_detected_loss",
    "verdict_text": "no detected loss (MDD80 2.91)",
    "flags": [],
    "q_exact": 0.5125439368590711,
    "verdict_exact": "no_detected_loss",
    "q_per_arm": 0.44995500449955006,
    "verdict_per_arm": "no_detected_loss",
    "fragment_found": [
     "fp8kv_s1"
    ],
    "fragment_ok": true
   },
   {
    "model": "nemotron3.5-lightning",
    "bench": "swe",
    "a": "blasst_t50_s1",
    "b": "dense_s1",
    "label": "BLASST t50 vs bf16",
    "n_items": 1500,
    "n_clusters": 500,
    "n_diff_items": 233,
    "a_only": 133,
    "b_only": 100,
    "mean_a": 50.6,
    "mean_b": 48.4,
    "rate_a": 50.6,
    "rate_b": 48.400000000000006,
    "delta": 2.2,
    "ci95": [
     0.2721088415733056,
     4.104477613711747
    ],
    "ci95_bootstrap": [
     0.26666666666666666,
     4.133333333333334
    ],
    "se": 0.988353550578326,
    "p": 0.030396960303969604,
    "mid_p": 0.02525,
    "per_seed": {
     "42": 3.4,
     "43": 2.4,
     "44": 0.8
    },
    "p_het": 0.5967403259674032,
    "family": "B12",
    "arm": "blasst_t50_s1",
    "base": "blasst_t50_s1",
    "row_arm": "blasst_t50_s1",
    "mapped": false,
    "source_note": null,
    "reference": "dense_s1",
    "mdd80": 2.7390063764106354,
    "decode_only": false,
    "fragment": "blasst_t50_s1",
    "bf16_level": 48.400000000000006,
    "floor_ceiling": false,
    "p_exact": 0.030144644711851132,
    "exact_clusters": 134,
    "exact_unit": 100.0,
    "exact_mc_z": 0.09085889943148938,
    "q": 0.390960903909609,
    "verdict": "nominal_gain",
    "verdict_text": "above, nominal (p 0.0304, q 0.39)",
    "flags": [],
    "q_exact": 0.38818359375,
    "verdict_exact": "nominal_gain",
    "q_per_arm": 0.30396960303969606,
    "verdict_per_arm": "nominal_gain",
    "fragment_found": [
     "blasst_t50_s1"
    ],
    "fragment_ok": true
   }
  ],
  "B12_family_size": 40,
  "ctl_window": {
   "d5": "pin",
   "branch": "pin",
   "registered_reference_q38_swe": "dense_s1",
   "computed": true,
   "contrasts": [
    {
     "arm": "fp8kv_s1",
     "a": "fp8kv_s1",
     "b": "dense_s1d",
     "model": "qwen3.8-27b",
     "bench": "swe",
     "delta": -0.4691689008042895,
     "ci95": [
      -2.25000000165659,
      1.310615991251488
     ],
     "p": 0.660933906609339,
     "n_items": 1492,
     "p_het": 0.7344265573442655,
     "reference": "dense_s1d",
     "rate_a": 87.13333333333333,
     "rate_b": 87.53333333333335,
     "per_seed": {
      "42": 0.20202020202020202,
      "43": -1.4,
      "44": -0.2012072434607646
     },
     "mean_a": 87.39946380697052,
     "mean_b": 87.8686327077748,
     "q": 0.9116329746335711,
     "verdict": "no_detected_loss",
     "mdd80": 2.544783784751236,
     "installed": {
      "delta": 4.548494983277592,
      "ci95": [
       2.6109660555521392,
       6.495468280140329
      ],
      "p": 9.999000099990002e-05,
      "q": 0.001999800019998,
      "n_items": 1495,
      "verdict": "gain_detected",
      "mdd80": 2.776266323762853
     },
     "verdict_changed": true,
     "p05_status_changed": true,
     "verdict_text": "no detected loss (MDD80 2.54)"
    },
    {
     "arm": "blasst_t50_s1",
     "a": "blasst_t50_s1",
     "b": "dense_s1d",
     "model": "qwen3.8-27b",
     "bench": "swe",
     "delta": -0.6036217303822937,
     "ci95": [
      -2.2636484703506365,
      1.0596026506432374
     ],
     "p": 0.5235476452354765,
     "n_items": 1491,
     "p_het": 0.40055994400559947,
     "reference": "dense_s1d",
     "rate_a": 86.93333333333334,
     "rate_b": 87.53333333333335,
     "per_seed": {
      "42": 0.6060606060606061,
      "43": -2.0,
      "44": -0.4032258064516129
     },
     "mean_a": 87.32394366197182,
     "mean_b": 87.92756539235413,
     "q": 0.8810547516676903,
     "verdict": "no_detected_loss",
     "mdd80": 2.3751383418503638,
     "installed": {
      "delta": 4.280936454849498,
      "ci95": [
       2.3999999981247946,
       6.143790851488853
      ],
      "p": 9.999000099990002e-05,
      "q": 0.001999800019998,
      "n_items": 1495,
      "verdict": "gain_detected",
      "mdd80": 2.675699450914308
     },
     "verdict_changed": true,
     "p05_status_changed": true,
     "verdict_text": "no detected loss (MDD80 2.38)"
    }
   ],
   "rule": "prereg R4: with D5 = pin, dense_s1 is the registered reference; if the gate fires (valid, p < 0.05) the Qwen3.8 SWE-bench contrasts are also reported against dense_s1d (descriptive, outside the BH; their label with that p substituted into B12's BH is R4 (b)'s second verdict, stated in the same sentence, (w)). With D5 not pin (R4 a), dense_s1d is the registered reference and dense_s1 the sensitivity.",
   "other_verdict_changes": [],
   "window_effect": true,
   "w_mark": true
  },
  "control": {
   "computed": true,
   "branch": "pin",
   "w_mark": true,
   "registered_reference_q38_swe": "dense_s1",
   "gate": {
    "valid": true,
    "window_effect": true,
    "text": "WINDOW EFFECT: report the bl2 Qwen3.8 SWE-bench contrasts also against dense_s1d (descriptive) and flag it",
    "status": "complete",
    "mdd80": 2.685118735164083,
    "contrast": {
     "delta": 4.825737265415549,
     "ci95": [
      2.9494382002886015,
      6.706408347839641
     ],
     "p": 9.999000099990002e-05,
     "per_seed": {
      "42": 4.435483870967742,
      "43": 4.4,
      "44": 5.645161290322581
     },
     "p_het": 0.7961203879612039,
     "rate_a": 87.53333333333335,
     "rate_b": 82.73333333333333,
     "n_items": 1492
    },
    "md5_ok": true
   },
   "contrasts": [
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "arm": "fp8kv_s1",
     "reference": "dense_s1d",
     "delta": -0.4691689008042895,
     "ci95": [
      -2.25000000165659,
      1.310615991251488
     ],
     "p": 0.660933906609339,
     "q": 0.9116329746335711,
     "verdict": "no_detected_loss",
     "verdict_text": "no detected loss (MDD80 2.54)",
     "verdict_changed": true,
     "rate_a": 87.13333333333333,
     "rate_b": 87.53333333333335
    },
    {
     "model": "qwen3.8-27b",
     "bench": "swe",
     "arm": "blasst_t50_s1",
     "reference": "dense_s1d",
     "delta": -0.6036217303822937,
     "ci95": [
      -2.2636484703506365,
      1.0596026506432374
     ],
     "p": 0.5235476452354765,
     "q": 0.8810547516676903,
     "verdict": "no_detected_loss",
     "verdict_text": "no detected loss (MDD80 2.38)",
     "verdict_changed": true,
     "rate_a": 86.93333333333334,
     "rate_b": 87.53333333333335
    }
   ]
  },
  "ctl_gate": {
   "generated": "2026-10-23T00:14:00-0700",
   "model": "qwen3.8-27b",
   "bench": "swe",
   "control": "dense_s1d",
   "reference": "dense_s1",
   "flips": 10000,
   "seed": [
    20261021,
    77,
    1
   ],
   "status": "complete",
   "contrast": {
    "model": "qwen3.8-27b",
    "bench": "swe",
    "a": "dense_s1d",
    "b": "dense_s1",
    "label": "bf16 S1d (bl2 same-window control) vs bf16 S1",
    "n_items": 1492,
    "n_clusters": 500,
    "n_diff_items": 178,
    "a_only": 125,
    "b_only": 53,
    "mean_a": 87.93565683646112,
    "mean_b": 83.10991957104558,
    "rate_a": 87.53333333333335,
    "rate_b": 82.73333333333333,
    "delta": 4.825737265415549,
    "ci95": [
     2.9494382002886015,
     6.706408347839641
    ],
    "ci95_bootstrap": [
     2.9569396000779915,
     6.751449797006061
    ],
    "se": 0.9613655494299915,
    "p": 9.999000099990002e-05,
    "mid_p": 0.0,
    "per_seed": {
     "42": 4.435483870967742,
     "43": 4.4,
     "44": 5.645161290322581
    },
    "p_het": 0.7961203879612039
   },
   "mdd80": 2.685118735164083,
   "window_effect": true,
   "decision": "WINDOW EFFECT: report the bl2 Qwen3.8 SWE-bench contrasts also against dense_s1d (descriptive) and flag it"
  },
  "source_md5": {
   "log/sparse/dev/bigmodels/bl2/reports/swe_report_bl2.md": "68d1c8b92d207f4603786590738b7cc3",
   "log/sparse/dev/bigmodels/bl2/recheck/cells_values.json": "b74019eb2a6a5177dfa15effe836baf2",
   "log/sparse/dev/bigmodels/bl2/recheck/bl2_recheck.json": "91098fcb660efd1d7e04768cc220886e",
   "log/sparse/dev/bigmodels/bl2/trackA/docs_stage/table1.md": "e38927e2c770afd312beaf4b2fd9d4be",
   "log/sparse/dev/bigmodels/bl2/provenance/bl2_provenance.json": "32bd32aa49acd91ebfced991caa9ed23",
   "log/sparse/dev/bigmodels/bl2/prereg/bl2_prereg_v1.json": "bb3d5f31471777d39de50cf42156d269",
   "log/sparse/dev/bigmodels/bl2/ctl_gate.json": "c5cd12a3c95ab33fc603626190d2482e",
   "log/sparse/dev/stats/paired_baselines_bl2.json": "36c8c67e65e750babb97a5f8f94dace6"
  },
  "files_read": {
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/run_summary.json": {
    "md5": "0dbf5206ce66d238b7146dfe5e9a884f",
    "bytes": 729
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "b538c597d8e2c879013aca7bb86f2616",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "75b4b8d6a9d7dd7c7e39c917944175d7",
    "bytes": 3553923
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard0of8/zero_token_ledger.json": {
    "md5": "a1545ac567309456391f5449ba5ceb19",
    "bytes": 13
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "dd0c217922c08f89baddae4379c44f35",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c03151db5172b28c4e368f69e7256111",
    "bytes": 1979860
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "28f98c408c9c8b03065de506b7521500",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1cb0703161e50f6ad1255a63c71a8dfa",
    "bytes": 1811252
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "6413912def22de3bc3ec911e2f45372e",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6ed1058408b3ed1975cc1b92afad6834",
    "bytes": 1968471
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "1461f12a6905e90af21ee2fd6249bcac",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "14264cdc5b821448c647f3e607bcef16",
    "bytes": 4575264
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "04ac1c0d70fabd341b765922a27fc045",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c45dd111133b94dafd8e5cc5e37d9b34",
    "bytes": 2675616
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "d9edac02f6dd438308ef0d0c6c3a4d08",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b12d9efa95e7df7647a36e13376c60b5",
    "bytes": 2873373
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "6e980363bc7b6079cbc74448a46cb5b0",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a4326a1e63444e2b70670d8f89f0df78",
    "bytes": 876470
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/run_summary.json": {
    "md5": "f34c0c8cb754cf14f48a855b8b7c12b7",
    "bytes": 727
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "fe5b53052e49a18ada2b8e19ecf724e4",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "24da7dd69c6758a3cdcbe73971342675",
    "bytes": 3491467
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "b78333b5af7371e5f71b8249eb4742a3",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a0baa3f3beb46551dc6daf629ef2eef4",
    "bytes": 1926091
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "f06706cd47d99640440ab2e588fadcbc",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f6bf86a6b5185f29c461ec12b769a6e4",
    "bytes": 1858656
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "02c4576bed59701c361a6fe74ea9e80f",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0993f53d24087354736974c3de53cc0c",
    "bytes": 1856343
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "d3299d03267be70cbbae4cf2b1f60185",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "fd4a17d090e8308702026e2282736c6e",
    "bytes": 4552546
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "6d09875de3b72eb607a8bc1122fc5cd0",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c51070d81016d07e50195a31ea535c62",
    "bytes": 2801057
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "e8112cc9f481f6ba229b99ba62f9ee27",
    "bytes": 611
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1a0b584bbb858dea8f40643e35b956ac",
    "bytes": 2723517
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "30104739746ac1905547fbbcb90c5dc8",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "84a8e56f90f3efb79c0a94ea0256ab73",
    "bytes": 879193
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/run_summary.json": {
    "md5": "89f362fd22d435a4c124bed4bd7f6db4",
    "bytes": 729
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "108d048ffb78a4cbbeef6d059c78e589",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "4a747e8c7dedfbc4c389dcb6203a1ead",
    "bytes": 3635993
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard0of8/zero_token_ledger.json": {
    "md5": "de54aea5d3186a84e35240def98bf228",
    "bytes": 30
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "4fecd26dda60384df03493421ba2ddaa",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5f182e4c583b1951ab54fe4bd1a82cdf",
    "bytes": 1967767
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "4acc9b2e74ee03e5338bff58ef542581",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "648a28e486430e5b7008606fd83be706",
    "bytes": 1840769
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "59a2c90475248fcb55240321ac5ba957",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0bc1f8a5faa412c5177a232361e77a53",
    "bytes": 2014754
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "62fb5ee921b8dbbe961fca1b61a3487b",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d57d9e876db8b44f52c782eefac5ad8b",
    "bytes": 4504789
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "bcc9ace963c30b30f439128f90fa4f56",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c1038f0adf5470cf7a2e5844170d0dfb",
    "bytes": 2745313
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "c7afa4ee8825a637c8f24a01dbf1ac9f",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6cf95f6d47a73877a38eb3418d4989b5",
    "bytes": 2790760
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "6bfc8bf1c2c4a8b21a7cd732b93f4f97",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_blasst_t50_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "dd444964c29f38d2397c4ad0064690f0",
    "bytes": 882450
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/run_summary.json": {
    "md5": "d3bcc4fe1bc8543c26427d340f82d09e",
    "bytes": 724
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "62ce3dd380ae27d137b888bd1f55f01c",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c4cedb4d66c0d1b04199623a39410bdf",
    "bytes": 3554122
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "5477b1630579a65cfed10af4d8429576",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "ff95e4bbfc6bcb776dd0a014918d68c4",
    "bytes": 1981225
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "9080b2540148b0e90d3cc6c83de86370",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "df7675d2c24a4275ec12d676f8edfd00",
    "bytes": 1823219
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "4114b05a3e09d782c346591ac315f1a3",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b1c5f4cd599830bfd28ec1f56665accb",
    "bytes": 1946961
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "eca27e62940fda0cf4bd3c345fc550d2",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "ecd31bce71a91966e91f27390a53e46e",
    "bytes": 4585504
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "e8f2825daad25da5c3796c8bc932ea8f",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e564ff23271d3ed90bdc19b7220efa05",
    "bytes": 2712058
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "95a5025c9c5cbe8d26674be8089109c4",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a492b668f59fb606ea382f33d07f319b",
    "bytes": 2719126
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "1d7333e90e64cb7aa9b0f4797c5d42bb",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "845f54ef53deb84e4580462e2a82ab69",
    "bytes": 880434
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/run_summary.json": {
    "md5": "4cca5f0dff30888ec549941383bc3b79",
    "bytes": 724
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "905eaafd9295add02906e7e3de815c0d",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b34fc509c78c9c2afccf0e0b8bd362f4",
    "bytes": 3528271
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "eae41596fe7ee8ebbdcc4f0defd34d6a",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a41ea140bcea88f667ae5d52bcf28f77",
    "bytes": 1981118
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "1d278a8df57b20f034d17fe74cdb5c8a",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "3905171a73da68fecd68ed57e4223096",
    "bytes": 1788472
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "d3a0fe2d93aa9daf7227232485840781",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "246a1e02883e4005c81e346b92a8ee5d",
    "bytes": 1956704
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "2076284bdc23ac949742153b2f76c10b",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "75442e0b621b13c056bf13ddf1d735d3",
    "bytes": 4589955
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "895b0976c0abff1688575af8cbbb37bb",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "fb71772e505f80cdf6cbba53fffdbbe4",
    "bytes": 2725022
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "c3b6b0606f321f6ce6b1f42a7aeda676",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "54c317c63d023b8aa66b5d86fac30d96",
    "bytes": 2878286
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "de949ee377d986a9ec064fa4d19c6d02",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "01110e66f628eb80557dcaa769024335",
    "bytes": 873141
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/run_summary.json": {
    "md5": "f0e3d48beb3de7742bf7f29a72263448",
    "bytes": 724
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "4fa34ee5c8855813500dc977a2baffac",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "76c70bd0b3e09cca34ec68e8074aba12",
    "bytes": 3490815
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "706e8087f3abb99fb723874bdd5fab6a",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "7dd12e31bc8231acd62eaa29c26eff98",
    "bytes": 1906150
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "ec65427f37e2a3238071c9e39aac0cd6",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b899e111bd3567f3989a588f5fcb2249",
    "bytes": 1752461
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "94499fd209642b3fca0c017b0a8238f8",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1f124dc0e9a488f6606a6f0ea353a61f",
    "bytes": 1965288
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "65f1a221a9624c4c990bcce7e559406d",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "956d10ed4d351170142a52c1b3e8fb52",
    "bytes": 4561684
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "ff9220a9c3c7dbec8a5e9f4bf64a03d9",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d7c6dfafe4ee43b7dcaa66f841a60869",
    "bytes": 2807749
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "328d75ac808a339adca65aaf446916e0",
    "bytes": 605
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "afcaec016cfde5491d9a6f2281152c47",
    "bytes": 2724486
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "53fdc12d82dc56aab6a5f2bf7c321acb",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f46f69f2e273c53771ee5230da94ee84",
    "bytes": 926983
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3-nano/method_fp8kv_s1/swebench/seed44/shard7of8/zero_token_ledger.json": {
    "md5": "a8c25536518e344c06466377ff9da0be",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/run_summary.json": {
    "md5": "7f04d67b3da6f63ecf7e2cbeb87170c1",
    "bytes": 738
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "5f3e78a74a8a6149dc2e2be89400b505",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "20ad0a83bfc9a0c8eec10bf54025349c",
    "bytes": 3517585
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard0of8/zero_token_ledger.json": {
    "md5": "95620e94cf37483955a6cfc3c5f6ec4b",
    "bytes": 31
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "044139188e9e85ecb03453517b1fcd88",
    "bytes": 631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "10ed8c8201f2d56fd9d419d61288dc87",
    "bytes": 1973713
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "ec24477ee2298690aab6c209e2305bb9",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "deaae01137ee2a7485a7087719b1a85e",
    "bytes": 1902609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "d867a0b496278e36796259816dd64339",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "29387c550a4dbe45e95eea8ef687ee13",
    "bytes": 2046129
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard3of8/zero_token_ledger.json": {
    "md5": "d0d064b43aceb02dfb40c585ae881587",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "6334cd1e5ec4db6ce9ffedb0750520bb",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c5e840956aa1a5714dbfc40403086c0c",
    "bytes": 4542043
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "e136f7ad8f1fe6173fc28fa1814e3729",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f12b94a863b5e7b2c7caee9775150b35",
    "bytes": 2718493
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "99208a860b6bc174b44c43c69bd61082",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e1aa4df00fe646b042b256803aaf3134",
    "bytes": 2771427
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "9df77c46b4e1d0a9bb3c1e938cc19f45",
    "bytes": 627
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "fa446585c688717c0dbb16505897d250",
    "bytes": 870990
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/run_summary.json": {
    "md5": "32d0a071e23564e21fac578fd01a9496",
    "bytes": 735
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "363ad59b8365d2ecd2dfc47ed9b987e7",
    "bytes": 631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "133d0d2802ce071b111069f2ddab8791",
    "bytes": 3490932
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "d6950fff7af18d5337677852a35b79c1",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "9602cafd14f9e1cc177c3c80f7a912ce",
    "bytes": 1898909
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "62335b6c564cb79056e610970be08d22",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "41c158a86f142f01dd9f44adde1374b8",
    "bytes": 1850006
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "7dfa3c7a9ebcea280b38763311f60b10",
    "bytes": 631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "181fc5e3ad1535b3f3e5e9906ab24234",
    "bytes": 1911930
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "eb6663caf4eb33eb0ad4aff50dcf0d12",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "896467e4f84da433674cab3be1693c35",
    "bytes": 4534721
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "983e2a1ea6d1040fcda0d6261492a918",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "48cd5a63b06461a51560367a73f614db",
    "bytes": 2713095
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "8161a573413a5b476598f1618303a8fc",
    "bytes": 631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6e02d0864bc08fc2f4a3b8bccf276342",
    "bytes": 2810327
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "228d8f026444d40014ba591cf3b74e8e",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "3add6feebaf1843236e18b84472b12c8",
    "bytes": 862638
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/run_summary.json": {
    "md5": "090847d463e07611e16d6945f5e6182e",
    "bytes": 737
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "f749c16f62c9d455a96dfb7d84fd328e",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e11d4152194ff653e46ef0425128a3a3",
    "bytes": 3572640
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "adf8b067de703f9b4027f2bfc560399d",
    "bytes": 631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b987118b20265157997df0a0609642a0",
    "bytes": 1932833
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "4628353de54bbe9574440977cf0d5c20",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a70a81184a87e0a5c62f6ffc50de63e2",
    "bytes": 1880908
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "b199a0ad25561fb8809af7b724abaca4",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1614b00d8e69f2050590ec0d86530a0a",
    "bytes": 2035331
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "f7b8ababd73c720e8b9a43a6f8bfc7c7",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "68385f0dbfb3aaec356e3ac31d1b2544",
    "bytes": 4539082
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "e638f8e3adeab2d83571d0e5b5f763b8",
    "bytes": 629
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5b5ec5d44ddd6a00a4e7530107c25848",
    "bytes": 2690618
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "3b1a2a313f2f397b1efaa6113afc0eac",
    "bytes": 631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e062ce79b3d5cdace360ed5fa603fe04",
    "bytes": 2815718
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard6of8/zero_token_ledger.json": {
    "md5": "eb2ecd4993b5c755e67f97aca1ed23d5",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "9a63cc9ce9c64f48b0c43d80e2bf12e4",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_blasst_t50_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a9a786dc873e4af5ad96b0b29afa7fce",
    "bytes": 856021
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/run_summary.json": {
    "md5": "766c9e9baadac9aaa076287e115197f8",
    "bytes": 732
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "8e6f48af69058e4c5faf5abb0a24527d",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "078e9e4214d1a93ce7a4d39fae802053",
    "bytes": 3474664
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "5854393bab443dc784f02886516c0479",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "20e879ca8a10ed197f1912d362c145fa",
    "bytes": 1851487
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "aae69928597758f61df3023e702d9f54",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d6f9b672ce0223353d8e8121409d5642",
    "bytes": 1886436
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "8d5373560869c0998d3c40f83ad7eb87",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "4eefba42b7a7a6d8626bace9297eb505",
    "bytes": 1966687
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "48b9b8563f220421dbeba0af5de929c3",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d50f6aa51ed8f794d9277a7b6031fa0f",
    "bytes": 4559659
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "008ad6441ef1b604fc7c2ea9690e167f",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c509fc63c27841563ddc969f07d72f06",
    "bytes": 2651078
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "fb97f34bf3e9adf91d0ec161d45ca63d",
    "bytes": 621
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6f2e52d71eacb436c7014592db889b5c",
    "bytes": 2857050
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "85f5e3844f60d32d64730deae5af7b9e",
    "bytes": 621
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5ae5f459ab0c4c302c8d630afcca3ba5",
    "bytes": 868507
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/run_summary.json": {
    "md5": "03a354528b517edee6d453bd05f4810b",
    "bytes": 733
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "b40ed38b615349cb1eebca853820a7bb",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1a658a984a0e82076f7b88b5561ef617",
    "bytes": 3479242
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "138c74fe8100638e73559b71a665cc56",
    "bytes": 621
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "96f388d5c6bd365b926c7e9ef363dc14",
    "bytes": 1956630
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "d229e53e10728a3096dfc258d81f982e",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0392eb1f4a33d3897b8b7a1b01a35db7",
    "bytes": 1819812
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "c67af3b3552b1bb4553fe2cec84233f5",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b9da7f02da86a0a92ca04933d5a6e029",
    "bytes": 2006493
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard3of8/zero_token_ledger.json": {
    "md5": "6a1b5a8115a667bf35b376d653e5c422",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "ef729ed5e6de3a2a26931f129505fb55",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6a5883a076cb89559ceb21be8ebcb897",
    "bytes": 4551926
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "26c38df3890892563d47ce6b798d5fda",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b44649e4a565414fc1c391c84d895400",
    "bytes": 2764334
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "bee5978e9763803d546ff3b9d2836c74",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c67daf1b91ad423c0d75940e417e9845",
    "bytes": 2817908
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "0656c82ce30a6c536c826f0d89205acc",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c38c7fd035652b3dfb2c1065b6ab5c6f",
    "bytes": 857631
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/run_summary.json": {
    "md5": "9810ba70c80995dc12f91c4fe51cfc99",
    "bytes": 732
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "416657e6c482d7543c1ebd258644ea1c",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0882384ccb8ad238cbb5f3910327f3d7",
    "bytes": 3511141
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "1130480720799aad7b3854bcc00b5354",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e92bc958e652592c8ffccfda032e94c6",
    "bytes": 1948059
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "bec47466cdbd624e5774a5406b72f4de",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e2cf17537d1537f6387e6103d57ba80b",
    "bytes": 1877442
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "6a5cd4d3e6525e6f82db473316a106f7",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f0e26eff67b3a616e0d186fd5983ea8f",
    "bytes": 1932226
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "fdcd3548aa66932bfae8e8e21e1db5b8",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "7e725b23c578feeb0b3b05d7a8c3e7f0",
    "bytes": 4577535
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "f4f5f63561c3febc95dadf21e6668dd1",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b915475368cab2a0f893bfcdc5c31db2",
    "bytes": 2710863
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "6233f0e32f96b30e39c45fa8797a8693",
    "bytes": 621
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "2622e70c61c99ca95978293d204cc1ae",
    "bytes": 2797835
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard6of8/zero_token_ledger.json": {
    "md5": "4e9dfcaa1924f6628d1c2aac73450a92",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "083ff0f21d92a4e8b9b29e7af6094f50",
    "bytes": 619
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/nemotron3.5-lightning/method_fp8kv_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "3b5bfbd2b0576070a8dde61c9d3289cc",
    "bytes": 851840
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/run_summary.json": {
    "md5": "e4c1e08e9a8739ea25398dfe3d2c6a22",
    "bytes": 730
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "5c0e32e88ee90de8056bb067328e25b5",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "58b2bc3b7728cb3517c71505735b59e4",
    "bytes": 3415892
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "a9aba0a90ff18f82df0b6568552c61bd",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "625a34b8b3b7601de7b705f37075cec2",
    "bytes": 1818701
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "6f028b571143aabefbdd0c9f4ee457e1",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "9ef1ab958f37d7540051809ea82e1953",
    "bytes": 1782215
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "99ae8d3f37edb778d67aee261ae7c834",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "dc46ce788efe8f89cecd5af29c5747d2",
    "bytes": 1838221
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "23ef5a78b97a15607d35780406199ada",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "270ec455ff323109dd01eed0913761bc",
    "bytes": 4527426
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "61f9e30384f796a0ec81c02f29041a4e",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "74fb944db4c00c746e0b3b2477702ea2",
    "bytes": 2687476
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "33434ab047bf7e5b84549b7069ce62c1",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "595eb7280b9bbad416b7892149d8fd39",
    "bytes": 2732778
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "04f7183ff468e1a521d9629838809abe",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e5899b73fdc2b216cb58f913a521acbe",
    "bytes": 845655
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/run_summary.json": {
    "md5": "0d9fcfe6d4efab3a14ba3ed4e557c615",
    "bytes": 729
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "50a62676ef28529d243c124b04b08830",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "7e66cfd9976965408234939750d96a85",
    "bytes": 3422242
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "a6a1fac443314bfecb7920105a07a2c4",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5463bc9f5cb11f77290af7c877a6a6ca",
    "bytes": 1835432
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "6396823c3388b130d5a5143bc21fe64f",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "45e365e04a494c9607c581384432e858",
    "bytes": 1778705
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard2of8/zero_token_ledger.json": {
    "md5": "7754fed1a4fe45086d07571671382623",
    "bytes": 97
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "72aaa92896d3a16d67bf20cfa5c1ee1d",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "eced71fd7007622578fc7609633f78cc",
    "bytes": 1910111
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "c14de6e06bd0091c5c1a62633e6d6a76",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f5a2c6d748135ac30ee6783ca35337e2",
    "bytes": 4522960
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "bd2ba09e1329621019042e1c0e1a7333",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "91dc1f09df3ca50f4934921f52170f1d",
    "bytes": 2694693
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "46eb48f5d0793d190af330b70e9b1a5a",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "142c6cd895fc0db10b4e7e743c304712",
    "bytes": 2731083
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "567710c969e9b40c0f7c9f3f6d1c9b8d",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e09bb81a70227c1ebe222f0557ce1267",
    "bytes": 843265
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/run_summary.json": {
    "md5": "33e72fae196a9a45d9de41afe2fd93a9",
    "bytes": 730
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "9556493d117054e2b1dc307d2d73526a",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "52b54491bab4d9d08986a420652f6d85",
    "bytes": 3449807
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "9bd11b13fa7d6178f422602f7832d4e4",
    "bytes": 615
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "49fb406f1353d3c41ae7212596be6978",
    "bytes": 1851580
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "c61f08f3003473aad47513d59f731484",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0703797c2ed6d2cabc312439f19818ab",
    "bytes": 1765995
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "0b665ca53dd50abe126ab9cbe8503f08",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f0b0d11e24a1e760bf916c6e4a934094",
    "bytes": 1871292
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "f91160da2c84c6c474345afeb0503fa8",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "2e3441d3add1a994275b383c6a023a0f",
    "bytes": 4503917
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "2d5b07d90bdfad8bf946ab851dae9c8a",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "16ce335e7eeeee2573ed1ee71c74914f",
    "bytes": 2700876
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "04505208a702b87d7416f3a56d08dbf6",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "77771fce2e78bb7bb1e625a3c482ab8b",
    "bytes": 2745065
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "e452d338766b3a7dbedea5f15498e4b8",
    "bytes": 617
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_blasst_t50_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "cd9f4be98c57ac64408c8636bcf31711",
    "bytes": 844664
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/run_summary.json": {
    "md5": "2c4ff4e330206cbf76f8758e3c420f8f",
    "bytes": 723
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "8989e6b2f59b7844368dbd6aa0487ea1",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "7e73985b644bde652729f929595a65d9",
    "bytes": 3491871
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "c11979d53681b03f1101cfaa1b965283",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "29807419b8c32bfe2a411e3bde39a165",
    "bytes": 1844371
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "59310de7f7275b72302fe03fd989f712",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b2082205f04cbe7667d76be6103bd7ef",
    "bytes": 1770958
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "865561baf8b6fe1093b05e0b57f50a12",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d97be3f0e5f1345e8a28a899b50b530c",
    "bytes": 1960818
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "18ee7584718bea69ca7f57e25b8d0f74",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1a47e677564016e6f735395b738f3cd8",
    "bytes": 4516990
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "52e9bec4d7f36f3329fb7d9142d01c69",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "39f4386a80ab5e4c75c1803bbc8f14f2",
    "bytes": 2694451
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "8ef3ba0fae41b900d9138a5e4ddce8ab",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "3f7cd31c3a8b72ae3464318fad335314",
    "bytes": 2740475
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "08e46946cf83df90d6cc26da163dd9a4",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "657070ba76542adee5ca656fb7929bf5",
    "bytes": 841627
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/run_summary.json": {
    "md5": "637d513b5cb2ed0afac0030b8e4b0abe",
    "bytes": 724
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "939df01b31fe9f1be0df52d6737347b3",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "da71e9f6ad6396739d941faecdc06746",
    "bytes": 3421454
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "cfe8c0650552c76c3f9df0db492e2ecb",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f73d3350f8ccdfd52d5a3426b9531476",
    "bytes": 1809332
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "7201e086b485a2f3eb5768040bc399b9",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5e3a3d9aa3015bf10b379e3897ea925d",
    "bytes": 1787128
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard2of8/zero_token_ledger.json": {
    "md5": "a746bc0b5fd34d1f8543a20684c626a0",
    "bytes": 54
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "b28b9d0db12f700c71a3e1f66651be3b",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "67a1dd2e9a3078fc6516490367f3974c",
    "bytes": 1952036
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "36761dcc168f4c47f85d2f2ba305b5df",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "001e869c0c1be18cf3e71a3775620f77",
    "bytes": 4509592
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "1edbea589b2e481014b44c70c0190684",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "607b99430015929e0419cdf1fefd3d06",
    "bytes": 2691628
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "152fdf3ad3981f44088d7bf852e6c7b8",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "dbf2e9fd1b226e9018b1f4e0c986d293",
    "bytes": 2732022
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "67bd4343a8420cfae634262723bc3392",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "616e46db958ab03cc4600678d1f07906",
    "bytes": 898808
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/run_summary.json": {
    "md5": "94814f7b8e5f9b20fd6d7ec991e73870",
    "bytes": 726
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "ac8c0685548abdfd2df30467ec7d59c3",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6dd8fb06145c1bddd79c264389ae3afa",
    "bytes": 3449451
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "a020f5956f482189e4f5f975b11fc806",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "260d231d6b5a50e7914626a176b4f148",
    "bytes": 1849808
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "edd94949b1e986c5d0150856a21991a6",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "dbca815e64a5a1d5fb6705de7fe30bb0",
    "bytes": 1733164
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "9b61aecb63f6a0ec5cf23ae30ab361e1",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "2eec0dc23739ff70d60183d524a9ff97",
    "bytes": 1906088
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "089f373d9f20623430706c26157fb523",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b512422f37423c1ba1cdd5393da93374",
    "bytes": 4508220
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "473b443b77194060c31a3280d455ebd0",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "86a777e38bc6f6f8e1c658247b16dbe3",
    "bytes": 2702359
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "483b3f1677bbbf8f0a46d07aa2363dec",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c6bd1039d6b9aaa8591920368b2e2773",
    "bytes": 2736716
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "f62e4b1a58742a8b1e06e460b2a0beef",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.6-35b-a3b/method_fp8kv_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b713f246d2576860ac8a96fb85bda5d5",
    "bytes": 891993
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/run_summary.json": {
    "md5": "485a451d18cc1f3ac5d69c524f440cd0",
    "bytes": 726
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "5a241edd697d6686a93defbb07274fb3",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e05085b3a0c758b1118e9976c2144d30",
    "bytes": 3351949
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard0of8/zero_token_ledger.json": {
    "md5": "e19118013e46a0998d25c0e6e74099e0",
    "bytes": 74
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "61c961ea9a2a24b2e332804d8904b189",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "8d639f9f7e0c3285ba1a4d699827f325",
    "bytes": 1779875
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard1of8/zero_token_ledger.json": {
    "md5": "429605e02025edf6a8d175cd55a8ad0c",
    "bytes": 51
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "d5fbb3a5b35a4130a4fbd2f268abf2db",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1f764afdad292fd436d16881a1c72083",
    "bytes": 1760990
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard2of8/zero_token_ledger.json": {
    "md5": "11457855b6b958204a156fcbd7f44312",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "32a5d3fdba6c0a60dd185265176bc23e",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "7314ecfa742ce5652f6bb22c58808144",
    "bytes": 1853397
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard3of8/zero_token_ledger.json": {
    "md5": "2d1823662dfc594cf884ee909ce96274",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "9b4e96ea1013195bff412d61263c1d88",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c4a7992e0dce6d0a31833d0886ff351f",
    "bytes": 4505351
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard4of8/zero_token_ledger.json": {
    "md5": "8ad8539df28246d7f6ac14f7a17fd658",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "d1cb813a36d962d993f3b53a879ce674",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "fb1e8462b9d067f86372f3c1400a7a3a",
    "bytes": 2651840
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard5of8/zero_token_ledger.json": {
    "md5": "66db7e8ba06b78e585f8f8c6efef8c3b",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "ef594ecd1ca9c4f6fa2d522e9ec21b52",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c1bc3186e452072e24aedd25a0942e3c",
    "bytes": 2702947
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard6of8/zero_token_ledger.json": {
    "md5": "5be9e4d5f1b8b26b0605f181f7842f55",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "411265f119ac3a37ccf44e3c88814f02",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "efa743965bb7308ed1da2165b93911c1",
    "bytes": 820379
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed42/shard7of8/zero_token_ledger.json": {
    "md5": "35d515871e1b64df7ec0b2e03674232e",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/run_summary.json": {
    "md5": "07853b8af9576602167e0253d1abeca2",
    "bytes": 726
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "66f820e99a19b9d91a80f5794f3b6c34",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "afa98dbeb60b664ffbcfdd8a96926696",
    "bytes": 3405100
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard0of8/zero_token_ledger.json": {
    "md5": "9101c3f095e5669f8db7618984666b93",
    "bytes": 31
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "8d97df51d8aa0fbe346b8d2988338c49",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b42c6b675c6f3047632e8999da9f9330",
    "bytes": 1771818
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "0aa2688f1e6bd96d8d3c571bed7ac81b",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "40769f6ec99c410d2a6eff9e025cf6dc",
    "bytes": 1738345
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard2of8/zero_token_ledger.json": {
    "md5": "e2d14c2ab06f1bd8bbee91cdeebe12b2",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "4537417c2d14024e5e9cd80672d2a90b",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "eb5fc65663a8f97035fd9dac71836c62",
    "bytes": 1847634
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard3of8/zero_token_ledger.json": {
    "md5": "705e4e87d4bbab63ae09cc93da40112f",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "a51524b56f1f5db9eddfe81acd258a16",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0a65cb1307ff49bc79720176b1aeb4a4",
    "bytes": 4498595
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard4of8/zero_token_ledger.json": {
    "md5": "274df32b359c4d2962405eb5581a1fc9",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "f647d99192c28c01716df285958abd8c",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "88e2c4f1ea7028b0f5223e252172f6cc",
    "bytes": 2671791
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard5of8/zero_token_ledger.json": {
    "md5": "360737792bc4cacb51ec3fd1ab97e01b",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "68bebcd3946b610bb67547ab5d998a3c",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "37aeedb4bf723c12d1bbb2c40ce7f32a",
    "bytes": 2680397
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "3400871331ad1c77c9bc7925c2f66844",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5861d1f8581b2e1e8eef2128c2bac4cf",
    "bytes": 818875
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed43/shard7of8/zero_token_ledger.json": {
    "md5": "9f0b3e24c4208ad530e836a65af59a8e",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/run_summary.json": {
    "md5": "4b0ce145e38bc46e6dced4e9c39c4d3f",
    "bytes": 727
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "988d1ec117e4f255e3ec14467ad70001",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c7d2c8edf0f475facb92fe57fc361361",
    "bytes": 3300031
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard0of8/zero_token_ledger.json": {
    "md5": "2ad33ca8fb963a074333fe91cdede40c",
    "bytes": 26
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "b64fdd1a5f9058ce47a07bbba47ade25",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "dc7ae8496e0751a0337b26f31cce1a8d",
    "bytes": 1795594
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard1of8/zero_token_ledger.json": {
    "md5": "363804090887257973975be975a73056",
    "bytes": 14
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "5b1445349937a0955ac8f5293b9d5314",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "261a8f7aa7e0cd0d7718b71c2a20d2ac",
    "bytes": 1755486
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard2of8/zero_token_ledger.json": {
    "md5": "d92d95124e56b5b9a839c3e91b06cb97",
    "bytes": 93
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "0894500b040d3ff3a3b92321857db84d",
    "bytes": 607
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "4110b89adcbe8d7bfc2f980e66833f82",
    "bytes": 1851342
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "0fbd4aeb0bd148cebaa865c5f9c36b13",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "ad1c662b819bef066fe15050a636dd58",
    "bytes": 4509697
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard4of8/zero_token_ledger.json": {
    "md5": "36e4a674c01f15da21e0a71e1185629e",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "7aa4a87e81734154602367deca79fbfc",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e769c236cde7d382f9ad45d0aafab3cb",
    "bytes": 2639004
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard5of8/zero_token_ledger.json": {
    "md5": "765c46930fa50cac6f8c07906ed6827f",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "937da944fb4618e8f9a990de16ee2cf8",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "77c81fd53da0b5e59f900d7d47363da6",
    "bytes": 2692349
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard6of8/zero_token_ledger.json": {
    "md5": "caf11f622c8d0ded327e9f96723742ee",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "834ffa400a97ca5e475442ef3375d7d0",
    "bytes": 609
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "9b8465228c4608ecedaac8abaa890938",
    "bytes": 823844
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_blasst_t50_s1/swebench/seed44/shard7of8/zero_token_ledger.json": {
    "md5": "8df02050b22928c164862d2e88bc00b9",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard0of8/summary.json": {
    "md5": "e95c56cc47b00c702a709ac2b1ec4296",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "cd94dcc03c2bb9ae47b682a46a972958",
    "bytes": 3335862
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard0of8/zero_token_ledger.json": {
    "md5": "cea6363f7319c28dda42f773d38139ad",
    "bytes": 38
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard1of8/summary.json": {
    "md5": "52bf678fb50d381f06439d0980519615",
    "bytes": 596
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "9d878a2ec4b99f7294648ae74242d639",
    "bytes": 1738108
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard1of8/zero_token_ledger.json": {
    "md5": "20166aaa2684b032b0406b0ed40c2d14",
    "bytes": 38
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard2of8/summary.json": {
    "md5": "ac65884438b5437447ece6565e3c48cb",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "b7367ecc76a5afc6b42457f3aaff4fab",
    "bytes": 1724054
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard2of8/zero_token_ledger.json": {
    "md5": "3059a41b62b7b65e3b9787b4c7a78d7c",
    "bytes": 45
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard3of8/summary.json": {
    "md5": "4f3cf02efe5505f12f0b184e4eac82eb",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a45f492a33bf7754a96b61c6e88a7f86",
    "bytes": 1811878
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard3of8/zero_token_ledger.json": {
    "md5": "42449d1eaf35e1d330f613d7fc3717fb",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard4of8/summary.json": {
    "md5": "f242543ead2f1ef0e9b01fd7259bba3d",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "9088f60b7b16c3165719916974291653",
    "bytes": 4476228
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard5of8/summary.json": {
    "md5": "a1f6b2ede7a6e4aea8b4012a16617104",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "8bf35d9a0bcb22039b9490c187578740",
    "bytes": 2654779
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard5of8/zero_token_ledger.json": {
    "md5": "5f670b821ff0e546ffcb5b54897b6a07",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard6of8/summary.json": {
    "md5": "c58e00d7423df5f51b41b2330ace81b8",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "0d07a87193a8088f55e8a327c1290c40",
    "bytes": 2681097
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard7of8/summary.json": {
    "md5": "775b0e026bc645de66f607fa205924bb",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e3f54b13d806245f8a7e13dab0722f94",
    "bytes": 824275
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed42/shard7of8/zero_token_ledger.json": {
    "md5": "a3c52e51d9bb29c1cf5a60919f6850e0",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard0of8/summary.json": {
    "md5": "a018f44dcd32a1cd577c10e1395296aa",
    "bytes": 595
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "de918e68edc7ae04db59f4c11cc5a859",
    "bytes": 3417096
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard1of8/summary.json": {
    "md5": "84aeaa60e7f2a613faf1b462833518cb",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "bc374017c39268eccd05346847172d50",
    "bytes": 1770388
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard2of8/summary.json": {
    "md5": "3650be91ec3a19e06bf15b67a23627c9",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d29b2834083e11ac7bf21df2f45735f7",
    "bytes": 1735130
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard2of8/zero_token_ledger.json": {
    "md5": "f4a1052880b05ef708d1258da9412ef4",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard3of8/summary.json": {
    "md5": "df93b4ac401b6e789048dc3b24e43b9f",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "aff73185950d5c17b7b6a359199858f2",
    "bytes": 1848658
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard3of8/zero_token_ledger.json": {
    "md5": "c52abee51ae30f01e2fdac70628449e6",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard4of8/summary.json": {
    "md5": "69f6092416e6cba604172fb285847f44",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "83d7318b01feb0b169b51cdca0d31830",
    "bytes": 4489926
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard5of8/summary.json": {
    "md5": "86a6373a65d1d44dc4cac421a64d3afc",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d93c8e36435b585d9bc82dfb90c7577b",
    "bytes": 2668470
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard6of8/summary.json": {
    "md5": "8786911aadafb2c088789bdd2ce1bba5",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "df3c4a842884bdd7ee405490f265407c",
    "bytes": 2667634
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard6of8/zero_token_ledger.json": {
    "md5": "029c84d279870800e491797667043518",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard7of8/summary.json": {
    "md5": "9a466e7665529895b311d24f3d159aed",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "292ef4c9a1ab5065feffe708abd0cd94",
    "bytes": 817919
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed43/shard7of8/zero_token_ledger.json": {
    "md5": "f5c8ed84f5f4a3e8820b08f18835ff62",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard0of8/summary.json": {
    "md5": "01c66392e397d90d25b8898045f75f17",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "89ca853952140c66f299268df31e9375",
    "bytes": 3406466
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard0of8/zero_token_ledger.json": {
    "md5": "2f7fe452085a13c94ba1fc1c9e163ea4",
    "bytes": 50
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard1of8/summary.json": {
    "md5": "971f353a5f6a7183cb3fdf1487d3e44f",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "3f6092da58f78ea12dd05622fb80bfa7",
    "bytes": 1792304
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard1of8/zero_token_ledger.json": {
    "md5": "c3c40d1fb8f8dafe5112b5eda0f6822f",
    "bytes": 14
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard2of8/summary.json": {
    "md5": "d46272f30ebde00453cf4ade91e144e3",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "6fb25f3caaea40b4c89954417014a405",
    "bytes": 1733272
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard2of8/zero_token_ledger.json": {
    "md5": "e8af60ffe7ce8188598a6dee3ca93632",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard3of8/summary.json": {
    "md5": "e43fc5dba7b13c08aedef448c621d6c2",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1a7776c877969ac365a31860c8e93e71",
    "bytes": 1809715
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard3of8/zero_token_ledger.json": {
    "md5": "f3e429133503b50072839f45fd0097e8",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard4of8/summary.json": {
    "md5": "48360e2c30cedc179e5186e994d56154",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "7c3d99cf47667012bf53d9bc316a65e3",
    "bytes": 4499793
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard5of8/summary.json": {
    "md5": "75e824a9be7e7881ca04cee32a92d586",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "62c150399fb0752c9c61a0902ba41611",
    "bytes": 2647840
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard6of8/summary.json": {
    "md5": "40b93ecae324b6324b95e1ccedc5f954",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f99948645f45d7b16eaaabeaa7b8eddc",
    "bytes": 2670277
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard6of8/zero_token_ledger.json": {
    "md5": "2469677faa5f9f0b0aae63970c61884d",
    "bytes": 58
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard7of8/summary.json": {
    "md5": "227edfeea5d00bb3d52ee13ba2d9619f",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "250142de6dee7e1b00b2aba7eb5de52f",
    "bytes": 817275
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_dense_s1d/swebench/seed44/shard7of8/zero_token_ledger.json": {
    "md5": "7c635912597390c38d062303aee6d0c4",
    "bytes": 28
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/run_summary.json": {
    "md5": "f2ad6b350eff4cfd805dd0337c054800",
    "bytes": 722
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard0of8/summary.json": {
    "md5": "b00da27e961bb57d972e89cc5b76a7bc",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "266d26c518782ccf667b3f1e0bcb68ce",
    "bytes": 3343874
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard0of8/zero_token_ledger.json": {
    "md5": "2ad33ca8fb963a074333fe91cdede40c",
    "bytes": 26
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard1of8/summary.json": {
    "md5": "e49d973e7c5a2760d1d6c967f016f700",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "85de96886335aa2d0549245572eb4dda",
    "bytes": 1797386
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard1of8/zero_token_ledger.json": {
    "md5": "a997d12b4927f97be8f1fb8ba752ab7f",
    "bytes": 56
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard2of8/summary.json": {
    "md5": "104d1b8cbbedf19746bbb8b413eb227b",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "513164b3f3022cb067882c068c95b9f6",
    "bytes": 1736929
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard2of8/zero_token_ledger.json": {
    "md5": "144d48fb5ac8b82b365e7b78568366f4",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard3of8/summary.json": {
    "md5": "27a34f09fd1f72d4e5651429cadcc4c2",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "18f85fe809622ff4b6ef6259f0236ad0",
    "bytes": 1839102
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard3of8/zero_token_ledger.json": {
    "md5": "6829686d3e252d8b6565f6201cb2760a",
    "bytes": 54
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard4of8/summary.json": {
    "md5": "b25dd4c07e2f43328d496bf6fac5c7b0",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "63220d72b6c89c221a27ac9ab5b3a427",
    "bytes": 4485761
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard4of8/zero_token_ledger.json": {
    "md5": "c563f1a5292ee0126412bf8e5ccec13b",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard5of8/summary.json": {
    "md5": "4a366a42857ccff0146421241459917a",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "2c7f224883f2174c617c83c73edc5d74",
    "bytes": 2651241
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard5of8/zero_token_ledger.json": {
    "md5": "765c46930fa50cac6f8c07906ed6827f",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard6of8/summary.json": {
    "md5": "287e80bcd42d89c2fb02712a528f1db6",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "06e64eb8e0ca14e7dbe8a5190f2caf3b",
    "bytes": 2681057
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard7of8/summary.json": {
    "md5": "d551d239ecdeadb6c3d0df3a5d6791d3",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "d2a7a215b11b86f1c1f684e3b0e7ce4f",
    "bytes": 823215
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed42/shard7of8/zero_token_ledger.json": {
    "md5": "dd942e75a2a70c349ebcf7f958d30cdf",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/run_summary.json": {
    "md5": "1f4d3aeac85feef4be1cf79d542b92e2",
    "bytes": 717
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard0of8/summary.json": {
    "md5": "d88c8316bbe94ff06d388e76e2be54e7",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "f3ff492c54e0dde1af55ba3b390cf14f",
    "bytes": 3395502
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard0of8/zero_token_ledger.json": {
    "md5": "3d1ef838ebd5802f7b8e479c3bb7c633",
    "bytes": 14
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard1of8/summary.json": {
    "md5": "22d6a8c9199d6649f487b417be9f98ca",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "15f18ed360d342ccffd1cf096c2ae5bb",
    "bytes": 1769753
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard1of8/zero_token_ledger.json": {
    "md5": "51a17c28d59400a6cb463718764074ff",
    "bytes": 31
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard2of8/summary.json": {
    "md5": "663af53e693f8f6d00da808bed996723",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "5fdd5421d49d8e5fdc392baad3fef6d5",
    "bytes": 1736794
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard3of8/summary.json": {
    "md5": "d2f95741803410cbc6879994e8ee6b8e",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "a0c3c822b30be0b24e79fe1a0a40259b",
    "bytes": 1848777
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard4of8/summary.json": {
    "md5": "cfb89e0d3f87fea75927a9869355056a",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c702b98162b6a59fcb232b7e06296b87",
    "bytes": 4504389
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard5of8/summary.json": {
    "md5": "dede0fa455341bfe57d3880a02725240",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "ddcb7801b6f0a95acffc7692d68d3a0a",
    "bytes": 2666129
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard5of8/zero_token_ledger.json": {
    "md5": "1d4db64bedeb00abbad55b53f56b2901",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard6of8/summary.json": {
    "md5": "9085f7b7fb251df5773d7de1a7375f13",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e96480f9aa0ac5c948301dfb40ca6969",
    "bytes": 2675787
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard7of8/summary.json": {
    "md5": "1cdf946b19756fad5894aa4d14fe93bd",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "62d99789bbdecaa19fd02cb554aa4629",
    "bytes": 818888
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed43/shard7of8/zero_token_ledger.json": {
    "md5": "efc2ee88ee7c3af076c4cfc518ce189a",
    "bytes": 41
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/run_summary.json": {
    "md5": "00e91e24ba79fa4566be61b33f937cd1",
    "bytes": 720
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard0of8/summary.json": {
    "md5": "066280570ece961816a00ae83296c583",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard0of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "93e03dbb8def275f9099560c3e33bbcc",
    "bytes": 3427211
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard1of8/summary.json": {
    "md5": "62062959217367f5c38def460918f0ed",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard1of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "9262d062717cf29461966be7b7b9adb0",
    "bytes": 1800759
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard1of8/zero_token_ledger.json": {
    "md5": "a787728d8bed2fa807a4637e3e49aee0",
    "bytes": 44
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard2of8/summary.json": {
    "md5": "a51733c414865e74f612337bbf588af6",
    "bytes": 597
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard2of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "27d4c8d0393c63c80dd139c5b4db63a1",
    "bytes": 1750749
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard3of8/summary.json": {
    "md5": "0d59756ddf0244d24d68b2558123507e",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard3of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "1bcda46aac8bce02b74d904fcfc456c5",
    "bytes": 1847950
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard3of8/zero_token_ledger.json": {
    "md5": "e526e8fd3d65fbc32fa8698ad7387ef1",
    "bytes": 15
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard4of8/summary.json": {
    "md5": "a7d5035c1ac50c065cc389b8955e647b",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard4of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "2bc08d23adc1b3a73ef4e8fbd4eb1a0c",
    "bytes": 4481121
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard5of8/summary.json": {
    "md5": "90a501a74eab71aaf5946dfa88da1828",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard5of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "c2caacb0fe8b07e5452c030ab52811c8",
    "bytes": 2647702
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard5of8/zero_token_ledger.json": {
    "md5": "1d4db64bedeb00abbad55b53f56b2901",
    "bytes": 32
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard6of8/summary.json": {
    "md5": "a9473edae4450a8e1c236b0c04fcabdd",
    "bytes": 599
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard6of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "e3e80c2ab0028245f4a22b059bfceed3",
    "bytes": 2694454
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard7of8/summary.json": {
    "md5": "270a0d8605ebf0c2b4416bec4bfb99fa",
    "bytes": 598
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard7of8/swebench-verified_1.0/verified_log.jsonl": {
    "md5": "3715687ff7c5d6efc0016bae12a7b3c1",
    "bytes": 814262
   },
   "/lustre/fsw/portfolios/nvr/users/hcai/jqs/eval/qwen3.8-27b/method_fp8kv_s1/swebench/seed44/shard7of8/zero_token_ledger.json": {
    "md5": "62d720765c93f6bc8d80c286c50b708d",
    "bytes": 71
   }
  },
  "original_swe_report": "| model | arm | pass@1 per seed, % (passed/rows; * = still running, rate over rows so far) | mean +/- std (finished seeds once any has finished) | vs dense | paired vs dense (both completed, same seed) |\n|---|---|---|---|---|---|\n| qwen3.8-27b | dense_s1 | 80.8 (404/500) / 87.0 (435/500) / 80.4 (402/500) | 82.7 +/- 3.7 | -- | -- |\n| qwen3.8-27b | fp8kv_s1 | 85.4 (427/500) / 90.0 (450/500) / 86.0 (430/500) | 87.1 +/- 2.5 | -- | -- |\n| qwen3.8-27b | blasst_t50_s1 | 85.6 (428/500) / 89.4 (447/500) / 85.8 (429/500) | 86.9 +/- 2.1 | -- | -- |\n| qwen3.8-27b | dense_s1d | 85.0 (425/500) / 91.4 (457/500) / 86.2 (431/500) | 87.5 +/- 3.4 | -- | -- |\n| qwen3.6-35b-a3b | dense_s1 | 68.2 (341/500) / 70.0 (350/500) / 67.2 (336/500) | 68.5 +/- 1.4 | -- | -- |\n| qwen3.6-35b-a3b | fp8kv_s1 | 69.0 (345/500) / 68.0 (340/500) / 69.4 (347/500) | 68.8 +/- 0.7 | -- | -- |\n| qwen3.6-35b-a3b | blasst_t50_s1 | 69.8 (349/500) / 69.0 (345/500) / 71.2 (356/500) | 70.0 +/- 1.1 | -- | -- |\n| nemotron3-nano | dense_s1 | 21.8 (109/500) / 23.8 (119/500) / 20.2 (101/500) | 21.9 +/- 1.8 | -- | -- |\n| nemotron3-nano | fp8kv_s1 | 22.6 (113/500) / 23.8 (119/500) / 22.6 (113/500) | 23.0 +/- 0.7 | -- | -- |\n| nemotron3-nano | blasst_t50_s1 | 24.2 (121/500) / 23.0 (115/500) / 20.6 (103/500) | 22.6 +/- 1.8 | -- | -- |\n| nemotron3.5-lightning | dense_s1 | 48.2 (241/500) / 48.6 (243/500) / 48.4 (242/500) | 48.4 +/- 0.2 | -- | -- |\n| nemotron3.5-lightning | fp8kv_s1 | 51.8 (259/500) / 50.2 (251/500) / 48.6 (243/500) | 50.2 +/- 1.6 | -- | -- |\n| nemotron3.5-lightning | blasst_t50_s1 | 51.6 (258/500) / 51.0 (255/500) / 49.2 (246/500) | 50.6 +/- 1.2 | -- | -- |\n\nFailure modes (summed over seeds; timeouts from the instance latency vs run_timeout 5400 s; HTTP codes from model_traffic.jsonl):\n\n| model | arm | seeds (rows) | pass@1 over rows | no_report (0 tok) | agent timeouts (>= 90 min) | infra_error rows | system_error rows | solver-failed (graceful) | agent crashed | never called a tool (>= 5 calls, 0 tool_calls) | responses without a tool call (tool errors) | reward MISSING | HTTP 400 calls (instances) | other >= 400 | calls | truncated @16K | median instance min | pass@1 excl. infra + system + timeouts | harbor-log: timeouts / one-shot fallbacks / re-clones |\n|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|\n| qwen3.8-27b | dense_s1 | 42:500 43:500 44:500 | 82.7 (1241/1500) | 2 | 4 | 2 | 0 | 0 | 0 | 0 | 1.8% | 0 | 0 (0) | 0 | 113004 | 0.5% | 15.6 | 82.8 (1239/1496) | 0 / 0 / 0 |\n| qwen3.8-27b | fp8kv_s1 | 42:500 43:500 44:500 | 87.1 (1307/1500) | 3 | 4 | 3 | 0 | 0 | 0 | 0 | 1.4% | 0 | 0 (0) | 0 | 110428 | 0.7% | 19.5 | 87.3 (1306/1496) | 39 / 0 / 0 |\n| qwen3.8-27b | blasst_t50_s1 | 42:500 43:500 44:500 | 86.9 (1304/1500) | 4 | 8 | 4 | 0 | 0 | 0 | 0 | 1.5% | 0 | 0 (0) | 0 | 113660 | 0.8% | 20.6 | 87.1 (1300/1492) | 62 / 0 / 0 |\n| qwen3.8-27b | dense_s1d | 42:500 43:500 44:500 | 87.5 (1313/1500) | 6 | 8 | 6 | 0 | 0 | 0 | 0 | 1.5% | 0 | 0 (0) | 0 | 112111 | 0.9% | 20.6 | 87.9 (1311/1492) | 0 / 0 / 0 |\n| qwen3.6-35b-a3b | dense_s1 | 42:500 43:500 44:500 | 68.5 (1027/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4.3% | 0 | 0 (0) | 0 | 121201 | 0.0% | 4.6 | 68.5 (1027/1500) | 0 / 0 / 0 |\n| qwen3.6-35b-a3b | fp8kv_s1 | 42:500 43:500 44:500 | 68.8 (1032/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4.4% | 0 | 0 (0) | 0 | 119914 | 0.0% | 4.5 | 68.8 (1032/1500) | 0 / 0 / 0 |\n| qwen3.6-35b-a3b | blasst_t50_s1 | 42:500 43:500 44:500 | 70.0 (1050/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4.3% | 0 | 0 (0) | 0 | 118936 | 0.0% | 4.7 | 70.0 (1050/1500) | 0 / 0 / 0 |\n| nemotron3-nano | dense_s1 | 42:500 43:500 44:500 | 21.9 (329/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14.4% | 0 | 0 (0) | 0 | 141245 | 2.0% | 5.3 | 21.9 (329/1500) | 0 / 0 / 0 |\n| nemotron3-nano | fp8kv_s1 | 42:500 43:500 44:500 | 23.0 (345/1500) | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 15.8% | 0 | 0 (0) | 0 | 139850 | 1.9% | 5.4 | 23.0 (345/1499) | 1 / 0 / 0 |\n| nemotron3-nano | blasst_t50_s1 | 42:500 43:500 44:500 | 22.6 (339/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14.5% | 0 | 0 (0) | 0 | 137541 | 2.2% | 5.4 | 22.6 (339/1500) | 3 / 0 / 0 |\n| nemotron3.5-lightning | dense_s1 | 42:500 43:500 44:500 | 48.4 (726/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.6% | 0 | 1 (1) | 0 | 115855 | 0.0% | 5.2 | 48.4 (726/1500) | 0 / 0 / 0 |\n| nemotron3.5-lightning | fp8kv_s1 | 42:500 43:500 44:500 | 50.2 (753/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.4% | 0 | 1 (1) | 0 | 123152 | 0.0% | 5.6 | 50.2 (753/1500) | 0 / 0 / 0 |\n| nemotron3.5-lightning | blasst_t50_s1 | 42:500 43:500 44:500 | 50.6 (759/1500) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.4% | 0 | 3 (3) | 0 | 114330 | 0.0% | 5.4 | 50.6 (759/1500) | 0 / 0 / 0 |\n",
  "models": {
   "qwen3.8-27b": "Qwen3.8-27B",
   "qwen3.6-35b-a3b": "Qwen3.6-35B-A3B",
   "nemotron3-nano": "Nemotron-3-Nano-30B-A3B",
   "nemotron3.5-lightning": "Nemotron-3.5-Lightning-30B-A3B"
  },
  "fp8_fragment_md5": "31dc1955854b7dbf6a33ec1135851be0",
  "blasst_fragment_md5": "aac345fed4553c65320499d74a0aff00"
 },
 "integrity_exposure_evidence": [
  {
   "arm": "dense_sxs",
   "seed": 42,
   "instance": "django__django-13315",
   "problem_index": 106,
   "attempt": "293554_0",
   "read": "notes"
  },
  {
   "arm": "dense_sxs",
   "seed": 43,
   "instance": "sympy__sympy-18763",
   "problem_index": 467,
   "attempt": "293769_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_dense_sxs",
   "seed": 42,
   "instance": "sympy__sympy-14248",
   "problem_index": 443,
   "attempt": "293602_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_r60_sxs",
   "seed": 42,
   "instance": "sympy__sympy-15599",
   "problem_index": 450,
   "attempt": "293610_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_r60_sxs",
   "seed": 42,
   "instance": "sympy__sympy-22080",
   "problem_index": 485,
   "attempt": "293610_1",
   "read": "notes; also attempted _q4"
  },
  {
   "arm": "jqs_f_r60_sxs",
   "seed": 43,
   "instance": "sympy__sympy-21930",
   "problem_index": 484,
   "attempt": "293768_0",
   "read": "notes and patch"
  },
  {
   "arm": "jqs_f_u128_sxs",
   "seed": 42,
   "instance": "sympy__sympy-24661",
   "problem_index": 499,
   "attempt": "293611_1",
   "read": "patch"
  },
  {
   "arm": "jqs_f_u128_sxs",
   "seed": 42,
   "instance": "django__django-14140",
   "problem_index": 144,
   "attempt": "293711_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_u128_sxs",
   "seed": 44,
   "instance": "sphinx-doc__sphinx-9711",
   "problem_index": 424,
   "attempt": "293730_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_u32_sxs",
   "seed": 42,
   "instance": "sympy__sympy-13798",
   "problem_index": 438,
   "attempt": "293605_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_u32_sxs",
   "seed": 44,
   "instance": "django__django-14771",
   "problem_index": 168,
   "attempt": "304328_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_u64_sxs",
   "seed": 44,
   "instance": "django__django-13837",
   "problem_index": 133,
   "attempt": "293696_0",
   "read": "patch"
  },
  {
   "arm": "jqs_f_u64_sxs",
   "seed": 42,
   "instance": "scikit-learn__scikit-learn-26194",
   "problem_index": 378,
   "attempt": "293684_0",
   "read": "patch"
  },
  {
   "arm": "blasst_t50_s1_sxs",
   "seed": 42,
   "instance": "sympy__sympy-13615",
   "problem_index": 435,
   "attempt": "293677_1",
   "read": "partial notes"
  },
  {
   "arm": "fp8kv_s1_sxs",
   "seed": 42,
   "instance": "matplotlib__matplotlib-21568",
   "problem_index": 259,
   "attempt": "293534_1",
   "read": "full patch, later full notes; matching-task edit"
  },
  {
   "arm": "fp8kv_s1_sxs",
   "seed": 43,
   "instance": "sympy__sympy-16597",
   "problem_index": 455,
   "attempt": "293770_0",
   "read": "patch"
  },
  {
   "arm": "fp8kv_s1_sxs",
   "seed": 44,
   "instance": "sympy__sympy-13798",
   "problem_index": 438,
   "attempt": "293718_0",
   "read": "patch"
  },
  {
   "arm": "loki_k25_d25_s1_sxs",
   "seed": 42,
   "instance": "django__django-12308",
   "problem_index": 80,
   "attempt": "293552_0",
   "read": "notes"
  },
  {
   "arm": "tri_b4096_s1_sxs",
   "seed": 43,
   "instance": "psf__requests-2317",
   "problem_index": 294,
   "attempt": "293578_0",
   "read": "patch header only"
  },
  {
   "arm": "tri_b4096_s1_sxs",
   "seed": 44,
   "instance": "django__django-11206",
   "problem_index": 39,
   "attempt": "293669_0",
   "read": "patch"
  }
 ],
 "archival_interpretation": "All computed family, arm-status and sensitivity labels are hypothetical diagnostics under compromised conditions, not accepted main-study verdicts. Original main reading and caveats remain in force.",
 "publication_scope": {
  "sxs_seed_runs": 39,
  "earlier_two_baseline_seed_runs": 24,
  "earlier_new_dense_control_seed_runs": 3,
  "total_new_seed_results_archived": 75,
  "task_subset_applied": false,
  "ctl2_new_dense_control_seed_runs": 9
 },
 "presentation_finished": "2026-10-28T15:55:26.200902-07:00",
 "ctl2_swe_backup": {
  "source": "log/sparse/dev/bigmodels/bl2/ctl2/ctl2_gate.json",
  "source_md5": "e4547508d2c2243dcd6d158a4b3463be",
  "P2_source": "log/sparse/dev/bigmodels/bl2/stage_tbp2/regen/P2/ctl2_gate.json",
  "P2_source_md5": "d1731bc9e4d8fd44739becc92e248380",
  "SWE_cells_unchanged_by_P2": true,
  "registered_rule": "p < 0.05 = effect per cell; else no detected effect with MDD80; BH q over the cells descriptive",
  "cells": {
   "qwen3.6-35b-a3b|swe": {
    "status": "complete",
    "seed_tuple": [
     20261023,
     78,
     1,
     1
    ],
    "contrast": {
     "model": "qwen3.6-35b-a3b",
     "bench": "swe",
     "a": "dense_s1e",
     "b": "dense_s1",
     "label": "bf16 dense_s1e (same-window control) vs bf16 S1",
     "n_items": 1500,
     "n_clusters": 500,
     "n_diff_items": 161,
     "a_only": 87,
     "b_only": 74,
     "mean_a": 69.33333333333333,
     "mean_b": 68.46666666666667,
     "rate_a": 69.33333333333333,
     "rate_b": 68.46666666666665,
     "delta": 0.8666666666666667,
     "ci95": [
      -0.8871989877226512,
      2.627939144285902
     ],
     "ci95_bootstrap": [
      -0.9333333333333333,
      2.6666666666666665
     ],
     "se": 0.9112808382277422,
     "p": 0.3731626837316268,
     "mid_p": 0.3354,
     "per_seed": {
      "42": 0.0,
      "43": 0.0,
      "44": 2.6
     },
     "p_het": 0.34326567343265674
    },
    "mdd80": 2.5122806102407598,
    "verdict": "no detected effect",
    "reading": "dense_s1e - dense_s1 +0.87 [-0.89, +2.63] p 0.3732: no detected effect (MDD80 2.51 points): the published dense bf16 is reproduced at that resolution; bl2's rows of this cell are comparable with the published arms (disclosures)",
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "delta": 1.0775862068965518,
      "ci95": [
       -0.7278020396735796,
       2.8806584379311877
      ],
      "p": 0.27277272272772723,
      "n_items": 1392,
      "mean_a": 69.25287356321839,
      "mean_b": 68.17528735632185,
      "mdd80": 2.578978392956226,
      "verdict": "no detected effect",
      "shift_vs_primary": 0.21091954022988513,
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "delta": 0.4694835680751174,
      "ci95": [
       -1.1811023638189315,
       2.1248339989784313
      ],
      "p": 0.6379362063793621,
      "n_items": 1491,
      "mean_a": 69.3494299128102,
      "mean_b": 68.87994634473507,
      "mdd80": 2.3627634280761365,
      "verdict": "no detected effect",
      "shift_vs_primary": -0.3971830985915493,
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "complete",
      "delta": 0.6666666666666666,
      "ci95": [
       -1.115760113439754,
       2.4390243920415875
      ],
      "p": 0.5091490850914908,
      "n_items": 1500,
      "mean_a": 68.73333333333333,
      "mean_b": 68.06666666666666,
      "mdd80": 2.5406160017962365,
      "verdict": "no detected effect",
      "shift_vs_primary": -0.20000000000000007,
      "passes_scored_failed": {
       "dense_s1e": 9,
       "dense_s1": 6
      },
      "proven_episodes": {
       "dense_s1e": 10,
       "dense_s1": 6
      }
     }
    },
    "q": 0.48913441989134426
   },
   "nemotron3-nano|swe": {
    "status": "complete",
    "seed_tuple": [
     20261023,
     78,
     2,
     1
    ],
    "contrast": {
     "model": "nemotron3-nano",
     "bench": "swe",
     "a": "dense_s1e",
     "b": "dense_s1",
     "label": "bf16 dense_s1e (same-window control) vs bf16 S1",
     "n_items": 1500,
     "n_clusters": 500,
     "n_diff_items": 277,
     "a_only": 128,
     "b_only": 149,
     "mean_a": 20.533333333333335,
     "mean_b": 21.933333333333334,
     "rate_a": 20.533333333333335,
     "rate_b": 21.933333333333334,
     "delta": -1.4,
     "ci95": [
      -3.4578146632660802,
      0.6666666687268658
     ],
     "ci95_bootstrap": [
      -3.4,
      0.6
     ],
     "se": 1.0250810347596395,
     "p": 0.20157984201579843,
     "mid_p": 0.1807,
     "per_seed": {
      "42": -2.2,
      "43": -2.0,
      "44": 0.0
     },
     "p_het": 0.6931306869313069
    },
    "mdd80": 2.947780169237642,
    "verdict": "no detected effect",
    "reading": "dense_s1e - dense_s1 -1.40 [-3.46, +0.67] p 0.2016: no detected effect (MDD80 2.95 points): the published dense bf16 is reproduced at that resolution; bl2's rows of this cell are comparable with the published arms (disclosures)",
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "delta": -1.1494252873563218,
      "ci95": [
       -3.2904148805269746,
       1.0057471285873776
      ],
      "p": 0.31886811318868113,
      "n_items": 1392,
      "mean_a": 20.977011494252874,
      "mean_b": 22.126436781609197,
      "mdd80": 3.070480905336073,
      "verdict": "no detected effect",
      "shift_vs_primary": 0.25057471264367814,
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "delta": -1.5425888665325285,
      "ci95": [
       -3.600000002043836,
       0.5376344106820754
      ],
      "p": 0.15978402159784022,
      "n_items": 1491,
      "mean_a": 20.4560697518444,
      "mean_b": 21.99865861837693,
      "mdd80": 2.957180718646913,
      "verdict": "no detected effect",
      "shift_vs_primary": -0.14258886653252856,
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "complete",
      "delta": -1.4,
      "ci95": [
       -3.4578146632660802,
       0.6666666687268658
      ],
      "p": 0.20157984201579843,
      "n_items": 1500,
      "mean_a": 20.533333333333335,
      "mean_b": 21.933333333333334,
      "mdd80": 2.947780169237642,
      "verdict": "no detected effect",
      "shift_vs_primary": 0.0,
      "passes_scored_failed": {
       "dense_s1e": 0,
       "dense_s1": 0
      },
      "proven_episodes": {
       "dense_s1e": 1,
       "dense_s1": 0
      }
     }
    },
    "q": 0.48913441989134426
   },
   "nemotron3.5-lightning|swe": {
    "status": "complete",
    "seed_tuple": [
     20261023,
     78,
     3,
     1
    ],
    "contrast": {
     "model": "nemotron3.5-lightning",
     "bench": "swe",
     "a": "dense_s1e",
     "b": "dense_s1",
     "label": "bf16 dense_s1e (same-window control) vs bf16 S1",
     "n_items": 1500,
     "n_clusters": 500,
     "n_diff_items": 242,
     "a_only": 137,
     "b_only": 105,
     "mean_a": 50.53333333333333,
     "mean_b": 48.4,
     "rate_a": 50.53333333333334,
     "rate_b": 48.400000000000006,
     "delta": 2.1333333333333333,
     "ci95": [
      -2.0519647709860584e-09,
      4.232804234882053
     ],
     "ci95_bootstrap": [
      0.06666666666666667,
      4.2
     ],
     "se": 1.0622466169339015,
     "p": 0.0514948505149485,
     "mid_p": 0.0448,
     "per_seed": {
      "42": 2.4,
      "43": 1.2,
      "44": 2.8
     },
     "p_het": 0.7986201379862014
    },
    "mdd80": 3.025198900311208,
    "verdict": "no detected effect",
    "reading": "dense_s1e - dense_s1 +2.13 [-0.00, +4.23] p 0.0515: no detected effect (MDD80 3.03 points): the published dense bf16 is reproduced at that resolution; bl2's rows of this cell are comparable with the published arms (disclosures)",
    "sensitivities": {
     "drop_u36": {
      "status": "complete",
      "delta": 2.1551724137931036,
      "ci95": [
       -2.076681275544791e-09,
       4.273504275597705
      ],
      "p": 0.0527947205279472,
      "n_items": 1392,
      "mean_a": 50.79022988505747,
      "mean_b": 48.63505747126437,
      "mdd80": 3.05428735127618,
      "verdict": "no detected effect",
      "shift_vs_primary": 0.021839080459770344,
      "left_out_pidx": [
       0,
       2,
       3,
       5,
       9,
       11,
       15,
       26,
       28,
       29,
       33,
       35,
       36,
       37,
       38,
       40,
       41,
       44,
       46,
       50,
       51,
       52,
       53,
       59,
       60,
       61,
       62,
       63,
       64,
       65,
       66,
       67,
       68,
       69,
       70,
       71
      ]
     },
     "drop_linkcheck": {
      "status": "complete",
      "delta": 1.743796109993293,
      "ci95": [
       -0.27662517497341466,
       3.7786774649274113
      ],
      "p": 0.10528947105289471,
      "n_items": 1491,
      "mean_a": 50.435949027498324,
      "mean_b": 48.69215291750503,
      "mdd80": 2.8983379338949464,
      "verdict": "no detected effect",
      "shift_vs_primary": -0.38953722334004026,
      "left_out_pidx": [
       397,
       402,
       404
      ]
     },
     "reads_failed": {
      "status": "complete",
      "delta": 2.1333333333333333,
      "ci95": [
       -2.0519647709860584e-09,
       4.232804234882053
      ],
      "p": 0.0514948505149485,
      "n_items": 1500,
      "mean_a": 50.46666666666667,
      "mean_b": 48.333333333333336,
      "mdd80": 3.025198900311208,
      "verdict": "no detected effect",
      "shift_vs_primary": 0.0,
      "passes_scored_failed": {
       "dense_s1e": 1,
       "dense_s1": 1
      },
      "proven_episodes": {
       "dense_s1e": 3,
       "dense_s1": 2
      }
     }
    },
    "q": 0.3604639536046395
   }
  },
  "seed_results": [
   {
    "model": "qwen3.6-35b-a3b",
    "arm": "dense_s1e",
    "seeds": [
     42,
     43,
     44
    ],
    "resolved": [
     341,
     350,
     349
    ],
    "rates": [
     68.2,
     70.0,
     69.8
    ],
    "mean": 69.33333333333333,
    "sd_sample": 0.9865765724632471,
    "derivation": "Historical dense_s1 seed counts plus saved full-1500-pair ctl2 per-seed delta; no excluded pairs."
   },
   {
    "model": "nemotron3-nano",
    "arm": "dense_s1e",
    "seeds": [
     42,
     43,
     44
    ],
    "resolved": [
     98,
     109,
     101
    ],
    "rates": [
     19.6,
     21.8,
     20.2
    ],
    "mean": 20.533333333333335,
    "sd_sample": 1.1372481406154653,
    "derivation": "Historical dense_s1 seed counts plus saved full-1500-pair ctl2 per-seed delta; no excluded pairs."
   },
   {
    "model": "nemotron3.5-lightning",
    "arm": "dense_s1e",
    "seeds": [
     42,
     43,
     44
    ],
    "resolved": [
     253,
     249,
     256
    ],
    "rates": [
     50.6,
     49.800000000000004,
     51.199999999999996
    ],
    "mean": 50.53333333333333,
    "sd_sample": 0.7023769168568451,
    "derivation": "Historical dense_s1 seed counts plus saved full-1500-pair ctl2 per-seed delta; no excluded pairs."
   }
  ],
  "status": {
   "qwen3.6-35b-a3b|swe|dense_s1e|42": [
    "done",
    ""
   ],
   "qwen3.6-35b-a3b|swe|dense_s1e|43": [
    "done",
    ""
   ],
   "qwen3.6-35b-a3b|swe|dense_s1e|44": [
    "done",
    ""
   ],
   "qwen3.6-35b-a3b|swe|dense_s1|42": [
    "done",
    ""
   ],
   "qwen3.6-35b-a3b|swe|dense_s1|43": [
    "done",
    ""
   ],
   "qwen3.6-35b-a3b|swe|dense_s1|44": [
    "done",
    ""
   ],
   "nemotron3-nano|swe|dense_s1e|42": [
    "done",
    ""
   ],
   "nemotron3-nano|swe|dense_s1e|43": [
    "done",
    ""
   ],
   "nemotron3-nano|swe|dense_s1e|44": [
    "done",
    ""
   ],
   "nemotron3-nano|swe|dense_s1|42": [
    "done",
    ""
   ],
   "nemotron3-nano|swe|dense_s1|43": [
    "done",
    ""
   ],
   "nemotron3-nano|swe|dense_s1|44": [
    "done",
    ""
   ],
   "nemotron3.5-lightning|swe|dense_s1e|42": [
    "done",
    ""
   ],
   "nemotron3.5-lightning|swe|dense_s1e|43": [
    "done",
    ""
   ],
   "nemotron3.5-lightning|swe|dense_s1e|44": [
    "done",
    ""
   ],
   "nemotron3.5-lightning|swe|dense_s1|42": [
    "done",
    ""
   ],
   "nemotron3.5-lightning|swe|dense_s1|43": [
    "done",
    ""
   ],
   "nemotron3.5-lightning|swe|dense_s1|44": [
    "done",
    ""
   ]
  },
  "void_test_source": "log/sparse/dev/bigmodels/bl2/ctl2/void_ctl2_test_1023.json",
  "void_test_md5": "d81ad463ebfca6fc4a77cd71bb7ecab5"
 },
 "publication_redactions": {
  "kind": "Private session scratch prefixes replaced; content hashes and numeric results retained",
  "occurrences": 2
 },
 "validation": {
  "independent_review": "All 39 sxs seed pass counts, 13 means/sample SDs, 41 paired contrasts, six BH families and displayed statistics checked against source; all 48 registered input pins and 672 scored-file hashes matched. Canonical outputs and completion record absent.",
  "earlier_seed_arithmetic_verified": 27,
  "ctl2_seed_arithmetic_verified": 9
 },
 "hf_sync": {
  "status": "BLOCKED; upload not started",
  "target_repo": "tturing/jqsparse",
  "repo_type": "dataset",
  "target_path": "doc/SWE_rerun.md",
  "checked_at": "2026-10-28T16:00:52.232191-07:00",
  "reason": "hf auth whoami failed: DNS resolution failure; account identity and remote tree could not be verified",
  "authorization": "User explicitly requested this backup file and its HF sync; no new authorization required to retry once recorded checks pass",
  "token_scan_new_file_hits": 0,
  "whole_doc_scan_hits": [
   {
    "file": "doc/recap.md",
    "line": 766,
    "kind": "session_scratch_path",
    "disposition": "Known existing exception; this file is outside the one-file upload"
   }
  ]
 },
 "preservation_check": {
  "existing_documentation_files_identical": 114,
  "engine_HEAD": "e3493c19863f568a2b59ea6e4ef806bc3cf69808",
  "engine_staged_paths_unchanged": 144,
  "engine_staged_diff_sha256": "a261311c42277d399e5e4c45e8c7501f7abfd15eeed80ffe63cdae47e5e6e659",
  "engine_source_changes": 0
 }
}
```

</details>

## HF sync status

**Not synced.** The final `hf auth whoami` retry failed with DNS resolution failure (`Temporary failure in name resolution`). Authenticated identity and the remote tree could not be verified, so the upload was not started. No new HF commit or remote-byte verification is claimed.

The new file passes the installed token scan with zero hits. The whole `doc/` scan has only the recorded pre-existing `doc/recap.md:766: session_scratch_path` exception; no credential-shaped strings were found. Private session scratch prefixes in this backup have been redacted. The 114 earlier documentation files and the engine's existing 144-path staged diff remain byte-identical to the audit baseline.

The user has already authorized syncing this file. When connectivity is restored, repeat the credential scan, require `hf auth whoami` to identify `tturing`, inspect the remote target, upload only this file, and verify the remote content against the local bytes using the installed LFS-aware checker filtered to `doc/SWE_rerun.md`. This avoids syncing unrelated pending files.

```bash
/lustre/fsw/portfolios/nvr/users/hcai/jqs/uv/envs/jqs/bin/hf auth whoami
/lustre/fsw/portfolios/nvr/users/hcai/jqs/uv/envs/jqs/bin/hf upload tturing/jqsparse /home/hcai/workspace/code/jet-qs/doc/SWE_rerun.md doc/SWE_rerun.md --repo-type dataset
```

Both commands run from `/home/hcai/workspace/code/jet-qs`. The failed completion gate remains unsigned regardless of whether the archival file is later synced. Canonical doc promotion, the appendix rewrite and engine staging were not performed under the superseded rerun-promotion plan.