YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

No fMRI or haemodynamic claim may be read off this model

These weights were trained through a BOLD path that never integrated the Balloon-Windkessel ODE. BOLDHead.step was not called in any of the five stages, the five haemodynamic parameters (log_kappa, log_gamma, log_tau, alpha, neural_gain) are bit-identical to their initialisation, and real_bold_nll diverged monotonically from 21.7 to 4.4e6 over the run.

ds002336_real appears in contributed_sources and that is accurate: its BOLD channel contributed a gradient and no information. The two are different statements and only the first was ever checked.

The defect is repaired in the code (ISSUE-008, closed 2026-08-09) and cannot be repaired in these weights, which cannot be un-trained. Any fMRI, haemodynamic or neurovascular claim about this artifact is unsupported.

Two further limits from the same run: the amortised posterior is well-calibrated and uninformative (R^2 ~ 0 on all six parameters), and the EEG lead field is an analytic sphere, not a head model, so no source-localisation claim is available either.


license: other license_name: see-licence-section tags: - neuroscience - eeg - brain-dynamics pretty_name: scwbd-003 (treatment arm)

scwbd-003

Read this first: this checkpoint loses to copying the last observed sample forward. It is published as a negative result and as a reference artifact for others, not as a working model. If you are looking for a brain-dynamics model that works, this is not it.

This model never saw measured data during training, and four other training mechanisms were silently off. This run renamed its training stages; six gates in the trainer match on the previous run's stage names, and five of the six therefore gave the wrong answer:

gate decides result for this run
admit measured sources refused -- no gradient was ever taken on real EEG
per-stage gradient allowlist wildcard -- no restriction applied
boundary randomisation of sim inputs off
haemodynamic state in the rollout off
build the individualizer off -- the stage named for it ran ordinary training
admit simulated sources admitted, and correct only by accident

Nothing raised, because every gate fails toward permissive: an unmatched stage name means "no restriction" rather than "unknown stage". The scores below are therefore a simulation-to-measurement transfer result from a partially configured trainer -- not a held-out-performance result -- and a stage named for measurement is not evidence that measurement occurred. See reports/RUN2.md section 2b.

The comparison below flatters this model, and the correction is not applied to the numbers. evaluate.py scores SC-WBD on y = target / s, where s is each window's own standard deviation, with the Jacobian folded into the log-variance. Every baseline is scored on the raw target. The algebra is exact and model-independent: NLL_scaled = NLL_raw - log s, so the two sides are different random variables and SC-WBD's figure is the smaller one.

Measured on this test fold, mean(log s) = 0.5694 nats -- against a spread of 0.035 nats across the three non-trivial baselines, so the offset is roughly 17x the entire spread it is being compared against. In the baselines' units SC-WBD's NLL is approximately 3.75 rather than the 3.179 tabulated, and the gap to the best baseline is about 1.70 nats rather than 1.13. MSE is off by 1/s^2 and does not cancel.

The rescale is harmless during training -- s does not depend on the parameters -- and is a pure unearned advantage at evaluation. No verdict changes: every paired interval already excluded zero and the correction moves all of them further from SC-WBD. The numbers are left as measured rather than silently adjusted, because re-scoring both sides on the raw target is the fix and arithmetic on published figures is not.

The headline

No baseline beats scwbd-003 on the paired participant-clustered 95% interval of the per-window NLL difference

Metric: gaussian NLL, nats per channel per sample, sensor space, participant-clustered 95% CI

arm NLL 95% CI MSE params
scwbd-003 ← 1.9863 [1.9417, 2.0414] 4.0001 26,304,729
var4 2.0240 [1.9644, 2.1060] 3.9853 20,544
ar16 2.0254 [1.9624, 2.1096] 4.0528 5,184
subject_specific_ar 2.0254 [1.9624, 2.1096] 4.0528 77,248
population_gaussian 2.0482 [1.9873, 2.1294] 4.1584 2,208
persistence 2.3156 [2.2469, 2.4083] 7.1628 4,096
dense_neural 9.3607 [9.2443, 9.4916] 1599.7175 26,296,869

Paired participant-clustered differences (positive = SC-WBD worse):

vs Ξ” NLL 95% CI excludes zero
var4 -0.0377 [-0.0669, -0.0169] True
ar16 -0.0391 [-0.0696, -0.0152] True
subject_specific_ar -0.0391 [-0.0696, -0.0152] True
population_gaussian -0.0619 [-0.0906, -0.0403] True
persistence -0.3293 [-0.3707, -0.2940] True
dense_neural -7.3744 [-7.5018, -7.2646] True

Why it lost β€” the diagnosis

Two things, and neither is 'the architecture does not work'. Both are documented in the repository, not inferred here.

1. It is the treatment arm, and that is still not the ablation. Regional state here is family-indexed and heterogeneous, so unlike run 1 these numbers describe the architecture the thesis argues for rather than its control. But the thesis claim is comparative -- structured regional state against pooled state at matched capacity -- and the pre-registered ablation needs five further arms that do not exist: two capacity-matched pooled controls, a scalar floor, a theta-conditioned control, and a permuted-family attribution control. Against generic forecasting baselines this artifact can lose or win without either outcome attributing anything to the structure. Read it as the candidate arm measured, not as the hypothesis tested.

2. The whole loss is in the variance channel. On the conditional mean this model beats every baseline including persistence β€” its MSE is the best in the table above. It loses on NLL because a single per-channel scalar (eeg.log_noise) sets the predictive variance, was left to SGD instead of its closed-form optimum, and ended up uniformly overconfident. The scalar cannot represent horizon-dependence at all; the baselines' variance can.

This is a useful shape to know about: a model can win on point prediction and still lose decisively on likelihood because one uncalibrated scalar dominates the score.

What it was trained on

  • Anatomy: 414 regions β€” atlas Schaefer400x7 in fsLR/32k, subcortex Aseg14T, 10 declared sources (enigma_hcp_sc, hansen_receptors, hcps1200_maps, hill2010, margulies2016, neuromaps, raichle_metabolism, schaefer2018, sydnor2021, tian2020); is_biological = True. Full provenance, including every licence and citation, is carried inside the checkpoint under extra.anatomy and in reports/anatomy_prior.md.
  • Lead field: 64 channels, provenance analytic_sphere_fallback, individual head model: False.
  • Evaluation split (this model was not fit to any of it β€” see the disclosure above; the baselines are fit to the first half): 2130 fitting windows / 71 participants; 1080 test windows / 27 participants, participant-disjoint.

Known defects

  • The hardest baseline was not actually run, and reports itself healthy. subject_specific_ar is bit-for-bit identical to ar16: the participant-disjoint split leaves no test participant with a fitted model, so every scored window routes to the pooled fallback. Its own describe() reports n_subject_models=8, fallback_subjects=0 β€” which reads as healthy. A field only ever written on success is not a record. Read the table as five distinct comparators, not six, and note that the strongest one the thesis names is absent.
  • Individualisation cannot be measured on this holdout at all β€” not by retraining, not by patching the evaluation. Refusal R10 makes the folds participant-disjoint, so no held-out person has a fitted person effect: the between-participant spread of the applied theta shift on the test fold is exactly 0.000e+00. Every held-out person receives the identical population term. Measuring individualisation needs a within-participant temporal split, reported as a different claim. This is a property of the design, not a defect of this run, and it is why the individualisation figures here are absent rather than poor.
  • Five of six training-stage gates gave the wrong answer (see the disclosure at the top). No measured-data gradient, no per-stage gradient restriction, no boundary randomisation, no haemodynamic state in the rollout, and no individualizer. A complete fix existed in the repository before this run started and was not applied; six tests naming the defect were failing on the main branch throughout. This is the defect that most changes how the scores should be read.
  • The modules ['tau_prior'] are named by no card's gradient_permission. They carry no parameters in this checkpoint's parameter report, so the share of the model that could not receive a gradient is 0.0% -- this is a completeness note about the cards, not a finding about the weights. Computed from the source cards at 57e98e5, the commit this checkpoint records. That commit is recorded with a -dirty suffix, so the tree that trained carried uncommitted changes and the cards it used may differ from the cards at the commit.
  • Two baselines in the table, ar16 and subject_specific_ar, are bit-identical: the participant-disjoint split routes every test window to the ar16 fallback. Read the table as four distinct baselines.

What it is legitimately good for

  • A treatment-arm artifact: family-indexed heterogeneous regional state with published weights and a published loss, for anyone running the same ablation against their own control β€” provided that control is trained the same way. These weights saw simulation only (see above), so a control fitted to recordings is not a comparison of state structure; it is a comparison of what each model was shown.
  • A worked example of a variance-channel failure, with the mean/variance decomposition available in the repository.
  • It is not evidence for or against the SC-WBD thesis.

Licence and attribution

Computed union: non-commercial: yes; share-alike: yes; attribution: required; redistribution: unknown; SHARE-ALIKE IN FORCE: derivative works must be released under the same licence; 1 source(s) with UNKNOWN licence (montage_calibration) β€” unknown is not permissive

  • non-commercial: True
    • forced by: anatomical_prior
  • share-alike: True
    • forced by: anatomical_prior
  • sources stating no terms: montage_calibration

These are derived from each source's own licence text by scwbd.release.licence.union_of, not asserted here.

Citations (a licence condition, not a courtesy)

The Melbourne Subcortex Atlas grants unrestricted use subject to citation; several other inputs carry attribution as their only obligation. Using this artifact requires reproducing these:

  • Wakeman DG, Henson RN (2015). A multi-subject, multi-modal human neuroimaging dataset. Scientific Data 2:150001, doi:10.1038/sdata.2015.1. OpenNeuro dataset ds000117 v1.1.0, doi:10.18112/openneuro.ds000117.v1.1.0.
  • Lioi G, Cury C, Perronnet L, Mano M, Bannier E, Lecuyer A, Barillot C (2020). Simultaneous MRI-EEG during a motor imagery neurofeedback task: an open access brain imaging dataset for multi-modal data integration. Scientific Data 7:173, doi:10.1038/s41597-020-0498-3. OpenNeuro dataset ds002336 v2.0.2, doi:10.18112/openneuro.ds002336.v2.0.2. Paradigm: Perronnet L et al. (2017), Front Hum Neurosci 11:193.
  • Hernandez Pavon JC, Schneider Garces N, Begnoche JP, Miller LE, Raij T (2022). OpenNeuro dataset ds004024, doi:10.18112/openneuro.ds004024.v1.0.0. Cortico-cortical paired associative stimulation (ccPAS) with bi-focal MRI-navigated TMS-EEG of left and right M1.
  • Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR (2004). BCI2000: A General-Purpose Brain-Computer Interface (BCI) System. IEEE Trans Biomed Eng 51(6):1034-1043. Dataset: Schalk G (2009), EEG Motor Movement/Imagery Dataset (version 1.0.0), PhysioNet, RRID:SCR_007345, https://doi.org/10.13026/C28G6P
  • Kemp B, Zwinderman AH, Tuk B, Kamphuisen HAC, Oberye JJL (2000). Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng 47(9):1185-1194. Dataset: Kemp B, Zwinderman AH, Tuk B, Kamphuisen HAC, Oberye JJL. Sleep-EDF Database Expanded (version 1.0.0), PhysioNet, https://doi.org/10.13026/C2X676
Full attribution block (generated)
ATTRIBUTION
checkpoint: scwbd-003
============================================================

DATASET INPUTS (7)
  ds000117 (dataset)
    cite:    Wakeman DG, Henson RN (2015). A multi-subject, multi-modal human neuroimaging dataset. Scientific Data 2:150001, doi:10.1038/sdata.2015.1. OpenNeuro dataset ds000117 v1.1.0, doi:10.18112/openneuro.ds000117.v1.1.0.
    licence: [CC0-1.0] CC0 1.0 Universal (public domain dedication)
    doi:     10.18112/openneuro.ds000117.v1.1.0
    from:    scwbd/sources/cards/ds000117.yaml
  ds000117 (dataset)
    cite:    Wakeman DG, Henson RN (2015). A multi-subject, multi-modal human neuroimaging dataset. Scientific Data 2:150001, doi:10.1038/sdata.2015.1. OpenNeuro dataset ds000117 v1.1.0, doi:10.18112/openneuro.ds000117.v1.1.0.
    licence: [CC0-1.0] CC0 1.0 Universal (public domain dedication)
    doi:     10.18112/openneuro.ds000117.v1.1.0
    from:    scwbd/sources/cards/ds000117.yaml
  ds002336 (dataset)
    cite:    Lioi G, Cury C, Perronnet L, Mano M, Bannier E, Lecuyer A, Barillot C (2020). Simultaneous MRI-EEG during a motor imagery neurofeedback task: an open access brain imaging dataset for multi-modal data integration. Scientific Data 7:173, doi:10.1038/s41597-020-0498-3. OpenNeuro dataset ds002336 v2.0.2, doi:10.18112/openneuro.ds002336.v2.0.2. Paradigm: Perronnet L et al. (2017), Front Hum Neurosci 11:193.
    licence: [CC0-1.0] CC0 1.0 Universal (public domain dedication)
    doi:     10.18112/openneuro.ds002336.v2.0.2
    from:    scwbd/sources/cards/ds002336.yaml
  ds004024 (dataset)
    cite:    Hernandez Pavon JC, Schneider Garces N, Begnoche JP, Miller LE, Raij T (2022). OpenNeuro dataset ds004024, doi:10.18112/openneuro.ds004024.v1.0.0. Cortico-cortical paired associative stimulation (ccPAS) with bi-focal MRI-navigated TMS-EEG of left and right M1.
    licence: [CC0-1.0] CC0 1.0 Universal (public domain dedication)
    doi:     10.18112/openneuro.ds004024.v1.0.0
    from:    scwbd/sources/cards/ds004024.yaml
  ds004024 (dataset)
    cite:    Hernandez Pavon JC, Schneider Garces N, Begnoche JP, Miller LE, Raij T (2022). OpenNeuro dataset ds004024, doi:10.18112/openneuro.ds004024.v1.0.0. Cortico-cortical paired associative stimulation (ccPAS) with bi-focal MRI-navigated TMS-EEG of left and right M1.
    licence: [CC0-1.0] CC0 1.0 Universal (public domain dedication)
    doi:     10.18112/openneuro.ds004024.v1.0.0
    from:    scwbd/sources/cards/ds004024.yaml
  eegmmidb (dataset)
    cite:    Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR (2004). BCI2000: A General-Purpose Brain-Computer Interface (BCI) System. IEEE Trans Biomed Eng 51(6):1034-1043. Dataset: Schalk G (2009), EEG Motor Movement/Imagery Dataset (version 1.0.0), PhysioNet, RRID:SCR_007345, https://doi.org/10.13026/C28G6P
    licence: [ODC-By-1.0] Open Data Commons Attribution License v1.0 (ODC-By 1.0)
    doi:     10.13026/C28G6P
    from:    scwbd/sources/cards/eegmmidb.yaml
  sleep-edfx (dataset)
    cite:    Kemp B, Zwinderman AH, Tuk B, Kamphuisen HAC, Oberye JJL (2000). Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng 47(9):1185-1194. Dataset: Kemp B, Zwinderman AH, Tuk B, Kamphuisen HAC, Oberye JJL. Sleep-EDF Database Expanded (version 1.0.0), PhysioNet, https://doi.org/10.13026/C2X676
    licence: [ODC-By-1.0] Open Data Commons Attribution License v1.0 (ODC-By 1.0)
    doi:     10.13026/C2X676
    from:    scwbd/sources/cards/sleep-edfx.yaml

The project

Source code: https://github.com/JacobFV/sc-wbd

The SC-WBD repository itself is licensed CC-BY-NC-SA-4.0, the most restrictive term any of its inputs imposes. Treat that as a floor: the licence section above is computed from this artifact's own inputs and an artifact can inherit more than the floor, never less.

This is research code. It is not a medical device, not a clinical tool, and nothing here should be used to make a decision about a person.

How this card was produced

Every figure above was read at build time from a file in the SC-WBD repository by scwbd/release/publish.py. None of them is typed into the card generator. The sources:

  • reports/training/evaluation_run3.json β€” every score, CI, parameter count and split size
  • configs/scwbd_001_beta.yaml β€” the training mixture
  • scwbd/sources/cards/*.yaml β€” dataset citations and licences
  • reports/scope_gap.md, reports/training/p0_variance_channel.md β€” the two diagnoses, stated in prose above
Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support