diff --git a/README.md b/README.md index 3c7c6a10d0d6f251612d9fbc86faab06d66fd918..52c4b74387c9a13f07d9bd0efdffcb6c03a9b184 100644 --- a/README.md +++ b/README.md @@ -1,3 +1,169 @@ --- license: cc-by-nc-sa-4.0 +tags: + - pathology + - computational-pathology + - histopathology + - multiple-instance-learning + - whole-slide-images + - prostate-cancer + - medical-imaging + - pytorch --- + +# Artifact-aware MIL heads for prostate biopsy ISUP grading + +Trained multiple instance learning (MIL) heads from the paper *Aggregation, +Ordinal Training, and Artifact Gating in Multiple Instance Learning for +Prostate Biopsy Grading*. Each model maps a bag of frozen Virchow2 patch +embeddings from one prostate biopsy whole-slide image to an ISUP grade group +(0–5). + +Code, data split and result files: + +> **Research use only. Not for clinical use.** These models have not been +> validated for diagnosis or treatment decisions and are not a medical device. + +## Contents + +30 models, the members of every ensemble reported in the paper. Each folder +holds `best_model.safetensors` (weights only), the run's recorded +`config.json`, and `release_info.json` (best epoch, validation QWK, SHA-256). + +| Folder | Members | Aggregator | Loss | Gate | Protocol | +| --- | --- | --- | --- | --- | --- | +| `virchow2_transmil_focal_nogate_5seed/` | `seed0`–`seed4` | TransMIL-style, 2 layers | focal | none | fixed split, 5 seeds | +| `virchow2_transmil_focal_maskgate_5seed/` | `seed0`–`seed4` | TransMIL-style, 2 layers | focal | mask-only | fixed split, 5 seeds | +| `virchow2_transmil_focal_fullgate_5seed/` | `seed0`–`seed4` | TransMIL-style, 2 layers | focal | full robust | fixed split, 5 seeds | +| `virchow2_abmil_focal_maskgate_5seed/` | `seed0`–`seed4` | ABMIL | focal | mask-only | fixed split, 5 seeds | +| `virchow2_transmil_coral_maskgate_5fold/` | `fold_1`–`fold_5` | TransMIL-style, 2 layers | CORAL | mask-only | 5-fold CV | +| `virchow2_transmil_coral_fullgate_5fold/` | `fold_1`–`fold_5` | TransMIL-style, 2 layers | CORAL | full robust | 5-fold CV | + +The mask-only and full robust gate variants implement the same model: flagged +tokens are excluded from attention in both, so the attenuation factor α does +not change the output. Their differences are run-to-run (replicate) +differences. α was not logged for any run; the evaluation code uses the +default α = 1e-4. + +Total size about 4.1 GB (TransMIL-style members 163 MB each, ABMIL members +6 MB each). The weights were exported from the training checkpoints with +`scripts/training/export_weights.py` in the code repository; for every model +the exported weights give identical logits to the original checkpoint. + +## Input + +The models do **not** contain an image encoder. Each slide must be converted +to a bag saved as a `.pt` file with: + +| Key | Shape | Content | +| --- | --- | --- | +| `embeddings` | `[N, 1280]` | Virchow2 CLS token of each tissue patch | +| `spatial_variances` | `[N]` | variance of the Laplacian of the grayscale patch, used by the gate | +| `coords` | `[N, 2]` | patch level-0 coordinates (used only for heatmaps) | + +Patches are 256 × 256 pixels at level 0 (nominal 20×), Macenko stain +normalization with a fixed reference, resized to 224 × 224 for Virchow2. The +code repository's `scripts/preprocessing/preprocess.py` and +`scripts/feature_extraction/extract_features.py` produce these bags. + +**Virchow2 weights are not included.** Request access to +[`paige-ai/Virchow2`](https://huggingface.co/paige-ai/Virchow2) and use it +under its own license terms. + +## Output + +- Focal-loss models: 6 logits (ISUP 0–5); class probabilities by softmax. +- CORAL models: 5 ordinal threshold logits; class probabilities by + differencing the cumulative sigmoids, clipping at 0 and renormalizing. + +Ensembles average the class probabilities of their members. + +## Usage + +```bash +git clone https://github.com/PathOS-Code/artifact-aware-mil-prostate.git +cd artifact-aware-mil-prostate +uv sync +hf download PathOS-Code/artifact-aware-mil-prostate --local-dir weights + +uv run python scripts/evaluation/ensemble_eval.py \ + --exp-dirs weights/virchow2_transmil_focal_fullgate_5seed/seed{0,1,2,3,4} \ + --embeddings-dir outputs/embeddings_virchow2 \ + --labels-csv data/panda_labels.csv \ + --split-csv splits/panda_fixed_split.csv \ + --out outputs/ensembles/panda_focal_fullgate_5seed.json +``` + +For an external cohort, pass its embeddings and labels CSV with +`--val-ratio 0 --test-ratio 0` to evaluate every slide. See `REPRODUCE.md` in +the code repository for all experiments. + +## Results + +From the paper and the result files in the code repository (`results/`). +QWK = quadratic weighted kappa. + +PANDA held-out test split (1,061 slides; 10,614 slides overall from Radboud +and Karolinska): + +| Ensemble | Test QWK | +| --- | --- | +| TransMIL-style, focal, no gate, 5 seeds | 0.9063 | +| TransMIL-style, focal, mask-only, 5 seeds | 0.9104 | +| TransMIL-style, focal, full robust gate, 5 seeds | 0.9134 (95% CI 0.8856–0.9368) | +| ABMIL, focal, mask-only, 5 seeds | 0.8919 | + +PANDA five-fold cross-validation (out-of-fold QWK, optimistic): CORAL +mask-only 0.9226, CORAL full robust gate 0.9227. + +External cohorts, direct transfer without fine-tuning: + +| Ensemble | SICAPv2 (155 biopsies) | CrowdGleason (232 slide identifiers) | +| --- | --- | --- | +| TransMIL-style, focal, no gate, 5 seeds | 0.8664 | 0.8076 | +| TransMIL-style, focal, mask-only, 5 seeds | 0.8633 | 0.8028 | +| TransMIL-style, focal, full robust gate, 5 seeds | 0.8482 | 0.8076 | +| TransMIL-style, CORAL, mask-only, 5 folds | 0.8760 | 0.8109 | +| TransMIL-style, CORAL, full robust gate, 5 folds | 0.8772 (95% CI 0.803–0.933) | 0.8080 (95% CI 0.733–0.871) | + +Caveats, as stated in the paper: + +- The PANDA test ensemble was the best of three ensembles, selected post hoc + after exploratory runs that included the test slides. +- None of the paired gated-versus-ungated QWK intervals excluded zero; no + statistically detectable gating effect was found, and gate firing was not + measured. +- All intervals treat slides as independent and ignore patient clustering. +- CrowdGleason slide labels are surrogates derived from patch labels. +- Aggregator and ordinal-loss contrasts are confounded and descriptive. +- Training is not bit-wise reproducible; retrained models differ slightly. + +## Limitations + +- Developed on PANDA only (two institutions, routine-practice labels); + external evaluation covers two small public cohorts. +- Performance under other scanners, stains, tissue preparation or patient + populations is unknown. +- Grade groups are predicted per slide; no localization of Gleason patterns + is provided by these heads. +- Depends on Virchow2 embeddings; other encoders will not work with these + weights. + +## License + +The weights are released under +[CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) +because they were trained on PANDA (CC BY-NC-SA 4.0): noncommercial use, +attribution required, derivatives under the same license. The code in the +GitHub repository is under the PolyForm Noncommercial License 1.0.0. + +## Citation + +```bibtex +@article{TODO, + title = {Aggregation, Ordinal Training, and Artifact Gating in Multiple Instance Learning for Prostate Biopsy Grading}, + author = {TODO}, + journal = {TODO}, + year = {TODO} +} +``` diff --git a/virchow2_abmil_focal_maskgate_5seed/seed0/best_model.safetensors b/virchow2_abmil_focal_maskgate_5seed/seed0/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..65caf4240ccd2994e40b9728c121509aff268939 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed0/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6232708782c90705c4f5a7fe737fd434cf0310cb2f1eeb2eed1864caf256fe64 +size 5920172 diff --git a/virchow2_abmil_focal_maskgate_5seed/seed0/config.json b/virchow2_abmil_focal_maskgate_5seed/seed0/config.json new file mode 100644 index 0000000000000000000000000000000000000000..eb0f95282ba298a92a4c46c266a54b2871ea0351 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed0/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_abmil_gated_seed0", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.25, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": false, + "epochs": 50, + "learning_rate": 0.0001, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": "N/A", + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 1479815, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 0, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_abmil_focal_maskgate_5seed/seed0/release_info.json b/virchow2_abmil_focal_maskgate_5seed/seed0/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..11e76b0a01e1bdd75f3ac34ce1ea6cf895f336cf --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed0/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_abmil_focal_maskgate_5seed/seed0", + "best_epoch": 27, + "best_val_qwk": 0.9077715569794771, + "n_parameters": 1479815, + "weights_sha256": "6232708782c90705c4f5a7fe737fd434cf0310cb2f1eeb2eed1864caf256fe64", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_abmil_focal_maskgate_5seed/seed1/best_model.safetensors b/virchow2_abmil_focal_maskgate_5seed/seed1/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..798e4ec0e34c192199b769488a0f79fd34d8f16e --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed1/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:68740082c74008a4cb131dae8dda8b95223a19a45f74ed1d9bdeed746b4b49e9 +size 5920172 diff --git a/virchow2_abmil_focal_maskgate_5seed/seed1/config.json b/virchow2_abmil_focal_maskgate_5seed/seed1/config.json new file mode 100644 index 0000000000000000000000000000000000000000..ec7216b8e178c7a4fcb5496253fafc8045986ba8 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed1/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_abmil_gated_seed1", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.25, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": false, + "epochs": 50, + "learning_rate": 0.0001, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": "N/A", + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 1479815, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 1, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_abmil_focal_maskgate_5seed/seed1/release_info.json b/virchow2_abmil_focal_maskgate_5seed/seed1/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..d8fe5a374779fa746c65ba548238c5c88d38273e --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed1/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_abmil_focal_maskgate_5seed/seed1", + "best_epoch": 43, + "best_val_qwk": 0.9106901289987646, + "n_parameters": 1479815, + "weights_sha256": "68740082c74008a4cb131dae8dda8b95223a19a45f74ed1d9bdeed746b4b49e9", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_abmil_focal_maskgate_5seed/seed2/best_model.safetensors b/virchow2_abmil_focal_maskgate_5seed/seed2/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a83f7092ea3808d2810d00e3f3e957659bfc8907 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed2/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5076b069fbf1e05ba33cff9e6f7245d944d3265b9883906891cfb6c8637e3c32 +size 5920172 diff --git a/virchow2_abmil_focal_maskgate_5seed/seed2/config.json b/virchow2_abmil_focal_maskgate_5seed/seed2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..5bf9f0699069312ea5ddd11b0f940020eba12f3b --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed2/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_abmil_gated_seed2", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.25, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": false, + "epochs": 50, + "learning_rate": 0.0001, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": "N/A", + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 1479815, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 2, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_abmil_focal_maskgate_5seed/seed2/release_info.json b/virchow2_abmil_focal_maskgate_5seed/seed2/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..958323abb328000d11bc3467466840f1072f52b0 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed2/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_abmil_focal_maskgate_5seed/seed2", + "best_epoch": 32, + "best_val_qwk": 0.9117707732552237, + "n_parameters": 1479815, + "weights_sha256": "5076b069fbf1e05ba33cff9e6f7245d944d3265b9883906891cfb6c8637e3c32", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_abmil_focal_maskgate_5seed/seed3/best_model.safetensors b/virchow2_abmil_focal_maskgate_5seed/seed3/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5df05a65835ea55f748a9a3c2ff5908d6e40aa02 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed3/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd95421639858940513c054f5116a233c29ee449357c5db9fe119ca14bb2ef7c +size 5920172 diff --git a/virchow2_abmil_focal_maskgate_5seed/seed3/config.json b/virchow2_abmil_focal_maskgate_5seed/seed3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..6d37944b5565da587293f76f621485fa50d2adb4 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed3/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_abmil_gated_seed3", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.25, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": false, + "epochs": 50, + "learning_rate": 0.0001, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": "N/A", + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 1479815, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 3, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_abmil_focal_maskgate_5seed/seed3/release_info.json b/virchow2_abmil_focal_maskgate_5seed/seed3/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..9d70ba21475fb2ea1e625c4db526eb64cc8ce158 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed3/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_abmil_focal_maskgate_5seed/seed3", + "best_epoch": 44, + "best_val_qwk": 0.9141272890088641, + "n_parameters": 1479815, + "weights_sha256": "fd95421639858940513c054f5116a233c29ee449357c5db9fe119ca14bb2ef7c", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_abmil_focal_maskgate_5seed/seed4/best_model.safetensors b/virchow2_abmil_focal_maskgate_5seed/seed4/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3c5664cd7265f29863ac2bd56b04d8757fd96b90 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed4/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eda8dcc1f5b36bcab163930ba2b4d69e0b1a1215aad78f234ea8b11076da7c07 +size 5920172 diff --git a/virchow2_abmil_focal_maskgate_5seed/seed4/config.json b/virchow2_abmil_focal_maskgate_5seed/seed4/config.json new file mode 100644 index 0000000000000000000000000000000000000000..a844e9860a634a447079c7705247cb5cbefdbf99 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed4/config.json @@ -0,0 +1,26 @@ +{ + "experiment_name": "virchow2_abmil_gated_seed4", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.25, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": false, + "epochs": 50, + "learning_rate": 0.0001, + "weight_decay": 0.01, + "loss_type": "focal", + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": "N/A", + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 1479815, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 4, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_abmil_focal_maskgate_5seed/seed4/release_info.json b/virchow2_abmil_focal_maskgate_5seed/seed4/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..b9ae898126e747d62ecaf9ffa6ea943d68563430 --- /dev/null +++ b/virchow2_abmil_focal_maskgate_5seed/seed4/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_abmil_focal_maskgate_5seed/seed4", + "best_epoch": 33, + "best_val_qwk": 0.9137856059183678, + "n_parameters": 1479815, + "weights_sha256": "eda8dcc1f5b36bcab163930ba2b4d69e0b1a1215aad78f234ea8b11076da7c07", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_1/best_model.safetensors b/virchow2_transmil_coral_fullgate_5fold/fold_1/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f0389a5adff837350ed56a13d116f6c334e486ee --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_1/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09e1ae98c9a5bb1d322fca1b90a6e9cc0d1b22898557a955e2356402ac831517 +size 163340024 diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_1/config.json b/virchow2_transmil_coral_fullgate_5fold/fold_1/config.json new file mode 100644 index 0000000000000000000000000000000000000000..60a7e45c74c46eec1f925344469b19a0c23f40ae --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_1/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_v2_fullgate_5fold_coral", + "fold": 1, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 0, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_1/release_info.json b/virchow2_transmil_coral_fullgate_5fold/fold_1/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..2eae7a3a71a3a6becb628cf9247c1edc9a35bae1 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_1/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_fullgate_5fold/fold_1", + "best_epoch": 41, + "best_val_qwk": 0.9253148951135173, + "n_parameters": 40834054, + "weights_sha256": "09e1ae98c9a5bb1d322fca1b90a6e9cc0d1b22898557a955e2356402ac831517", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_2/best_model.safetensors b/virchow2_transmil_coral_fullgate_5fold/fold_2/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..84735f456e8ca418f8eadc87454524ac9bf5a4f1 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_2/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3bbaddb7eba57549fff222daf0d32e0a0b4955f0fc841904e9866a0eb54b9232 +size 163340024 diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_2/config.json b/virchow2_transmil_coral_fullgate_5fold/fold_2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..4badfc002437acc81065902cb1303ee509d4368b --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_2/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_v2_fullgate_5fold_coral", + "fold": 2, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 1, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_2/release_info.json b/virchow2_transmil_coral_fullgate_5fold/fold_2/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..7e17b173de65f5e3435867ae91274e146bd5a634 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_2/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_fullgate_5fold/fold_2", + "best_epoch": 47, + "best_val_qwk": 0.9172772870217861, + "n_parameters": 40834054, + "weights_sha256": "3bbaddb7eba57549fff222daf0d32e0a0b4955f0fc841904e9866a0eb54b9232", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_3/best_model.safetensors b/virchow2_transmil_coral_fullgate_5fold/fold_3/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..40dd96d0a9b896c2404112d5659a00c638c45e4f --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_3/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc339930a718193945d10c139a58e4e9708cddbcbb971e1482088d683326e798 +size 163340024 diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_3/config.json b/virchow2_transmil_coral_fullgate_5fold/fold_3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..6b8cea781f4c2088f4415391e4e0e432d91df3f5 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_3/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_v2_fullgate_5fold_coral", + "fold": 3, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 2, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_3/release_info.json b/virchow2_transmil_coral_fullgate_5fold/fold_3/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..01a4f182dc83ccc6f1627a9a6fcf84e91bc35298 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_3/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_fullgate_5fold/fold_3", + "best_epoch": 46, + "best_val_qwk": 0.9271063800130852, + "n_parameters": 40834054, + "weights_sha256": "fc339930a718193945d10c139a58e4e9708cddbcbb971e1482088d683326e798", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_4/best_model.safetensors b/virchow2_transmil_coral_fullgate_5fold/fold_4/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..94cdb128701719ac310f47f514283221000576eb --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_4/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:22cf54253fdc87852bc4baed158104df1db3985593ff1cc80731960fcb448468 +size 163340024 diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_4/config.json b/virchow2_transmil_coral_fullgate_5fold/fold_4/config.json new file mode 100644 index 0000000000000000000000000000000000000000..6e31545f15dab0ddefeb39ef1bbcdc5e7eb87049 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_4/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_v2_fullgate_5fold_coral", + "fold": 4, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 3, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_4/release_info.json b/virchow2_transmil_coral_fullgate_5fold/fold_4/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..ad86f49d1fa3b78598feb8fb516afd3416bcf691 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_4/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_fullgate_5fold/fold_4", + "best_epoch": 46, + "best_val_qwk": 0.9169733837999474, + "n_parameters": 40834054, + "weights_sha256": "22cf54253fdc87852bc4baed158104df1db3985593ff1cc80731960fcb448468", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_5/best_model.safetensors b/virchow2_transmil_coral_fullgate_5fold/fold_5/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9d96a28ef2eb303a5f812fdef1a2a7ef8e2fbe2b --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_5/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b543aad365cc89d7cee8b42322ccf357572fc1248d87cf13161298c72a321b04 +size 163340024 diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_5/config.json b/virchow2_transmil_coral_fullgate_5fold/fold_5/config.json new file mode 100644 index 0000000000000000000000000000000000000000..84a6f07418a27dcc12b9d7fd66cc140f32511242 --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_5/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_v2_fullgate_5fold_coral", + "fold": 5, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8492, + "val_slides": 2122, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 4, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_fullgate_5fold/fold_5/release_info.json b/virchow2_transmil_coral_fullgate_5fold/fold_5/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..a68b91b0a8df64c7814553532828937021e5b1ff --- /dev/null +++ b/virchow2_transmil_coral_fullgate_5fold/fold_5/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_fullgate_5fold/fold_5", + "best_epoch": 47, + "best_val_qwk": 0.9269270799228082, + "n_parameters": 40834054, + "weights_sha256": "b543aad365cc89d7cee8b42322ccf357572fc1248d87cf13161298c72a321b04", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_1/best_model.safetensors b/virchow2_transmil_coral_maskgate_5fold/fold_1/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e135d073371fb56f93b1337a1f66d216fb0be1c2 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_1/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5fb6f6ae4232ca123faaf8f3fd21222c72019aa505500824611806f939d34a17 +size 163340024 diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_1/config.json b/virchow2_transmil_coral_maskgate_5fold/fold_1/config.json new file mode 100644 index 0000000000000000000000000000000000000000..aa700473eec71406112e12d90c0dc0cf819e5808 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_1/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_gated_5fold_coral", + "fold": 1, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 10, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 0, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_1/release_info.json b/virchow2_transmil_coral_maskgate_5fold/fold_1/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..72975b59f3f17cf3eb8adeda86eb9d3f5124b8fe --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_1/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_maskgate_5fold/fold_1", + "best_epoch": 22, + "best_val_qwk": 0.9217563225587565, + "n_parameters": 40834054, + "weights_sha256": "5fb6f6ae4232ca123faaf8f3fd21222c72019aa505500824611806f939d34a17", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_2/best_model.safetensors b/virchow2_transmil_coral_maskgate_5fold/fold_2/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c37cdde376e1816d5ca437dd4533f11906ad043b --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_2/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5b88e12854d5ef769385b8ea5c51c50ce737a316a3a24172c28361d30d73e3d7 +size 163340024 diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_2/config.json b/virchow2_transmil_coral_maskgate_5fold/fold_2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..160dc083d989951b5785a6785427e257722c9308 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_2/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_gated_5fold_coral", + "fold": 2, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 10, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 1, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_2/release_info.json b/virchow2_transmil_coral_maskgate_5fold/fold_2/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..61052e23f58621e9c7887fda1ccd627ddc400644 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_2/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_maskgate_5fold/fold_2", + "best_epoch": 28, + "best_val_qwk": 0.9186392839205172, + "n_parameters": 40834054, + "weights_sha256": "5b88e12854d5ef769385b8ea5c51c50ce737a316a3a24172c28361d30d73e3d7", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_3/best_model.safetensors b/virchow2_transmil_coral_maskgate_5fold/fold_3/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..69660f4e1cd4ee85481706cf6a5946116abd1bcf --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_3/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe2ab2e7064754a491720d9d243d762b3066e252bd22c69e2a82e86e336e50ea +size 163340024 diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_3/config.json b/virchow2_transmil_coral_maskgate_5fold/fold_3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..796d49bc1022ba04485f9a757cbbde4716af5858 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_3/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_gated_5fold_coral", + "fold": 3, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 10, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 2, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_3/release_info.json b/virchow2_transmil_coral_maskgate_5fold/fold_3/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..9852296a8935c8503767c67998fb943f2812ee21 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_3/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_maskgate_5fold/fold_3", + "best_epoch": 36, + "best_val_qwk": 0.927293241921137, + "n_parameters": 40834054, + "weights_sha256": "fe2ab2e7064754a491720d9d243d762b3066e252bd22c69e2a82e86e336e50ea", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_4/best_model.safetensors b/virchow2_transmil_coral_maskgate_5fold/fold_4/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..be9740d20430ba1ff10aaa9deaeb7334b6f495b1 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_4/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9a81d1711f03b1fb0b9c8d1b05b99f7f6ff314f9f502352c7057d4e7557f50a5 +size 163340024 diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_4/config.json b/virchow2_transmil_coral_maskgate_5fold/fold_4/config.json new file mode 100644 index 0000000000000000000000000000000000000000..84106f5fdc40f5508b84b437bf7132794464ced9 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_4/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_gated_5fold_coral", + "fold": 4, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 10, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8491, + "val_slides": 2123, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 3, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_4/release_info.json b/virchow2_transmil_coral_maskgate_5fold/fold_4/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..83b6bfcd979740a87f2b74bc6b0532124940fe98 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_4/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_maskgate_5fold/fold_4", + "best_epoch": 28, + "best_val_qwk": 0.9183432329171636, + "n_parameters": 40834054, + "weights_sha256": "9a81d1711f03b1fb0b9c8d1b05b99f7f6ff314f9f502352c7057d4e7557f50a5", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_5/best_model.safetensors b/virchow2_transmil_coral_maskgate_5fold/fold_5/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..cbcbc288f792af0f4d12489f0013369e7fdb0857 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_5/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f2b0756806725789966e22255388578d3f7fb32f78c5fb680751db409efd3d14 +size 163340024 diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_5/config.json b/virchow2_transmil_coral_maskgate_5fold/fold_5/config.json new file mode 100644 index 0000000000000000000000000000000000000000..13c4449954f169ced4593ede36b2e94602e0e247 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_5/config.json @@ -0,0 +1,27 @@ +{ + "experiment_name": "virchow2_transmil_gated_5fold_coral", + "fold": 5, + "n_folds": 5, + "backbone": "virchow2 (1280d)", + "aggregator": "transmil", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 10, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "coral", + "focal_gamma": "N/A", + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 8492, + "val_slides": 2122, + "device": "NVIDIA GeForce RTX 3070", + "fold_seed": 4, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_coral_maskgate_5fold/fold_5/release_info.json b/virchow2_transmil_coral_maskgate_5fold/fold_5/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..2069108b91fb3ff4a25f759489643f3e0cb9eb91 --- /dev/null +++ b/virchow2_transmil_coral_maskgate_5fold/fold_5/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_coral_maskgate_5fold/fold_5", + "best_epoch": 36, + "best_val_qwk": 0.9268811187789894, + "n_parameters": 40834054, + "weights_sha256": "f2b0756806725789966e22255388578d3f7fb32f78c5fb680751db409efd3d14", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_fullgate_5seed/seed0/best_model.safetensors b/virchow2_transmil_focal_fullgate_5seed/seed0/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..64e9bb0b99a9868b35c1aae71304550f1ef54a31 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed0/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df777ea7f2ea0ae71c7ffad59de84a8d478536011e648e6c94e15294508f3bc0 +size 163342588 diff --git a/virchow2_transmil_focal_fullgate_5seed/seed0/config.json b/virchow2_transmil_focal_fullgate_5seed/seed0/config.json new file mode 100644 index 0000000000000000000000000000000000000000..3cabb41ae71f1bdb5c31744a9755b533e495388a --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed0/config.json @@ -0,0 +1,26 @@ +{ + "experiment_name": "gated_transmil_v2_fullgate_seed0", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "focal", + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 0, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_fullgate_5seed/seed0/release_info.json b/virchow2_transmil_focal_fullgate_5seed/seed0/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..bc8354c9bfa70f1d9d2fbb1e6a01e323bdee938a --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed0/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_fullgate_5seed/seed0", + "best_epoch": 50, + "best_val_qwk": 0.9240166377712489, + "n_parameters": 40834695, + "weights_sha256": "df777ea7f2ea0ae71c7ffad59de84a8d478536011e648e6c94e15294508f3bc0", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_fullgate_5seed/seed1/best_model.safetensors b/virchow2_transmil_focal_fullgate_5seed/seed1/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..480997ae1dcdd7c2e1c04d4348ceb3b3ae229e23 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed1/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e2702fb1364b2da41fdb35eaf93e322762fb0c3b2c4f7a8a8fe229c9250fee72 +size 163342588 diff --git a/virchow2_transmil_focal_fullgate_5seed/seed1/config.json b/virchow2_transmil_focal_fullgate_5seed/seed1/config.json new file mode 100644 index 0000000000000000000000000000000000000000..d43a7bee21167687efe361f7acec98cac3ec47b2 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed1/config.json @@ -0,0 +1,26 @@ +{ + "experiment_name": "gated_transmil_v2_fullgate_seed1", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "focal", + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 1, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_fullgate_5seed/seed1/release_info.json b/virchow2_transmil_focal_fullgate_5seed/seed1/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..46eb132d27e0d7d42b54a9e84a91b1a54992c0ba --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed1/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_fullgate_5seed/seed1", + "best_epoch": 42, + "best_val_qwk": 0.9280846005143518, + "n_parameters": 40834695, + "weights_sha256": "e2702fb1364b2da41fdb35eaf93e322762fb0c3b2c4f7a8a8fe229c9250fee72", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_fullgate_5seed/seed2/best_model.safetensors b/virchow2_transmil_focal_fullgate_5seed/seed2/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d0b40d67e51dd5e386973a3e5225b54859480121 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed2/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f344e374ba42c2b809bbb67a02932b36ab4a5e603a1f27b27b0d209e0cfa7bd8 +size 163342588 diff --git a/virchow2_transmil_focal_fullgate_5seed/seed2/config.json b/virchow2_transmil_focal_fullgate_5seed/seed2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..e87e11ec3a66c22f293aecc94f32f54e056af9b7 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed2/config.json @@ -0,0 +1,26 @@ +{ + "experiment_name": "gated_transmil_v2_fullgate_seed2", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "focal", + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 2, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_fullgate_5seed/seed2/release_info.json b/virchow2_transmil_focal_fullgate_5seed/seed2/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..ad47ae4fc61327b6752501909f3f8cbbb2bce20b --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed2/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_fullgate_5seed/seed2", + "best_epoch": 44, + "best_val_qwk": 0.918031450453736, + "n_parameters": 40834695, + "weights_sha256": "f344e374ba42c2b809bbb67a02932b36ab4a5e603a1f27b27b0d209e0cfa7bd8", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_fullgate_5seed/seed3/best_model.safetensors b/virchow2_transmil_focal_fullgate_5seed/seed3/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c072008b5ab85c6e66b0c6d28249f92f690e0508 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed3/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:32fba85197fe28d6d0c6a0a36a0444759b2ac98b493f5c3e187bb85961bf1424 +size 163342588 diff --git a/virchow2_transmil_focal_fullgate_5seed/seed3/config.json b/virchow2_transmil_focal_fullgate_5seed/seed3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..4664bc1ebaa10e2ddccc1634b1ed012a3659e4d4 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed3/config.json @@ -0,0 +1,26 @@ +{ + "experiment_name": "gated_transmil_v2_fullgate_seed3", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "focal", + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 3, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_fullgate_5seed/seed3/release_info.json b/virchow2_transmil_focal_fullgate_5seed/seed3/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..a318b3a6f726c1c1cafa144aea34668e2af7e083 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed3/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_fullgate_5seed/seed3", + "best_epoch": 41, + "best_val_qwk": 0.9189628400493233, + "n_parameters": 40834695, + "weights_sha256": "32fba85197fe28d6d0c6a0a36a0444759b2ac98b493f5c3e187bb85961bf1424", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_fullgate_5seed/seed4/best_model.safetensors b/virchow2_transmil_focal_fullgate_5seed/seed4/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..0ca84b816855d526657c4db8730fee5e978419ac --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed4/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c398461b4189ff0123875e8aa2a8aa2f3258d0728e11f056474920c2481a244 +size 163342588 diff --git a/virchow2_transmil_focal_fullgate_5seed/seed4/config.json b/virchow2_transmil_focal_fullgate_5seed/seed4/config.json new file mode 100644 index 0000000000000000000000000000000000000000..88b701224e1beaf15fa1e859c64f445230101c73 --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed4/config.json @@ -0,0 +1,26 @@ +{ + "experiment_name": "gated_transmil_v2_fullgate_seed4", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "loss_type": "focal", + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 4, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_fullgate_5seed/seed4/release_info.json b/virchow2_transmil_focal_fullgate_5seed/seed4/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..fd5af3bd676fa125d925602afeb3d137bf7d838a --- /dev/null +++ b/virchow2_transmil_focal_fullgate_5seed/seed4/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_fullgate_5seed/seed4", + "best_epoch": 49, + "best_val_qwk": 0.9215550511757222, + "n_parameters": 40834695, + "weights_sha256": "9c398461b4189ff0123875e8aa2a8aa2f3258d0728e11f056474920c2481a244", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_maskgate_5seed/seed0/best_model.safetensors b/virchow2_transmil_focal_maskgate_5seed/seed0/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..10d1062f8fc02e3dad52ccdca138642a37c7beaf --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed0/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46d45ce2e9dca14b2afbe21a5b86309a8e1e08c279d33df1dd67beff99613125 +size 163342588 diff --git a/virchow2_transmil_focal_maskgate_5seed/seed0/config.json b/virchow2_transmil_focal_maskgate_5seed/seed0/config.json new file mode 100644 index 0000000000000000000000000000000000000000..025df887d5819c1524dbf0fbfbf81f6837555da8 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed0/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_gated_seed0", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 0, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_maskgate_5seed/seed0/release_info.json b/virchow2_transmil_focal_maskgate_5seed/seed0/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..ecfe8e47a02bf3bb494e514b19422eeb292929aa --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed0/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_maskgate_5seed/seed0", + "best_epoch": 46, + "best_val_qwk": 0.9247917359093395, + "n_parameters": 40834695, + "weights_sha256": "46d45ce2e9dca14b2afbe21a5b86309a8e1e08c279d33df1dd67beff99613125", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_maskgate_5seed/seed1/best_model.safetensors b/virchow2_transmil_focal_maskgate_5seed/seed1/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a8f6c02a307c33efdba15c1b2a4dfddeca878d16 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed1/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dcc8b1de9c11c37b66e8681734efeb9f7827c540beb0514b378c423728e45aba +size 163342588 diff --git a/virchow2_transmil_focal_maskgate_5seed/seed1/config.json b/virchow2_transmil_focal_maskgate_5seed/seed1/config.json new file mode 100644 index 0000000000000000000000000000000000000000..c94d422a1343e9f00d9beefd0f2ce41a294ddb3e --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed1/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_gated_seed1", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 1, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_maskgate_5seed/seed1/release_info.json b/virchow2_transmil_focal_maskgate_5seed/seed1/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..0f46ab03f68d66dd308c22425f0be65248db517d --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed1/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_maskgate_5seed/seed1", + "best_epoch": 37, + "best_val_qwk": 0.9300926205729482, + "n_parameters": 40834695, + "weights_sha256": "dcc8b1de9c11c37b66e8681734efeb9f7827c540beb0514b378c423728e45aba", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_maskgate_5seed/seed2/best_model.safetensors b/virchow2_transmil_focal_maskgate_5seed/seed2/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d9a4e081c56c09a0f195cb5796db4d92842412ea --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed2/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46ff95ed0b820ff26e871eed6028d2359d9f92dfca259c43bddb65ea84d87b3b +size 163342588 diff --git a/virchow2_transmil_focal_maskgate_5seed/seed2/config.json b/virchow2_transmil_focal_maskgate_5seed/seed2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..d83f96a39a04d9d1cf45477639a38676ee9c9ea1 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed2/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_gated_seed2", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 2, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_maskgate_5seed/seed2/release_info.json b/virchow2_transmil_focal_maskgate_5seed/seed2/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..4564176fb86e20c9e0823dce68e17b456eb4c0f8 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed2/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_maskgate_5seed/seed2", + "best_epoch": 34, + "best_val_qwk": 0.9187727803953625, + "n_parameters": 40834695, + "weights_sha256": "46ff95ed0b820ff26e871eed6028d2359d9f92dfca259c43bddb65ea84d87b3b", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_maskgate_5seed/seed3/best_model.safetensors b/virchow2_transmil_focal_maskgate_5seed/seed3/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c81ccbbf24a59464912cf9cc27b460d473a42cc6 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed3/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dcc9f05c9f588b4cd04895d35c0d205ff935947ab1ef052e02206ed224a0b1c1 +size 163342588 diff --git a/virchow2_transmil_focal_maskgate_5seed/seed3/config.json b/virchow2_transmil_focal_maskgate_5seed/seed3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..136db884e9db62157823fc20c39e6c4fd0b23312 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed3/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_gated_seed3", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 3, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_maskgate_5seed/seed3/release_info.json b/virchow2_transmil_focal_maskgate_5seed/seed3/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..1da7cdb08636155e88fb2e4bfa4f1d7e87e4d113 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed3/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_maskgate_5seed/seed3", + "best_epoch": 42, + "best_val_qwk": 0.9185035682935823, + "n_parameters": 40834695, + "weights_sha256": "dcc9f05c9f588b4cd04895d35c0d205ff935947ab1ef052e02206ed224a0b1c1", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_maskgate_5seed/seed4/best_model.safetensors b/virchow2_transmil_focal_maskgate_5seed/seed4/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..913d86dd6a576837bece171da02fa19c19955434 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed4/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00110a97154a2f145b54b273ceb35be0c83b2198c8b28dc8c6b76cc8d090b47f +size 163342588 diff --git a/virchow2_transmil_focal_maskgate_5seed/seed4/config.json b/virchow2_transmil_focal_maskgate_5seed/seed4/config.json new file mode 100644 index 0000000000000000000000000000000000000000..cebbd81e6177c7b180e6ceb3ef340ee10b292c79 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed4/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_gated_seed4", + "backbone": "virchow2 (1280d)", + "gating": true, + "gating_mode": "v2", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 4, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_maskgate_5seed/seed4/release_info.json b/virchow2_transmil_focal_maskgate_5seed/seed4/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..a788f54c36c5d7de09cb7f0152a77143aabe1544 --- /dev/null +++ b/virchow2_transmil_focal_maskgate_5seed/seed4/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_maskgate_5seed/seed4", + "best_epoch": 46, + "best_val_qwk": 0.9222518012362112, + "n_parameters": 40834695, + "weights_sha256": "00110a97154a2f145b54b273ceb35be0c83b2198c8b28dc8c6b76cc8d090b47f", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_nogate_5seed/seed0/best_model.safetensors b/virchow2_transmil_focal_nogate_5seed/seed0/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c8b15540badf74d0c01f486a326535a8b96b0db8 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed0/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:170fd45ea67215bd17c0fb1a38a613538d73cab94d0423ef04156d13a748a911 +size 163342588 diff --git a/virchow2_transmil_focal_nogate_5seed/seed0/config.json b/virchow2_transmil_focal_nogate_5seed/seed0/config.json new file mode 100644 index 0000000000000000000000000000000000000000..82d7603bbb81ea828b1f6de07025423807e53245 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed0/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_nogating_seed0", + "backbone": "virchow2 (1280d)", + "gating": false, + "gating_mode": "N/A", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 0, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_nogate_5seed/seed0/release_info.json b/virchow2_transmil_focal_nogate_5seed/seed0/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..d6338f9b1d034933443cf33280727d83eb5ed013 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed0/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_nogate_5seed/seed0", + "best_epoch": 29, + "best_val_qwk": 0.9213396434429536, + "n_parameters": 40834695, + "weights_sha256": "170fd45ea67215bd17c0fb1a38a613538d73cab94d0423ef04156d13a748a911", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_nogate_5seed/seed1/best_model.safetensors b/virchow2_transmil_focal_nogate_5seed/seed1/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..62bc2a45dbf54ac053662aee5e5906bba3587fff --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed1/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e807e4df9ed5fb0d092bb0d5f8242a810d564f444b33e3390d68c1a7ae9023bc +size 163342588 diff --git a/virchow2_transmil_focal_nogate_5seed/seed1/config.json b/virchow2_transmil_focal_nogate_5seed/seed1/config.json new file mode 100644 index 0000000000000000000000000000000000000000..21bf01d2043c336bf8837d438a426ed327e0792a --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed1/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_nogating_seed1", + "backbone": "virchow2 (1280d)", + "gating": false, + "gating_mode": "N/A", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 1, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_nogate_5seed/seed1/release_info.json b/virchow2_transmil_focal_nogate_5seed/seed1/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..526083a877a2c68d3bda747b0df9e144c29cf32d --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed1/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_nogate_5seed/seed1", + "best_epoch": 21, + "best_val_qwk": 0.9266136596180082, + "n_parameters": 40834695, + "weights_sha256": "e807e4df9ed5fb0d092bb0d5f8242a810d564f444b33e3390d68c1a7ae9023bc", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_nogate_5seed/seed2/best_model.safetensors b/virchow2_transmil_focal_nogate_5seed/seed2/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c02c7c8bf632acfd91efa8fbd40b0ddb6724c267 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed2/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:69b15f81db31a83b7df21497a3997634e4fe31d00e57781a4739a22cb2a2bd83 +size 163342588 diff --git a/virchow2_transmil_focal_nogate_5seed/seed2/config.json b/virchow2_transmil_focal_nogate_5seed/seed2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..988e5f6da4d5427382fe5aacd8c5e66cf1dc6e6e --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed2/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_nogating_seed2", + "backbone": "virchow2 (1280d)", + "gating": false, + "gating_mode": "N/A", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 2, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_nogate_5seed/seed2/release_info.json b/virchow2_transmil_focal_nogate_5seed/seed2/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..3981f0a6afaa7e70e825292ade0b6485926844b3 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed2/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_nogate_5seed/seed2", + "best_epoch": 32, + "best_val_qwk": 0.9279087682585482, + "n_parameters": 40834695, + "weights_sha256": "69b15f81db31a83b7df21497a3997634e4fe31d00e57781a4739a22cb2a2bd83", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_nogate_5seed/seed3/best_model.safetensors b/virchow2_transmil_focal_nogate_5seed/seed3/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3e56079e84fd3adefd66e8e5f5a6837da4f1c40e --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed3/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:790693f7e198d9110eb64761f9bb2102a78a0219c787d8d39d6331e0c661e7df +size 163342588 diff --git a/virchow2_transmil_focal_nogate_5seed/seed3/config.json b/virchow2_transmil_focal_nogate_5seed/seed3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..7c62b1fe47c144894cb35998f7bc0654614348cd --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed3/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_nogating_seed3", + "backbone": "virchow2 (1280d)", + "gating": false, + "gating_mode": "N/A", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 3, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_nogate_5seed/seed3/release_info.json b/virchow2_transmil_focal_nogate_5seed/seed3/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..747b881af92364a0823fe8ba0b7371ca1906dca8 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed3/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_nogate_5seed/seed3", + "best_epoch": 39, + "best_val_qwk": 0.9192990419968117, + "n_parameters": 40834695, + "weights_sha256": "790693f7e198d9110eb64761f9bb2102a78a0219c787d8d39d6331e0c661e7df", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +} diff --git a/virchow2_transmil_focal_nogate_5seed/seed4/best_model.safetensors b/virchow2_transmil_focal_nogate_5seed/seed4/best_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..531a46ff4c12ea95789351ee488280d8c70b1d1a --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed4/best_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4236712921325ab44cfa7b928b89172d7ef37868ff6fe16defc050dd7da19273 +size 163342588 diff --git a/virchow2_transmil_focal_nogate_5seed/seed4/config.json b/virchow2_transmil_focal_nogate_5seed/seed4/config.json new file mode 100644 index 0000000000000000000000000000000000000000..98ce107eb657f7005dcf6714b9266feae92bdae6 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed4/config.json @@ -0,0 +1,25 @@ +{ + "experiment_name": "virchow2_transmil_nogating_seed4", + "backbone": "virchow2 (1280d)", + "gating": false, + "gating_mode": "N/A", + "dropout": 0.4, + "patch_dropout": 0.2, + "early_stopping_patience": 0, + "cosine_lr": true, + "epochs": 50, + "learning_rate": 1e-05, + "weight_decay": 0.01, + "focal_gamma": 2.0, + "accumulation_steps": 8, + "transmil_layers": 2, + "variance_threshold": 122.0, + "z_score_factor": 2.0, + "train_slides": 7961, + "val_slides": 1592, + "test_slides": 1061, + "parameters": 40834695, + "device": "NVIDIA GeForce RTX 3070", + "init_seed": 4, + "split_seed": 42 +} \ No newline at end of file diff --git a/virchow2_transmil_focal_nogate_5seed/seed4/release_info.json b/virchow2_transmil_focal_nogate_5seed/seed4/release_info.json new file mode 100644 index 0000000000000000000000000000000000000000..17db4aa3a9d41446410fa775fb83443fbb900560 --- /dev/null +++ b/virchow2_transmil_focal_nogate_5seed/seed4/release_info.json @@ -0,0 +1,11 @@ +{ + "name": "virchow2_transmil_focal_nogate_5seed/seed4", + "best_epoch": 49, + "best_val_qwk": 0.9253653903936129, + "n_parameters": 40834695, + "weights_sha256": "4236712921325ab44cfa7b928b89172d7ef37868ff6fe16defc050dd7da19273", + "conversion_check": { + "random_bags": 3, + "max_abs_logit_diff": 0.0 + } +}