Genellect commited on
Commit
9bec941
·
verified ·
1 Parent(s): 6326cf8

Release reviewed experimental NCL candidate at 750 updates

Browse files

Add the reviewed 750-update state dictionary and aggregate metadata, preserve the 375-update version, and document detection improvements, quantification limitations and upstream BSD-3-Clause attribution.

Files changed (5) hide show
  1. LICENSE.cellpose +8 -0
  2. NOTICE.md +18 -0
  3. README.md +32 -8
  4. ncl/r1-step0750.json +68 -0
  5. ncl/r1-step0750.pt +3 -0
LICENSE.cellpose ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ Copyright © 2020 Howard Hughes Medical Institute
2
+
3
+ Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
4
+
5
+ Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
6
+ Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
7
+ Neither the name of HHMI nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.
8
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
NOTICE.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Upstream model attribution
2
+
3
+ The Cytellect NCL candidate is a fine-tune of the Cellpose-SAM `cpsam_v2`
4
+ checkpoint distributed by MouseLand.
5
+
6
+ - Upstream repository: https://huggingface.co/mouseland/cellpose-sam
7
+ - Upstream revision: `7c61431b5fbb078f3296754bd15d9f51b320f837`
8
+ - Upstream checkpoint SHA256: `0f1cc3f7ecdd8a037a57c6c48d9d8921391be4cbce3fa9f13c3e3a2e1253c667`
9
+ - That revision's model card declares `bsd-3-clause`:
10
+ https://huggingface.co/mouseland/cellpose-sam/blob/7c61431b5fbb078f3296754bd15d9f51b320f837/README.md
11
+ - The upstream copyright, conditions and disclaimer are reproduced in
12
+ `LICENSE.cellpose`.
13
+
14
+ The fine-tuning changes the model weights. It does not imply endorsement by
15
+ Howard Hughes Medical Institute or the upstream contributors.
16
+
17
+ The release's model card and version metadata identify the exact fine-tuned
18
+ checkpoint, its supported input conditions, and its evaluation limitations.
README.md CHANGED
@@ -1,21 +1,45 @@
1
  ---
 
2
  tags:
3
  - microscopy
4
  - image-segmentation
5
  - experimental
6
  ---
7
- # NCL development pilot, 375 real-image updates
8
 
9
- Experimental NCL-staining-specific nucleolar segmentation weights, fine-tuned from an untouched cpsam_v2 checkpoint. Not adopted into the product. Not validated for NPM1 staining or cytoplasm. No synthetic images were used in this fine-tuning run.
10
 
11
- Training used 8 approved objects in 2 regions from one experiment. Development used 4 reference objects in one region from a separately cultured and treated experiment; it was never a training input. There is no completed untouched final test.
12
 
13
- Under identical local product processing, development instance F1 changed from 0.5455 to 0.8000 (TP 3 to 4, FP 4 to 2, FN 1 to 0; matching IoU at least 0.5). Extra split fragments and individual boundary/area errors remain. Raw candidate F1 is 0.3636; product postprocessing materially affects the result. Total area agreement does not establish accurate per-object quantification. Training-region geometry regressions remain versus baseline.
14
 
15
- This small development result does not establish general performance, native fluorescence measurement accuracy, or reduced human correction burden. Two-human reference agreement is not established. Preserve the base model and evaluate this candidate before any use.
16
 
17
- Only model weights and aggregate metadata are included. No research images, annotations, optimizer state, or specimen identifiers are included.
18
 
19
- Checkpoint SHA256: `bc5ea7f25ce9a9f96e9ff510cee20587e1328ac834a0f7f82aee0bc06156d906`.
 
 
 
 
20
 
21
- See `ncl/r1-step0375.json` for the fixed recipe, package versions, provenance hashes, and aggregate metrics. No additional license grant is asserted by this model card; applicable upstream terms require separate review before redistribution.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: bsd-3-clause
3
  tags:
4
  - microscopy
5
  - image-segmentation
6
  - experimental
7
  ---
8
+ # NCL development pilot
9
 
10
+ Experimental NCL-staining-specific nucleolar segmentation weights, fine-tuned from the untouched Cellpose-SAM `cpsam_v2` checkpoint. These weights are not the product default. Product integration and a user-operated local PoC are not completed. NPM1 staining and cytoplasm performance are not validated.
11
 
12
+ The 750-update candidate is intended for a bounded detection PoC. The earlier 375-update candidate remains available for reproducibility. This is not a general-purpose or fully validated nucleolar model. No synthetic images were used in this fine-tuning run.
13
 
14
+ ## Data and comparison
15
 
16
+ Training used 8 human-approved objects in 2 regions from one experiment. Development used 4 reference objects in one region from a separately cultured and treated experiment. That development image was not a training input, but it was used for candidate selection and is not an untouched final test. There is no completed untouched final test.
17
 
18
+ The table uses the same development reference and fixed local product preprocessing, parent-nucleus gating and postprocessing. Matching requires IoU at least 0.5. Training-region results are not pooled into development performance.
19
 
20
+ | Product output | TP | FP | FN | Instance F1 | Union Dice | Total area difference |
21
+ |---|---:|---:|---:|---:|---:|---:|
22
+ | Untouched baseline | 3 | 4 | 1 | 0.5455 | 0.8534 | -20.38% |
23
+ | 375 updates | 4 | 2 | 0 | 0.8000 | 0.9349 | -2.69% |
24
+ | 750 updates | 4 | 0 | 0 | 1.0000 | 0.8951 | -11.70% |
25
 
26
+ At 750 updates, the three better-segmented objects have area errors of +5, -6 and +5 pixels. The remaining object has 360 predicted pixels versus 608 reference pixels: **40.8% undersegmentation**, with IoU 0.5638. F1 of 1 means four matches pass the selected threshold; it does not mean perfect boundaries or quantification. At IoU 0.7, instance F1 is 0.75.
27
+
28
+ Raw model output at 750 updates has TP 3, FP 1, FN 1 and F1 0.75. The fourth object's raw IoU is about 0.428; fixed product postprocessing raises it above 0.5. Raw and product output are not interchangeable. Removing the two unmatched fragments seen at 375 improves instance detection but worsens overall area agreement and union Dice. Some training-region geometry errors and a downstream parent-gate exclusion remain.
29
+
30
+ ## Use and limits
31
+
32
+ Use the matching NCL input conditions and reviewed product processing. Preserve the base model and record the exact checkpoint identity. Do not treat this pilot's development scores as expected accuracy on new experiments. Human reference agreement between two annotators, native fluorescence measurement accuracy, reduced correction time and broad generalization are not established.
33
+
34
+ Only model state-dict weights and aggregate metadata are distributed. No research images, annotations, optimizer state, raw logs, specimen identifiers or private filesystem paths are included.
35
+
36
+ | Version | File | SHA256 |
37
+ |---|---|---|
38
+ | 750 updates | `ncl/r1-step0750.pt` | `9d2c2ec06aa1aa71f36695b49b0828f82fd3cb633da2832c99a9f194d0bd4099` |
39
+ | 375 updates | `ncl/r1-step0375.pt` | `bc5ea7f25ce9a9f96e9ff510cee20587e1328ac834a0f7f82aee0bc06156d906` |
40
+
41
+ The corresponding JSON files contain the fixed recipe, package versions, provenance hashes and aggregate metrics. These are state dictionaries; load only with a compatible, reviewed Cellpose-SAM implementation and `weights_only=True`, rather than executing arbitrary serialized objects.
42
+
43
+ ## License and attribution
44
+
45
+ The upstream fixed-revision model card declares BSD-3-Clause. See `NOTICE.md` for the exact upstream revision and base checkpoint, and `LICENSE.cellpose` for the upstream copyright, conditions and disclaimer. The weights have been modified by fine-tuning; no upstream endorsement is implied.
ncl/r1-step0750.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema_version": 1,
3
+ "task": "NCL-stained nucleolar instance segmentation",
4
+ "status": "experimental_development_candidate_not_adopted",
5
+ "completed_updates": 750,
6
+ "checkpoint_sha256": "9d2c2ec06aa1aa71f36695b49b0828f82fd3cb633da2832c99a9f194d0bd4099",
7
+ "base_checkpoint_sha256": "0f1cc3f7ecdd8a037a57c6c48d9d8921391be4cbce3fa9f13c3e3a2e1253c667",
8
+ "data_manifest_sha256": "0ae2728c8e85ed94d55ca0baeb54bd72c139aac01a142d7ca6ebe4e8a5a5b7fe",
9
+ "training_code_sha256": "4d7797c716d9fde458b29ed3b1d07e8b990cbf826560d540a62cf5c0fb94d53a",
10
+ "inference_code_sha256": "c4b32c7910b3e00804b48794791468dfefedec7896ec770548f34872b4fd9453",
11
+ "recipe": {
12
+ "optimizer": "AdamW",
13
+ "lr_max": 1e-05,
14
+ "weight_decay": 0.1,
15
+ "warmup_updates": 100,
16
+ "batch_size": 1,
17
+ "rdrop": 0,
18
+ "augmentation": false
19
+ },
20
+ "environment": {
21
+ "cellpose": "4.2.1.1",
22
+ "torch": "2.8.0+cpu",
23
+ "numpy": "2.2.6",
24
+ "scipy": "1.16.2"
25
+ },
26
+ "evaluation_summary": {
27
+ "training_experiments": 1,
28
+ "training_regions": 2,
29
+ "training_objects": 8,
30
+ "development_experiments": 1,
31
+ "development_regions": 1,
32
+ "development_objects": 4,
33
+ "final_test_regions": 0,
34
+ "matched_product_baseline": {
35
+ "TP": 3,
36
+ "FP": 4,
37
+ "FN": 1,
38
+ "F1": 0.5454545454545454,
39
+ "union_Dice": 0.8534045393858478,
40
+ "total_area_relative_difference": -0.2038369304556355
41
+ },
42
+ "candidate_product_output": {
43
+ "TP": 4,
44
+ "FP": 0,
45
+ "FN": 0,
46
+ "F1": 1.0,
47
+ "union_Dice": 0.8950585838003057,
48
+ "total_area_relative_difference": -0.1170263788968825
49
+ },
50
+ "candidate_raw_output": {
51
+ "TP": 3,
52
+ "FP": 1,
53
+ "FN": 1,
54
+ "F1": 0.75,
55
+ "union_Dice": 0.8709005726184279,
56
+ "total_area_relative_difference": -0.15731414868105514
57
+ },
58
+ "limitations": [
59
+ "Development-only pilot; not a generalization or final validation claim.",
60
+ "Product output includes unchanged parent-nucleus and postprocessing stages; raw model output differs.",
61
+ "One development object is undersegmented by 40.8 percent in area despite passing the instance matching threshold.",
62
+ "Compared with 375 updates, fewer unmatched fragments but worse union Dice and total area agreement.",
63
+ "Training images are not independent validation; final training-output misses and geometry errors remain.",
64
+ "Two-human reference agreement, native fluorescence accuracy, and correction burden not measured.",
65
+ "Not validated for NPM1 staining or cytoplasm; product integration and actual user PoC not completed."
66
+ ]
67
+ }
68
+ }
ncl/r1-step0750.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d2c2ec06aa1aa71f36695b49b0828f82fd3cb633da2832c99a9f194d0bd4099
3
+ size 1233577155