| --- |
| license: other |
| license_name: modified-apache-2.0-noncommercial |
| license_link: LICENSE |
| extra_gated_heading: "Acknowledge license terms: non-commercial use" |
| extra_gated_button_content: "I agree to the license terms" |
| --- |
| |
| # cellsam3 |
|
|
| CellSAM3 is a universal model for cell segmentation. |
| CellSAM achieves state-of-the-art performance on segmentation across a variety |
| of cellular targets (bacteria, tissue, yeast, cell culture, etc.) and |
| imaging modalities (brightfield, fluorescence, phase, multiplexed, etc.). |
|
|
| ## Model Details |
|
|
| A Vision-Language Model (VLM) building on the detection and segmentation |
| capabilities of the [AnchorDETR][anchordetr-repo] and |
| [Segment Anything (SAM3)][sam3-repo] models, respectively. |
|
|
| [sam3-repo]: https://github.com/facebookresearch/sam3 |
| [anchordetr-repo]: https://github.com/megvii-research/AnchorDETR |
|
|
| ### Model Description |
|
|
| - **Developed by:** Van Valen Lab |
| - **Model type:** VLM |
| - **License:** Modified-apache2.0-noncommercial |
|
|
| ### Model Sources [optional] |
|
|
| - **Repository:** https://github.com/vanvalenlab/cellSAM3 |
|
|
| ## Uses |
|
|
| Cell segmentation in microscope images. |
|
|
| ### Direct Use |
|
|
| The weights provided in this repository are suitable for cell segmentation |
| across a variety of cellular targets (bacteria, tissue, yeast, cell culture, etc.) |
| and imaging modalities (brightfield, fluorescence, phase, multiplexed, etc.). |
|
|
| ### Downstream Use |
|
|
| Cellsam3 is a generalist model designed to perform cell segmentation across all |
| cell types and image modalities. |
| However, it is possible to fine-tune CellSAM for specific applications. |
| See the [training documentation][fine-tuning] for details. |
|
|
| [fine-tuning]: https://github.com/vanvalenlab/cellsam3/blob/sam3.1-upgrade/docs/TRAINING.md |
|
|
| ### Out-of-Scope Use |
|
|
| **The model herein is provided subject to license terms prohibiting use for |
| commercial applications.** |
|
|
| Inquiries regarding commercial licensing should be directed to the |
| [Caltech Office of Technology Transfer][ottcp]. |
|
|
| [ottcp]: https://innovation.caltech.edu/about-ottcp/contact-us#send-us-a-message |
|
|
| ## How to Get Started with the Model |
|
|
| The cellsam3 model is currently under active development. |
| Users interested in trying the development version for inference are directed |
| to the [inference package in the source repository][inference-dir]. |
|
|
| [inference-dir]: https://github.com/vanvalenlab/cellsam3/tree/sam3.1-upgrade/inference |
|
|
