cellsam3

CellSAM3 is a universal model for cell segmentation. CellSAM achieves state-of-the-art performance on segmentation across a variety of cellular targets (bacteria, tissue, yeast, cell culture, etc.) and imaging modalities (brightfield, fluorescence, phase, multiplexed, etc.).

Model Details

A Vision-Language Model (VLM) building on the detection and segmentation capabilities of the AnchorDETR and Segment Anything (SAM3) models, respectively.

Model Description

• Developed by: Van Valen Lab
• Model type: VLM
• License: Modified-apache2.0-noncommercial

Model Sources [optional]

• Repository: https://github.com/vanvalenlab/cellSAM3

Uses

Cell segmentation in microscope images.

Direct Use

The weights provided in this repository are suitable for cell segmentation across a variety of cellular targets (bacteria, tissue, yeast, cell culture, etc.) and imaging modalities (brightfield, fluorescence, phase, multiplexed, etc.).

Downstream Use

Cellsam3 is a generalist model designed to perform cell segmentation across all cell types and image modalities. However, it is possible to fine-tune CellSAM for specific applications. See the training documentation for details.

Out-of-Scope Use

The model herein is provided subject to license terms prohibiting use for commercial applications.

Inquiries regarding commercial licensing should be directed to the Caltech Office of Technology Transfer.

How to Get Started with the Model

The cellsam3 model is currently under active development. Users interested in trying the development version for inference are directed to the inference package in the source repository.