| --- |
| library_name: cellmap-models |
| tags: |
| - pytorch |
| - onnx |
| - torchscript |
| - 3d |
| - segmentation |
| - electron-microscopy |
| - cellmap |
| - ld_aff_1 |
| - ld_aff_2 |
| - ld_aff_3 |
| license: bsd-3-clause |
| --- |
| |
| # ld_aff_unet_setup_48 |
|
|
| Generalist affinities for lipids segmentation using a UNet architecture trained on setup 48 with 380k iterations. |
|
|
| ## Model Details |
|
|
| | | | |
| |---|---| |
| | **Architecture** | UNet | |
| | **Framework** | torch | |
| | **Spatial Dims** | 3 | |
| | **Input Channels** | 1 | |
| | **Output Channels** | 3 | |
| | **Channel Names** | ld_aff_1, ld_aff_2, ld_aff_3 | |
| | **Iteration** | 380000 | |
| | **Input Voxel Size** | 16, 16, 16 nm | |
| | **Output Voxel Size** | 16, 16, 16 nm | |
| | **Inference Input Shape** | 378, 378, 378 | |
| | **Inference Output Shape** | 256, 256, 256 | |
|
|
| ## Available Formats |
|
|
| | File | Format | Usage | |
| |---|---|---| |
| | `model.pt` | PyTorch pickle | `torch.load("model.pt")` | |
| | `model.ts` | TorchScript | `torch.jit.load("model.ts")` | |
| | `model.onnx` | ONNX | `onnxruntime.InferenceSession("model.onnx")` | |
| | `metadata.json` | JSON | Model metadata | |
|
|
| ## Usage |
|
|
| ```bash |
| pip install cellmap-models |
| ``` |
|
|
| ```python |
| from cellmap_models.model_export.cellmap_model import CellmapModel |
| |
| model = CellmapModel("path/to/model/folder") |
| |
| # Inference |
| output = model.ts_model(input_tensor) |
| |
| # Finetuning |
| trainable_model = model.train() |
| ``` |
|
|
| Or download from this repo and load directly: |
|
|
| ```python |
| from huggingface_hub import snapshot_download |
| from cellmap_models.model_export.cellmap_model import CellmapModel |
| |
| path = snapshot_download(repo_id="ld_aff_unet_setup_48") |
| model = CellmapModel(path) |
| ``` |
|
|
| ## Author |
|
|
| Marwan Zouinkhi |
|
|
| ## Links |
|
|
| - [cellmap-models](https://github.com/janelia-cellmap/cellmap-models) |
| - [CellMap Project](https://www.janelia.org/project-team/cellmap) |
|
|