Instructions to use microsoft/colipri with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- COLIPRI
How to use microsoft/colipri with COLIPRI:
pip install colipri
from colipri import get_model from colipri import get_processor from colipri import load_sample_ct from colipri import ZeroShotImageClassificationPipeline model = get_model().cuda() processor = get_processor() pipeline = ZeroShotImageClassificationPipeline(model, processor) image = load_sample_ct() pipeline(image, ["No lung nodules", "Lung nodules"])
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ pipeline_tag: zero-shot-image-classification
|
|
| 10 |
|
| 11 |
<!-- Provide a quick summary of what the model is/does. -->
|
| 12 |
|
| 13 |
-
COLIPRI is a 3D vision–language transformer model trained to encode chest CT scans and reports.
|
| 14 |
|
| 15 |
## Model description
|
| 16 |
|
|
@@ -148,6 +148,15 @@ COLIPRI was trained on [Azure Machine Learning](https://azure.microsoft.com/en-u
|
|
| 148 |
|
| 149 |
The main software libraries used in this work were [nnSSL](https://github.com/MIC-DKFZ/nnssl) for training, [TorchIO](https://torchio.org/) for preprocessing and augmentation, [`nifti-zarr-py`](https://github.com/neuroscales/nifti-zarr-py) for data loading, and [nnU-Net](https://github.com/MIC-DKFZ/nnUNet) for segmentation evaluation.
|
| 150 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 151 |
## Citation
|
| 152 |
|
| 153 |
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
|
|
|
| 10 |
|
| 11 |
<!-- Provide a quick summary of what the model is/does. -->
|
| 12 |
|
| 13 |
+
COLIPRI is a 3D vision–language transformer model trained to encode chest CT scans and radiological reports.
|
| 14 |
|
| 15 |
## Model description
|
| 16 |
|
|
|
|
| 148 |
|
| 149 |
The main software libraries used in this work were [nnSSL](https://github.com/MIC-DKFZ/nnssl) for training, [TorchIO](https://torchio.org/) for preprocessing and augmentation, [`nifti-zarr-py`](https://github.com/neuroscales/nifti-zarr-py) for data loading, and [nnU-Net](https://github.com/MIC-DKFZ/nnUNet) for segmentation evaluation.
|
| 150 |
|
| 151 |
+
## Community
|
| 152 |
+
|
| 153 |
+
Below are some works derived from COLIPRI.
|
| 154 |
+
|
| 155 |
+
| Name | Description |
|
| 156 |
+
| --- | --- |
|
| 157 |
+
| [NV-Reason-CT](https://huggingface.co/nvidia/NV-Reason-CT) | Open 3D CT VLM for Radiologist Chain-of-Thought Reasoning |
|
| 158 |
+
| [ORCA-3DCT](https://github.com/renjie-liang/ORCA-3DCT) | Training-free [ORCA](https://arxiv.org/abs/2608.00345) compression of CT-RATE embeddings |
|
| 159 |
+
|
| 160 |
## Citation
|
| 161 |
|
| 162 |
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|