Image Segmentation
Transformers
PyTorch
pixdlm
cvpr-2026
compute-transparency
reasoning-segmentation
uav
remote-sensing
vision-language
Instructions to use WhynotHug/PixDLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use WhynotHug/PixDLM with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-segmentation", model="WhynotHug/PixDLM")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("WhynotHug/PixDLM", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Upload README.md
Browse files
README.md
CHANGED
|
@@ -15,18 +15,13 @@ tags:
|
|
| 15 |
- image-segmentation
|
| 16 |
---
|
| 17 |
|
| 18 |
-
# PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation
|
| 19 |
|
| 20 |
[](https://arxiv.org/abs/2604.15670)
|
| 21 |
[](https://huggingface.co/WhynotHug/PixDLM)
|
| 22 |
[](https://huggingface.co/datasets/WhynotHug/DRSeg)
|
|
|
|
| 23 |
|
| 24 |
-
PixDLM is a dual-path multimodal language model for UAV reasoning segmentation.
|
| 25 |
-
Given an aerial image and a reasoning-oriented question, PixDLM produces a target
|
| 26 |
-
segmentation mask aligned with the described object.
|
| 27 |
-
|
| 28 |
-
This repository contains the clean open-source release for the CVPR 2026
|
| 29 |
-
Highlight paper and the 2027 CVPR Compute Transparency Champion release.
|
| 30 |
|
| 31 |
## Highlights
|
| 32 |
|
|
@@ -48,7 +43,7 @@ PixDLM/
|
|
| 48 |
βββ docs/ # Reproducibility and data/model documentation
|
| 49 |
βββ examples/ # Minimal local examples and expected file layout
|
| 50 |
βββ pretrained/pixdlm-7b/ # Lightweight model config/tokenizer files
|
| 51 |
-
βββ release/huggingface/ # Model card, dataset card,
|
| 52 |
βββ eval.py # Evaluation entry point
|
| 53 |
βββ train_ds.py # Training entry point
|
| 54 |
βββ requirements.txt
|
|
@@ -159,28 +154,6 @@ logs/<exp_name>/
|
|
| 159 |
Typical per-sample artifacts include the input image, predicted mask, ground
|
| 160 |
truth mask, red/green overlay, and a JSON result file.
|
| 161 |
|
| 162 |
-
## DRSeg Evaluation Results
|
| 163 |
-
|
| 164 |
-
The paper reports the following PixDLM metrics on DRSeg:
|
| 165 |
-
|
| 166 |
-
| Reasoning type | gIoU | cIoU |
|
| 167 |
-
| --- | ---: | ---: |
|
| 168 |
-
| Attribute | 62.80 | 62.84 |
|
| 169 |
-
| Scene | 61.75 | 64.03 |
|
| 170 |
-
| Spatial | 62.51 | 62.80 |
|
| 171 |
-
|
| 172 |
-
A practical 8-GPU verification run with this release produced:
|
| 173 |
-
|
| 174 |
-
| Reasoning type | gIoU | cIoU |
|
| 175 |
-
| --- | ---: | ---: |
|
| 176 |
-
| Attribute | 62.51 | 60.82 |
|
| 177 |
-
| Scene | 62.56 | 62.36 |
|
| 178 |
-
| Spatial | 61.54 | 61.00 |
|
| 179 |
-
| Overall | 62.20 | 61.41 |
|
| 180 |
-
|
| 181 |
-
The gIoU reproduction is close to the paper table. The cIoU numbers can vary with
|
| 182 |
-
the exact evaluation protocol, sampler behavior, and dependency versions.
|
| 183 |
-
|
| 184 |
## Dataset
|
| 185 |
|
| 186 |
DRSeg is available at:
|
|
|
|
| 15 |
- image-segmentation
|
| 16 |
---
|
| 17 |
|
| 18 |
+
# γCVPR2026 HighlightγPixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation
|
| 19 |
|
| 20 |
[](https://arxiv.org/abs/2604.15670)
|
| 21 |
[](https://huggingface.co/WhynotHug/PixDLM)
|
| 22 |
[](https://huggingface.co/datasets/WhynotHug/DRSeg)
|
| 23 |
+
[](https://huggingface.co/spaces/WhynotHug/PixDLM)
|
| 24 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
## Highlights
|
| 27 |
|
|
|
|
| 43 |
βββ docs/ # Reproducibility and data/model documentation
|
| 44 |
βββ examples/ # Minimal local examples and expected file layout
|
| 45 |
βββ pretrained/pixdlm-7b/ # Lightweight model config/tokenizer files
|
| 46 |
+
βββ release/huggingface/ # Model card, dataset card, Space, upload helpers
|
| 47 |
βββ eval.py # Evaluation entry point
|
| 48 |
βββ train_ds.py # Training entry point
|
| 49 |
βββ requirements.txt
|
|
|
|
| 154 |
Typical per-sample artifacts include the input image, predicted mask, ground
|
| 155 |
truth mask, red/green overlay, and a JSON result file.
|
| 156 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 157 |
## Dataset
|
| 158 |
|
| 159 |
DRSeg is available at:
|