WhynotHug commited on
Commit
f40fa58
Β·
verified Β·
1 Parent(s): ae4bb90

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -30
README.md CHANGED
@@ -15,18 +15,13 @@ tags:
15
  - image-segmentation
16
  ---
17
 
18
- # PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation
19
 
20
  [![Paper](https://img.shields.io/badge/arXiv-2604.15670-b31b1b)](https://arxiv.org/abs/2604.15670)
21
  [![Model](https://img.shields.io/badge/HuggingFace-WhynotHug%2FPixDLM-yellow)](https://huggingface.co/WhynotHug/PixDLM)
22
  [![Dataset](https://img.shields.io/badge/HuggingFace-WhynotHug%2FDRSeg-green)](https://huggingface.co/datasets/WhynotHug/DRSeg)
 
23
 
24
- PixDLM is a dual-path multimodal language model for UAV reasoning segmentation.
25
- Given an aerial image and a reasoning-oriented question, PixDLM produces a target
26
- segmentation mask aligned with the described object.
27
-
28
- This repository contains the clean open-source release for the CVPR 2026
29
- Highlight paper and the 2027 CVPR Compute Transparency Champion release.
30
 
31
  ## Highlights
32
 
@@ -48,7 +43,7 @@ PixDLM/
48
  β”œβ”€β”€ docs/ # Reproducibility and data/model documentation
49
  β”œβ”€β”€ examples/ # Minimal local examples and expected file layout
50
  β”œβ”€β”€ pretrained/pixdlm-7b/ # Lightweight model config/tokenizer files
51
- β”œβ”€β”€ release/huggingface/ # Model card, dataset card, and upload helpers
52
  β”œβ”€β”€ eval.py # Evaluation entry point
53
  β”œβ”€β”€ train_ds.py # Training entry point
54
  └── requirements.txt
@@ -159,28 +154,6 @@ logs/<exp_name>/
159
  Typical per-sample artifacts include the input image, predicted mask, ground
160
  truth mask, red/green overlay, and a JSON result file.
161
 
162
- ## DRSeg Evaluation Results
163
-
164
- The paper reports the following PixDLM metrics on DRSeg:
165
-
166
- | Reasoning type | gIoU | cIoU |
167
- | --- | ---: | ---: |
168
- | Attribute | 62.80 | 62.84 |
169
- | Scene | 61.75 | 64.03 |
170
- | Spatial | 62.51 | 62.80 |
171
-
172
- A practical 8-GPU verification run with this release produced:
173
-
174
- | Reasoning type | gIoU | cIoU |
175
- | --- | ---: | ---: |
176
- | Attribute | 62.51 | 60.82 |
177
- | Scene | 62.56 | 62.36 |
178
- | Spatial | 61.54 | 61.00 |
179
- | Overall | 62.20 | 61.41 |
180
-
181
- The gIoU reproduction is close to the paper table. The cIoU numbers can vary with
182
- the exact evaluation protocol, sampler behavior, and dependency versions.
183
-
184
  ## Dataset
185
 
186
  DRSeg is available at:
 
15
  - image-segmentation
16
  ---
17
 
18
+ # 【CVPR2026 Highlight】PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation
19
 
20
  [![Paper](https://img.shields.io/badge/arXiv-2604.15670-b31b1b)](https://arxiv.org/abs/2604.15670)
21
  [![Model](https://img.shields.io/badge/HuggingFace-WhynotHug%2FPixDLM-yellow)](https://huggingface.co/WhynotHug/PixDLM)
22
  [![Dataset](https://img.shields.io/badge/HuggingFace-WhynotHug%2FDRSeg-green)](https://huggingface.co/datasets/WhynotHug/DRSeg)
23
+ [![Project Page](https://img.shields.io/badge/Project-PixDLM-blue)](https://huggingface.co/spaces/WhynotHug/PixDLM)
24
 
 
 
 
 
 
 
25
 
26
  ## Highlights
27
 
 
43
  β”œβ”€β”€ docs/ # Reproducibility and data/model documentation
44
  β”œβ”€β”€ examples/ # Minimal local examples and expected file layout
45
  β”œβ”€β”€ pretrained/pixdlm-7b/ # Lightweight model config/tokenizer files
46
+ β”œβ”€β”€ release/huggingface/ # Model card, dataset card, Space, upload helpers
47
  β”œβ”€β”€ eval.py # Evaluation entry point
48
  β”œβ”€β”€ train_ds.py # Training entry point
49
  └── requirements.txt
 
154
  Typical per-sample artifacts include the input image, predicted mask, ground
155
  truth mask, red/green overlay, and a JSON result file.
156
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
157
  ## Dataset
158
 
159
  DRSeg is available at: