ilessio-aiflowlab commited on
Commit
a43fe51
·
verified ·
1 Parent(s): d494c67

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +63 -0
README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - rgb-thermal
5
+ - semantic-segmentation
6
+ - segformer
7
+ - defense
8
+ - anima
9
+ datasets:
10
+ - MFNet
11
+ - PST900
12
+ - FMB
13
+ metrics:
14
+ - mIoU
15
+ pipeline_tag: image-segmentation
16
+ ---
17
+
18
+ # DEF-rtfdnet: RTFDNet for Robust RGB-T Segmentation
19
+
20
+ ANIMA Defense Module implementing **RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentation** (ArXiv 2603.09149).
21
+
22
+ ## Architecture
23
+
24
+ - **Backbone**: BIMixVisionTransformer (dual-stream SegFormer MiT-B2, 50.4M params)
25
+ - **Fusion**: EAEF_clip (CLIP-style cross-modal alignment) + gated feature fusion at each of 4 stages
26
+ - **Losses**: CE + Modal CE + AKD (feature distillation) + RegionL1 (logit distillation)
27
+ - **Input**: 6-channel tensor (RGB + Thermal), 480x640 or 512x512
28
+
29
+ ## Results
30
+
31
+ | Dataset | Classes | mIoU | Accuracy |
32
+ |---------|---------|------|----------|
33
+ | MFNet | 9 | 0.929 | 0.979 |
34
+ | PST900 | 5 | training... | - |
35
+ | FMB | 14 | training... | - |
36
+
37
+ ## Exports
38
+
39
+ Each dataset variant includes:
40
+ - `model.safetensors` - PyTorch weights
41
+ - `model.onnx` - ONNX (opset 17)
42
+ - `model_fp16.trt` - TensorRT FP16
43
+ - `model_fp32.trt` - TensorRT FP32
44
+
45
+ ## Usage
46
+
47
+ ```python
48
+ from def_rtfdnet.model import build_rtfdnet
49
+ model = build_rtfdnet(variant='mit_b2', num_classes=9, pretrained='models/mit_b2.pth')
50
+ ```
51
+
52
+ ## Citation
53
+
54
+ ```bibtex
55
+ @article{tan2026rtfdnet,
56
+ title={RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentation},
57
+ author={Tan, Kunyu and Liang, Mingjian},
58
+ journal={arXiv preprint arXiv:2603.09149},
59
+ year={2026}
60
+ }
61
+ ```
62
+
63
+ Built with ANIMA by Robot Flow Labs