raulbalmez commited on
Commit
355dacb
Β·
verified Β·
1 Parent(s): dfa7200

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +173 -1
README.md CHANGED
@@ -1,5 +1,177 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
4
 
5
- Paper: https://arxiv.org/abs/2508.17885
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ tags:
4
+ - low-light
5
+ - low-light-image-enhancement
6
+ - image-enhancement
7
+ - image-restoration
8
+ - computer-vision
9
+ - transformer
10
+ - transformers
11
+ - vision-transformer
12
+ - vision-transformers
13
+ - image-segmentation
14
+ - illumination
15
+ - LoRA
16
+ - Mixture of Experts
17
+ model-index:
18
+ - name: ISALux
19
+ results:
20
+ - task:
21
+ type: low-light-image-enhancement
22
+ dataset:
23
+ name: LOL-v1
24
+ type: LOL-v1
25
+ metrics:
26
+ - type: PSNR
27
+ value: 27.63
28
+ name: PSNR
29
+ - type: SSIM
30
+ value: 0.881
31
+ name: SSIM
32
+ - task:
33
+ type: low-light-image-enhancement
34
+ dataset:
35
+ name: LOL-v2-Real
36
+ type: LOL-v2-Real
37
+ metrics:
38
+ - type: PSNR
39
+ value: 29.76
40
+ name: PSNR
41
+ - type: SSIM
42
+ value: 0.908
43
+ name: SSIM
44
+ - task:
45
+ type: low-light-image-enhancement
46
+ dataset:
47
+ name: LOL-v2-Synthetic
48
+ type: LOL-v2-Synthetic
49
+ metrics:
50
+ - type: PSNR
51
+ value: 30.78
52
+ name: PSNR
53
+ - type: SSIM
54
+ value: 0.956
55
+ name: SSIM
56
+ - task:
57
+ type: low-light-image-enhancement
58
+ dataset:
59
+ name: SDSD-indoor
60
+ type: SDSD-indoor
61
+ metrics:
62
+ - type: PSNR
63
+ value: 30.67
64
+ name: PSNR
65
+ - type: SSIM
66
+ value: 0.909
67
+ name: SSIM
68
+ - task:
69
+ type: low-light-image-enhancement
70
+ dataset:
71
+ name: SDSD-outdoor
72
+ type: SDSD-outdoor
73
+ metrics:
74
+ - type: PSNR
75
+ value: 31.58
76
+ name: PSNR
77
+ - type: SSIM
78
+ value: 0.895
79
+ name: SSIM
80
+ - task:
81
+ type: low-light-image-enhancement
82
+ dataset:
83
+ name: LOL Blur
84
+ type: LOL-Blur
85
+ metrics:
86
+ - type: PSNR
87
+ value: 28.01
88
+ name: PSNR
89
+ - type: SSIM
90
+ value: 0.903
91
+ name: SSIM
92
+ - task:
93
+ type: low-light-image-enhancement
94
+ dataset:
95
+ name: MEF
96
+ type: MEF
97
+ metrics:
98
+ - type: NIQE
99
+ value: 3.58
100
+ name: NIQE
101
+ - task:
102
+ type: low-light-image-enhancement
103
+ dataset:
104
+ name: LIME
105
+ type: LIME
106
+ metrics:
107
+ - type: NIQE
108
+ value: 3.91
109
+ name: NIQE
110
+ - task:
111
+ type: low-light-image-enhancement
112
+ dataset:
113
+ name: DICM
114
+ type: DICM
115
+ metrics:
116
+ - type: NIQE
117
+ value: 3.21
118
+ name: NIQE
119
+ - task:
120
+ type: low-light-image-enhancement
121
+ dataset:
122
+ name: NPE
123
+ type: NPE
124
+ metrics:
125
+ - type: NIQE
126
+ value: 3.40
127
+ name: NIQE
128
+ pipeline_tag: image-to-image
129
  ---
130
 
131
+ # 🌌 ISALux: Illumination & Semantics Aware Transformer with Mixture of Experts
132
+
133
+ <div align="center">
134
+
135
+ πŸ‘©β€πŸ’» **Authors:**
136
+ [Raul Balmez](https://scholar.google.com/citations?user=vPC7raQAAAAJ&hl=en), [Alexandru Brateanu](https://scholar.google.com/citations?user=ru0meGgAAAAJ&hl=en), [Ciprian Orhei](https://scholar.google.com/citations?user=DZHdq3wAAAAJ&hl=en), [Codruta Ancuti](https://scholar.google.com/citations?user=5PA43eEAAAAJ&hl=en), [Cosmin Ancuti](https://scholar.google.com/citations?user=zVTgt8IAAAAJ&hl=en)
137
+
138
+ πŸ“„ [![arXiv](https://img.shields.io/badge/arXiv-2508.17885-b31b1b.svg)](https://arxiv.org/abs/2508.17885)
139
+
140
+ </div>
141
+
142
+ ---
143
+
144
+ ## πŸ”Ž Abstract
145
+ We introduce **ISALux**, a novel transformer-based approach for **Low-Light Image Enhancement (LLIE)** that integrates both illumination and semantic priors.
146
+
147
+ ✨ Key contributions:
148
+ - **HISA-MSA**: A new attention block fusing illumination + semantic segmentation.
149
+ - **Mixture of Experts (MoE)**: Improves contextual learning with conditional activation.
150
+ - **LoRA-enhanced self-attention**: Tackles overfitting across diverse light conditions.
151
+
152
+ Extensive experiments on multiple benchmarks demonstrate **state-of-the-art** performance.
153
+ Ablation studies highlight the role of each proposed component.
154
+
155
+ ---
156
+
157
+ ## πŸ†• Updates
158
+ - **29.07.2025** πŸŽ‰ Our paper [ISALux](https://arxiv.org/abs/2508.17885) is live on arXiv!
159
+ Dive in to explore methods, results, and ablations. πŸš€
160
+
161
+ ---
162
+
163
+
164
+ ---
165
+
166
+ ## πŸ“š Citation
167
+
168
+ ```bibtex
169
+ @misc{balmez2025isaluxilluminationsegmentationaware,
170
+ title={ISALux: Illumination and Segmentation Aware Transformer Employing Mixture of Experts for Low Light Image Enhancement},
171
+ author={Raul Balmez and Alexandru Brateanu and Ciprian Orhei and Codruta Ancuti and Cosmin Ancuti},
172
+ year={2025},
173
+ eprint={2508.17885},
174
+ archivePrefix={arXiv},
175
+ primaryClass={cs.CV},
176
+ url={https://arxiv.org/abs/2508.17885},
177
+ }