|
|
|
|:-------------------------:|:-------------------------:|:-------------------------:|
| Low-light w/ blur | RetinexFormer | **DarkIR** (ours) |
|
|
|
|
| Low-light w/o blur | LEDNet | **DarkIR** (ours) |
## Network Architecture

## Dependencies and Installation
- Python == 3.10.12
- PyTorch == 2.5.1
- CUDA == 12.4
- Other required packages in `requirements.txt`
```bash
# git clone this repository
git clone https://github.com/Fundacion-Cidaut/DarkIR.git
cd DarkIR
# create python environment
python3 -m venv venv_DarkIR
source venv_DarkIR/bin/activate
# install python dependencies
pip install -r requirements.txt
```
## Datasets
The datasets used for training and/or evaluation are:
|Dataset | Sets of images | Source |
| -----------| :---------------:|------|
|LOL-Blur | 10200 training pairs / 1800 test pairs| [LEDNet](https://github.com/sczhou/LEDNet) |
|LOLv2-real | 689 training pairs / 100 test pairs | [Google Drive](https://drive.google.com/file/d/1dzuLCk9_gE2bFF222n3-7GVUlSVHpMYC/view) |
|LOLv2-synth | 900 training pairs / 100 test pairs | [Google Drive](https://drive.google.com/file/d/1dzuLCk9_gE2bFF222n3-7GVUlSVHpMYC/view) |
|LOL | 485 training pairs / 15 test pairs | [Official Site](https://daooshee.github.io/BMVC2018website/) |
|Real-LOLBlur | 1354 unpaired images | [LEDNet](https://github.com/sczhou/LEDNet) |
|LSRW-Nikon | 3150 training pairs / 20 test pairs | [R2RNet](https://github.com/JianghaiSCU/R2RNet) |
|LSRW-Huawei | 2450 training pairs / 30 test pairs | [R2RNet](https://github.com/JianghaiSCU/R2RNet) |
You can download each specific dataset and put it on the `/data/datasets` folder for testing.
## Results
We present results in different datasets for DarkIR of different sizes. While **DarkIR-m** has channel depth of 32, 3.31 M parameters and 7.25 GMACs, **DarkIR-l** has channel depth 64, 12.96 M parameters and 27.19 GMACs.
|Dataset | Model| PSNR| SSIM | LPIPS |
| -----------| :---------------:|:------:|------|------|
|LOL-Blur | DarkIR-m| 27.00| 0.883| 0.162|
| | DarkIR-l| 27.30| 0.898| 0.137|
|LOLv2-real | DarkIR-m| 23.87| 0.880| 0.186|
|LOLv2-synth | DarkIR-m| 25.54| 0.934| 0.058|
|LSRW-Both | DarkIR-m| 18.93| 0.583| 0.412|
We present perceptual metrics for Real-LOLBlur dataset:
| Model| MUSIQ| NRQM | NIQE |
| -----------| :---------------:|:------:|:------:|
| DarkIR-m| 48.36| 4.983| 4.998|
| DarkIR-l| 48.79| 4.917| 5.051|
## Evaluation
To check our results you could run the evaluation of DarkIR in each of the datasets:
- Download the weights of the model from [OneDrive](https://cidautes-my.sharepoint.com/:f:/g/personal/alvgar_cidaut_es/Epntbl4SucFNpeIT_jyYZ-cB9BamMbacbyq_svrkMCpShA?e=XB9YBB) and put them in `/models`.
- run `python testing.py -p ./options/test/LOLv2-real
|
|
|
|
|
|
|:-------------------------:|:-------------------------:|:-------------------------:|:-------------------------:|:-------------------------:|
| Low-light | SNR-Net | RetinexFormer | **DarkIR** (ours) | Ground Truth |
LOLv2-synth
|
|
|
|
|
|
|:-------------------------:|:-------------------------:|:-------------------------:|:-------------------------:|:-------------------------:|\
| Low-light | SNR-Net | RetinexFormer | **DarkIR** (ours) | Ground Truth |
Real-LOLBlur-Night