flashszn commited on
Commit
de5c239
·
verified ·
1 Parent(s): 0179226

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +106 -3
README.md CHANGED
@@ -1,3 +1,106 @@
1
- ---
2
- license: cc-by-nc-sa-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-sa-4.0
3
+ ---
4
+ # Resfusion
5
+
6
+ Official model weights for **Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise**.
7
+
8
+ This repository hosts pretrained checkpoints intended for **image restoration** tasks, including:
9
+
10
+ - Shadow removal
11
+ - Low-light image enhancement
12
+ - Raindrop removal
13
+
14
+ If you use this model or repository in research, please cite the original paper.
15
+
16
+ ---
17
+
18
+ ## Overview
19
+
20
+ Resfusion is a diffusion-based image restoration framework that incorporates **prior residual noise patterns** into the denoising diffusion process. Compared with standard diffusion-based restoration pipelines, Resfusion is designed to better exploit degradation-aware residual structure for higher-quality restoration.
21
+
22
+ This Hugging Face repository is intended to provide:
23
+
24
+ - Pretrained model weights
25
+ - Basic task descriptions
26
+ - Inference guidance
27
+ - Links to the original codebase and paper
28
+
29
+ ---
30
+
31
+ ## Supported checkpoints
32
+
33
+ You can organize the released weights in this repository with names similar to the following:
34
+
35
+ | Checkpoint | Task | Dataset |
36
+ |---|---|---|
37
+ | `resfusion-istd.ckpt` | Shadow removal | ISTD |
38
+ | `resfusion-lol.ckpt` | Low-light enhancement | LOL |
39
+ | `resfusion-raindrop.ckpt` | Raindrop removal | Raindrop |
40
+
41
+ ---
42
+
43
+ ## Model details
44
+
45
+ - **Model type:** DDPM-based image restoration
46
+ - **Framework:** PyTorch Lightning
47
+ - **Primary use:** Paired image restoration
48
+ - **Input:** Degraded image
49
+ - **Output:** Restored image
50
+
51
+ ### Intended uses
52
+
53
+ This model is intended for research and experimental applications in:
54
+
55
+ - Image restoration benchmarking
56
+ - Shadow removal
57
+ - Low-light enhancement
58
+ - Raindrop removal
59
+ - Diffusion-based restoration studies
60
+
61
+ ---
62
+
63
+ ## Training data
64
+
65
+ The original implementation supports the following datasets:
66
+
67
+ - **ISTD** for shadow removal
68
+ - **LOL** for low-light image enhancement
69
+ - **Raindrop** for raindrop removal
70
+
71
+ Please refer to the original project for exact data preparation, folder structure, and training configuration.
72
+
73
+ ---
74
+
75
+ ## Usage
76
+
77
+ ### Option 1: Use with the official codebase
78
+
79
+ Please use the official Resfusion repository for inference and evaluation:
80
+
81
+ - **Project repository:** `https://github.com/nkicsl/Resfusion`
82
+ - **arXiv link:** `https://arxiv.org/abs/2311.14900`
83
+ - **NeurIPS poster page:** `https://nips.cc/virtual/2024/poster/95696`
84
+
85
+ Typical workflow:
86
+
87
+ 1. Clone the official repository.
88
+ 2. Create the environment from `environment.yaml`.
89
+ 3. Download the checkpoint from this Hugging Face repository.
90
+ 4. Place the checkpoint in your preferred checkpoint directory.
91
+ 5. Run the corresponding test script for your task.
92
+
93
+ ---
94
+
95
+ ## Citation
96
+
97
+ If you use Resfusion in your work, please cite:
98
+
99
+ ```bibtex
100
+ @inproceedings{li2024resfusion,
101
+ title={Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise},
102
+ author={Li, Sihao and Lu, Xingjian and Zhang, Jianzhuang},
103
+ booktitle={Advances in Neural Information Processing Systems},
104
+ year={2024}
105
+ }
106
+ ```