SachyGuy commited on
Commit
67cea7b
·
verified ·
1 Parent(s): e4236c2

Upload Readme and weights

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ README_figures/display_image.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,127 @@
1
  ---
2
- license: cc-by-nc-sa-4.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: mit
3
+ datasets:
4
+ - Aldunitro/HDRT-TIR-diffusion-enhanced
5
+ language:
6
+ - en
7
+ tags:
8
+ - thermal
9
+ - infrared
10
+ - denoising
11
+ - diffusion
12
+ - transformer
13
+ task_categories:
14
+ - image-to-image
15
+ pretty_name: _Noise2DiffusionEnhanced_
16
+ size_categories:
17
+ - 10K<n<100K
18
  ---
19
+ &nbsp;
20
+
21
+ <div align="center">
22
+
23
+ <table>
24
+ <tr>
25
+
26
+ <td align="center" height="60">
27
+ <a href="https://openaccess.thecvf.com/content/CVPR2026W/PBVS/html/Hazebrouck_Self-supervised_Diffusion-guided_Hallucination-free_Thermal_Infrared_Image_Denoising_CVPRW_2026_paper.html">
28
+ <img src="./README_figures/button_paper.png" height="50"/>
29
+ </a>
30
+ </td>
31
+
32
+ <td align="center" height="60">
33
+ <a href="https://github.com/HensoldtOptronicsCV/Noise2DiffusionEnhanced">
34
+ <img src="./README_figures/button_github.png" height="50"/>
35
+ </a>
36
+ </td>
37
+
38
+ <td align="center" height="60">
39
+ <a href="https://huggingface.co/collections/SachyGuy/diffusion-guided-hallucination-free-tir-image-denoising">
40
+ <img src="./README_figures/button_huggingface.png" height="50"/>
41
+ </a>
42
+ </td>
43
+
44
+ </tr>
45
+ </table>
46
+
47
+ </div>
48
+
49
+ &nbsp;
50
+
51
+ ---
52
+
53
+ # **_Noise2DiffusionEnhanced_ : A Pretrained Ready-to-use TIR Denoising Transformer**
54
+
55
+ **This is part of the official repository of the paper _Self-supervised Diffusion-guided Hallucination-free Thermal Infrared Image Denoising_, 2026.**
56
+ &nbsp;
57
+
58
+ ![Graphical Abstract](./README_figures/display_image.png)
59
+ _Our approach uses diffusion-based image enhancement and realistic TIR image degradation to generate image pairs for supervised learning (a) and leverages remarkable visual quality of diffusion models (c) without suffering from hallucinations (d-e)._
60
+
61
+ &nbsp;
62
+ ## Overview
63
+
64
+ The _Noise2DiffusionEnhanced_ is part of the work described in "Self-supervised Diffusion-guided Hallucination-free Thermal Infrared Image Denoising", F. Hazebrouck, A. Schock-Schmidtke, N. Stuhrmann,
65
+ J. Fottner, M. Teutsch (2026). The paper is available [here](https://openaccess.thecvf.com/content/CVPR2026W/PBVS/html/Hazebrouck_Self-supervised_Diffusion-guided_Hallucination-free_Thermal_Infrared_Image_Denoising_CVPRW_2026_paper.html).
66
+
67
+ The _Noise2DiffusionEnhanced_ is a pretrained [Uformer architecture](https://openaccess.thecvf.com/content/CVPR2022/html/Wang_Uformer_A_General_U-Shaped_Transformer_for_Image_Restoration_CVPR_2022_paper.html) [[1]](#1) for TIR sensor noise denoising. It was trained on the [HDRT-TIR-diffusion-enhanced](https://huggingface.co/datasets/Aldunitro/HDRT-TIR-diffusion-enhanced) dataset. The [pretrained weights](./model_best.pth) published here can be inserted in the [GitHub Project](https://github.com/HensoldtOptronicsCV/Noise2DiffusionEnhanced) for inference or fine-tuning.
68
+
69
+ This pretrained model should contribute to filling the current lack of reference denoising models for Thermal Infrared (TIR) single-image denoising, for direct use as well as for related research.
70
+
71
+
72
+ &nbsp;
73
+ ## Files
74
+
75
+ - [model_best.pth](./model_best.pth) is the pretrained-weight file.
76
+ It can only be used with the associated [project codebase](https://github.com/HensoldtOptronicsCV/Noise2DiffusionEnhanced), where is described how to insert it to run inference or fine-tune the weights.
77
+
78
+
79
+ &nbsp;
80
+ ## Citation
81
+
82
+ If you use the _Noise2DiffusionEnhanced_, please cite our work:
83
+
84
+ @article{hazebrouck_self-supervised_2026,
85
+ title = {Self-supervised Diffusion-guided Hallucination-free Thermal Infrared Image Denoising},
86
+ booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
87
+ author = {Hazebrouck, Félix and Schock-Schmidtke, Alexander and Stuhrmann, Norbert and Fottner, Johannes and Teutsch, Michael},
88
+ year = {2026},
89
+ pages = {7091--7101},
90
+ }
91
+
92
+
93
+ &nbsp;
94
+ ## License and Copyrights
95
+ The model weights were obtained using different code-compounds, each with its proper license:
96
+ - The model architecture is a U-Former, introduced in [[1]](#1). The [original code](github.com/ZhendongWang6/Uformer) was adapted for our project and the modified version along with all license-notices with respect to the original source is available on our [project codebase](https://github.com/HensoldtOptronicsCV/Noise2DiffusionEnhanced) and is licensed under the MIT license. As we publish no code parts here, and because the code of [[1]](#1) only indirectly contributed to those weights, we cite them only for transparency.
97
+ - The model was trained with our _HDRT-TIR-DE_ dataset, which is licensed under the [CC-BY-NC-SA-4.0](https://spdx.org/licenses/CC-BY-NC-SA-4.0) license. The _HDRT-TIR-DE_ dataset itself is a modified version of the HDRT dataset introduced in [[2]](#2), but because the _HDRT-TIR-DE_ already comply with the licensing of the HDRT, as explicitly stated on the [_HDRT-TIR-DE_ repository](https://huggingface.co/datasets/SachyGuy/HDRT-TIR-DE) and only indirectly contributed to the weights, only the license from the _HDRT-TIR-DE_ dataset applies here.
98
+ According to the license of the _HDRT-TIR-DE_ Dataset ([CC-BY-NC-SA-4.0](https://spdx.org/licenses/CC-BY-NC-SA-4.0)), any "adapted material" must be licensed under the same or a compatible license, therefore including these pre-trained weights.
99
+ - The degradation model used to synthesize the noisy counterparts for the clean images from the _HDRT-TIR-DE_ dataset for the supervised training of the UFormer is adapted from the noise model introduced in [[3]](#3). The [original code](https://github.com/cailijing/MDIVDnet) was adapted for our project and the modified version along with all license-notices with respect to the original source is available on our [project codebase](https://github.com/HensoldtOptronicsCV/Noise2DiffusionEnhanced) and is licensed under the [MIT license](https://opensource.org/license/mit). As we publish no code parts here, and because the code of [[3]](#3) only indirectly contributed to those weights, we cite them only for transparency.
100
+
101
+ Therefore, the pre-trained weights published in this repository inherit the [CC-BY-NC-SA-4.0](https://spdx.org/licenses/CC-BY-NC-SA-4.0) license from the _HDRT-TIR-DE_ dataset. According to this license, we must include the original dataset authors, a copyright notice, a link to original dataset, a link to license, and a statement of modifications.
102
+
103
+ Authors:
104
+ © Félix Hazebrouck, Alexander Schock-Schmidtke, Norbert Stuhrmann, Johannes Fottner, Michael Teutsch
105
+
106
+ Original dataset:
107
+ _HDRT-TIR-DE_ dataset, available at https://huggingface.co/datasets/SachyGuy/HDRT-TIR-DE, introduced in _Self-supervised Diffusion-guided Hallucination-free Thermal Infrared Image Denoising_ by Hazebrouck et al., 2026.
108
+
109
+ License:
110
+ Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International
111
+ https://spdx.org/licenses/CC-BY-NC-SA-4.0
112
+
113
+ Modifications:
114
+ We encoded the statistical information from the _HDRT-TIR-DE_ dataset in the hereby published pretrained neural-network architecture weights through a process of machine learning.
115
+
116
+ These pretrained weights are distributed under the same license (CC-BY-NC-SA-4.0).
117
+
118
+
119
+ ## References
120
+ <a id="1">[1]</a>
121
+ Zhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou, Jianzhuang Liu and Houqiang Li. _Uformer: A general u-shaped transformer for image restoration_. CVPR, 2022
122
+
123
+ <a id="2">[2]</a>
124
+ Jingchao Peng, Thomas Bashford-Rogers, Francesco Banterle, Haitao Zhao and Kurt Debattista. _HDRT: A large-scale dataset for infrared-guided HDR imaging_. Elsevier Information Fusion, 120, 2025
125
+
126
+ <a id="3">[3]</a>
127
+ Lijing Cai, Xiangyu Dong, Kailai Zhou and Xun Cao. _Exploring video denoising in thermal infrared imaging: Physics-inspired noise generator, dataset, and model_, IEEE 2022
README_figures/button_github.png ADDED
README_figures/button_huggingface.png ADDED
README_figures/button_paper.png ADDED
README_figures/display_image.png ADDED

Git LFS Details

  • SHA256: bf41708bd5cbfc46cee18f42ba3d47ba11e7fabadd5dff34553f731c10392890
  • Pointer size: 131 Bytes
  • Size of remote file: 895 kB
model_best.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ef2ae807ecea5fe36ba9fc0f24f109fafa9e617ab55303f07b6d6fc9cc0e5be
3
+ size 612815345