BWLim commited on
Commit
dedbb4f
·
verified ·
1 Parent(s): 31c7579

Upload 2 files

Browse files
Files changed (2) hide show
  1. LICENSE +38 -0
  2. README.md +70 -0
LICENSE ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Academic and Non-Commercial Research Use Only License
2
+
3
+ Copyright (c) 2026 Jaekyun Ko, Byung Wan Lim, Soomin Lee, Dongjin Kim, Tae Hyun Kim
4
+ (Department of Computer Science, Hanyang University)
5
+
6
+ This repository (source code, configuration files, and any accompanying
7
+ pretrained model checkpoints distributed alongside it, e.g. via Hugging Face)
8
+ is provided for ACADEMIC AND NON-COMMERCIAL RESEARCH PURPOSES ONLY.
9
+
10
+ Permission is hereby granted, free of charge, to any person obtaining a copy
11
+ of this software and associated files (the "Software"), to use, copy,
12
+ modify, merge, and distribute copies of the Software for non-commercial
13
+ research and educational purposes, subject to the following conditions:
14
+
15
+ 1. The above copyright notice and this license notice shall be included in
16
+ all copies or substantial portions of the Software.
17
+ 2. The Software, in whole or in part, and any derivative works, may NOT be
18
+ used for any commercial purpose without prior written permission from the
19
+ authors. Commercial purposes include, without limitation, selling,
20
+ licensing, or incorporating the Software into a commercial product or
21
+ service, or using it to provide a commercial service.
22
+ 3. Any publication or public disclosure of results produced using the
23
+ Software shall cite the associated paper:
24
+
25
+ Jaekyun Ko, Byung Wan Lim, Soomin Lee, Dongjin Kim, and Tae Hyun Kim.
26
+ "YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise
27
+ Generation." arXiv:2607.09193, 2026.
28
+
29
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
30
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
31
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
32
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
33
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
34
+ FROM, OUT OF, OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
35
+ DEALINGS IN THE SOFTWARE.
36
+
37
+ For commercial licensing inquiries, please contact the corresponding author
38
+ (Tae Hyun Kim, Department of Computer Science, Hanyang University).
README.md ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: academic-use-only
4
+ license_link: https://github.com/ByungWanLim/YeTI/blob/main/LICENSE
5
+ tags:
6
+ - pytorch
7
+ - image-denoising
8
+ - noise-generation
9
+ - diffusion
10
+ - computer-vision
11
+ - image-to-image
12
+ ---
13
+
14
+ # YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation
15
+
16
+ **ECCV 2026** · [Paper (arXiv:2607.09193)](https://arxiv.org/abs/2607.09193) · [Code (GitHub)](https://github.com/ByungWanLim/YeTI)
17
+
18
+ Jaekyun Ko<sup>1,2\*</sup>, Byung Wan Lim<sup>1\*</sup>, Soomin Lee<sup>1</sup>, Dongjin Kim<sup>1</sup>, Tae Hyun Kim<sup>1†</sup>
19
+ — <sup>1</sup>Department of Computer Science, Hanyang University, <sup>2</sup>Mobile eXperience (MX) Division, Samsung Electronics
20
+ (<sup>\*</sup>equal contribution, <sup>†</sup>corresponding author)
21
+
22
+ ## Model description
23
+
24
+ YeTI is a real-world sRGB noise generation framework that learns to synthesize realistic, signal-dependent sensor noise from only **two noisy observations of the same scene** — no clean ground truth or camera metadata required. It uses a Reconstruction Autoencoder (RAE) to disentangle scene structure from noise characteristics, and a one-step Conditional Diffusion Transformer (C-DiT) trained with consistency objectives to model the latent noise distribution. At inference time, YeTI takes a single noisy image and generates additional realistic noisy samples of the same scene, which can be used to train downstream (self-supervised) denoisers such as AP-BSN and MM-BSN.
25
+
26
+ Full details, training recipe, and evaluation protocol are in the [paper](https://arxiv.org/abs/2607.09193) and the [official code repository](https://github.com/ByungWanLim/YeTI).
27
+
28
+ ## Files in this repository
29
+
30
+ | File | Description | Size |
31
+ |---|---|---|
32
+ | `rae.ckpt` | Reconstruction AutoEncoder — disentangles structure / noise latents | ~145 MB |
33
+ | `c_dit.ckpt` | Conditional Diffusion Transformer — main noise generation model | ~817 MB |
34
+ | `apbsn.ckpt` | AP-BSN self-supervised denoiser (baseline) | ~45 MB |
35
+ | `apbsn_mix.ckpt` | AP-BSN denoiser trained with YeTI-generated noisy data added | ~46 MB |
36
+ | `mmbsn.ckpt` | MM-BSN self-supervised denoiser (baseline) | ~81 MB |
37
+ | `mmbsn_mix.ckpt` | MM-BSN denoiser trained with YeTI-generated noisy data added | ~81 MB |
38
+
39
+ ## How to use
40
+
41
+ These checkpoints are PyTorch Lightning `.ckpt` files meant to be used with the official [YeTI code repository](https://github.com/ByungWanLim/YeTI), which defines the model architectures (`YeTI/archs`) and LightningModules (`YeTI/models`) needed to load them.
42
+
43
+ ```bash
44
+ # 1) Clone the code
45
+ git clone https://github.com/ByungWanLim/YeTI.git
46
+ cd YeTI
47
+
48
+ # 2) Download these weights into ckpt/
49
+ huggingface-cli download BWLim/YeTI --local-dir ckpt
50
+
51
+ # 3) Run validation / generation, e.g.
52
+ python main.py --config configs/val/C-DiT/val_lit_c-dit.yaml --ckpt ckpt/c_dit.ckpt
53
+ ```
54
+
55
+ See the repository README for the full training / evaluation / noise-generation usage (environment setup, dataset preparation, and all `run_*.sh` scripts).
56
+
57
+ ## Citation
58
+
59
+ ```bibtex
60
+ @article{ko2026yeti,
61
+ title = {YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation},
62
+ author = {Ko, Jaekyun and Lim, Byung Wan and Lee, Soomin and Kim, Dongjin and Kim, Tae Hyun},
63
+ journal = {arXiv preprint arXiv:2607.09193},
64
+ year = {2026}
65
+ }
66
+ ```
67
+
68
+ ## License
69
+
70
+ These model weights are released for **academic / non-commercial research use only**. See [LICENSE](./LICENSE) for full terms. For commercial licensing inquiries, please contact the corresponding author (Tae Hyun Kim, Hanyang University).