Upload 2 files
Browse files
LICENSE
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Academic and Non-Commercial Research Use Only License
|
| 2 |
+
|
| 3 |
+
Copyright (c) 2026 Jaekyun Ko, Byung Wan Lim, Soomin Lee, Dongjin Kim, Tae Hyun Kim
|
| 4 |
+
(Department of Computer Science, Hanyang University)
|
| 5 |
+
|
| 6 |
+
This repository (source code, configuration files, and any accompanying
|
| 7 |
+
pretrained model checkpoints distributed alongside it, e.g. via Hugging Face)
|
| 8 |
+
is provided for ACADEMIC AND NON-COMMERCIAL RESEARCH PURPOSES ONLY.
|
| 9 |
+
|
| 10 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 11 |
+
of this software and associated files (the "Software"), to use, copy,
|
| 12 |
+
modify, merge, and distribute copies of the Software for non-commercial
|
| 13 |
+
research and educational purposes, subject to the following conditions:
|
| 14 |
+
|
| 15 |
+
1. The above copyright notice and this license notice shall be included in
|
| 16 |
+
all copies or substantial portions of the Software.
|
| 17 |
+
2. The Software, in whole or in part, and any derivative works, may NOT be
|
| 18 |
+
used for any commercial purpose without prior written permission from the
|
| 19 |
+
authors. Commercial purposes include, without limitation, selling,
|
| 20 |
+
licensing, or incorporating the Software into a commercial product or
|
| 21 |
+
service, or using it to provide a commercial service.
|
| 22 |
+
3. Any publication or public disclosure of results produced using the
|
| 23 |
+
Software shall cite the associated paper:
|
| 24 |
+
|
| 25 |
+
Jaekyun Ko, Byung Wan Lim, Soomin Lee, Dongjin Kim, and Tae Hyun Kim.
|
| 26 |
+
"YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise
|
| 27 |
+
Generation." arXiv:2607.09193, 2026.
|
| 28 |
+
|
| 29 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 30 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 31 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 32 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 33 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
|
| 34 |
+
FROM, OUT OF, OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
|
| 35 |
+
DEALINGS IN THE SOFTWARE.
|
| 36 |
+
|
| 37 |
+
For commercial licensing inquiries, please contact the corresponding author
|
| 38 |
+
(Tae Hyun Kim, Department of Computer Science, Hanyang University).
|
README.md
ADDED
|
@@ -0,0 +1,70 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: academic-use-only
|
| 4 |
+
license_link: https://github.com/ByungWanLim/YeTI/blob/main/LICENSE
|
| 5 |
+
tags:
|
| 6 |
+
- pytorch
|
| 7 |
+
- image-denoising
|
| 8 |
+
- noise-generation
|
| 9 |
+
- diffusion
|
| 10 |
+
- computer-vision
|
| 11 |
+
- image-to-image
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation
|
| 15 |
+
|
| 16 |
+
**ECCV 2026** · [Paper (arXiv:2607.09193)](https://arxiv.org/abs/2607.09193) · [Code (GitHub)](https://github.com/ByungWanLim/YeTI)
|
| 17 |
+
|
| 18 |
+
Jaekyun Ko<sup>1,2\*</sup>, Byung Wan Lim<sup>1\*</sup>, Soomin Lee<sup>1</sup>, Dongjin Kim<sup>1</sup>, Tae Hyun Kim<sup>1†</sup>
|
| 19 |
+
— <sup>1</sup>Department of Computer Science, Hanyang University, <sup>2</sup>Mobile eXperience (MX) Division, Samsung Electronics
|
| 20 |
+
(<sup>\*</sup>equal contribution, <sup>†</sup>corresponding author)
|
| 21 |
+
|
| 22 |
+
## Model description
|
| 23 |
+
|
| 24 |
+
YeTI is a real-world sRGB noise generation framework that learns to synthesize realistic, signal-dependent sensor noise from only **two noisy observations of the same scene** — no clean ground truth or camera metadata required. It uses a Reconstruction Autoencoder (RAE) to disentangle scene structure from noise characteristics, and a one-step Conditional Diffusion Transformer (C-DiT) trained with consistency objectives to model the latent noise distribution. At inference time, YeTI takes a single noisy image and generates additional realistic noisy samples of the same scene, which can be used to train downstream (self-supervised) denoisers such as AP-BSN and MM-BSN.
|
| 25 |
+
|
| 26 |
+
Full details, training recipe, and evaluation protocol are in the [paper](https://arxiv.org/abs/2607.09193) and the [official code repository](https://github.com/ByungWanLim/YeTI).
|
| 27 |
+
|
| 28 |
+
## Files in this repository
|
| 29 |
+
|
| 30 |
+
| File | Description | Size |
|
| 31 |
+
|---|---|---|
|
| 32 |
+
| `rae.ckpt` | Reconstruction AutoEncoder — disentangles structure / noise latents | ~145 MB |
|
| 33 |
+
| `c_dit.ckpt` | Conditional Diffusion Transformer — main noise generation model | ~817 MB |
|
| 34 |
+
| `apbsn.ckpt` | AP-BSN self-supervised denoiser (baseline) | ~45 MB |
|
| 35 |
+
| `apbsn_mix.ckpt` | AP-BSN denoiser trained with YeTI-generated noisy data added | ~46 MB |
|
| 36 |
+
| `mmbsn.ckpt` | MM-BSN self-supervised denoiser (baseline) | ~81 MB |
|
| 37 |
+
| `mmbsn_mix.ckpt` | MM-BSN denoiser trained with YeTI-generated noisy data added | ~81 MB |
|
| 38 |
+
|
| 39 |
+
## How to use
|
| 40 |
+
|
| 41 |
+
These checkpoints are PyTorch Lightning `.ckpt` files meant to be used with the official [YeTI code repository](https://github.com/ByungWanLim/YeTI), which defines the model architectures (`YeTI/archs`) and LightningModules (`YeTI/models`) needed to load them.
|
| 42 |
+
|
| 43 |
+
```bash
|
| 44 |
+
# 1) Clone the code
|
| 45 |
+
git clone https://github.com/ByungWanLim/YeTI.git
|
| 46 |
+
cd YeTI
|
| 47 |
+
|
| 48 |
+
# 2) Download these weights into ckpt/
|
| 49 |
+
huggingface-cli download BWLim/YeTI --local-dir ckpt
|
| 50 |
+
|
| 51 |
+
# 3) Run validation / generation, e.g.
|
| 52 |
+
python main.py --config configs/val/C-DiT/val_lit_c-dit.yaml --ckpt ckpt/c_dit.ckpt
|
| 53 |
+
```
|
| 54 |
+
|
| 55 |
+
See the repository README for the full training / evaluation / noise-generation usage (environment setup, dataset preparation, and all `run_*.sh` scripts).
|
| 56 |
+
|
| 57 |
+
## Citation
|
| 58 |
+
|
| 59 |
+
```bibtex
|
| 60 |
+
@article{ko2026yeti,
|
| 61 |
+
title = {YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation},
|
| 62 |
+
author = {Ko, Jaekyun and Lim, Byung Wan and Lee, Soomin and Kim, Dongjin and Kim, Tae Hyun},
|
| 63 |
+
journal = {arXiv preprint arXiv:2607.09193},
|
| 64 |
+
year = {2026}
|
| 65 |
+
}
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
## License
|
| 69 |
+
|
| 70 |
+
These model weights are released for **academic / non-commercial research use only**. See [LICENSE](./LICENSE) for full terms. For commercial licensing inquiries, please contact the corresponding author (Tae Hyun Kim, Hanyang University).
|