[AAAI 2026] Rectified Noise: A Generative Model Using Positive-incentive Noise
Introduction
This is a Pytorch implementation of Rectified Noise, a generative model using positive-incentive noise to enhance model's sampling.
Setup
We provide an environment.yml file that can be used to create a Conda environment.
conda env create -f environment.yml
conda activate RN
Usage
Training
We provide a training script for RN in
train_rectified_noise.pyRun:
torchrun --nnodes=1 --nproc_per_node=4 train_rectified_noise.py \
--data-path /path/to/data \
--num-classes 3 \
--path-type Linear \
--prediction velocity \
--ckpt /path/to/pretrained_model \
--model SiT-B/2
--learn-mu True \
--depth 1 \
You can find relevant checkpoint files from the previous Hugging Face link.
- Parameters:
| Argument | Type | Default | Description |
|---|---|---|---|
--data-path |
str | - |
Path to the dataset. |
--num-classes |
int | - |
Number of classes. |
--path-type |
str | Linear |
Directory to save the generated images. |
--prediction |
str | velocity |
Output type of network. |
--ckpt |
str | - |
Path to pretrained model checkpoint. |
--model |
str | SiT-B/2 |
Model type, any option from the model list. |
--learn-mu |
bool | True |
Whether to learn the mu parameter. |
--depth |
int | 1 |
Depth parameter for the SiTF2 model(Extra SiT Block). |
Sampling
- Using the trained RN model to enhance the pre-trained model
torchrun --nnodes=1 --nproc_per_node=4 train_rectified_noise.py \
--path-type Linear \
--prediction velocity \
--ckpt /path/to/pretrained_model \
--sitf2-ckpt /path/to/pretrained_RN \
--model SiT-B/2
--learn-mu True \
--depth 1 \
Ackownledgement
This repo benefits from SiT. Thanks for their excellent works.
Contact
If you have any question about this project, please contact mguzhenyu@outlook.com.
Citation
If you find the code useful for your research, please consider citing our work:
@misc{gu2025rectifiednoisegenerativemodel,
title={Rectified Noise: A Generative Model Using Positive-incentive Noise},
author={Zhenyu Gu and Yanchen Xu and Sida Huang and Yubin Guo and Hongyuan Zhang},
year={2025},
eprint={2511.07911},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2511.07911},
}

