xiangzai's picture
Add files using upload-large-folder tool
0389e9b verified

[AAAI 2026] Rectified Noise: A Generative Model Using Positive-incentive Noise

Visualization of the $\pi$-noise by $\Delta$RN.


HuggingFace

Introduction

This is a Pytorch implementation of Rectified Noise, a generative model using positive-incentive noise to enhance model's sampling.

Overview of Laytrol

Setup

We provide an environment.yml file that can be used to create a Conda environment.

conda env create -f environment.yml
conda activate RN

Usage

Training

  1. We provide a training script for RN in train_rectified_noise.py

    Run:

torchrun --nnodes=1 --nproc_per_node=4  train_rectified_noise.py  \
--data-path /path/to/data \
--num-classes 3 \
--path-type Linear \
--prediction velocity  \
--ckpt /path/to/pretrained_model \
--model SiT-B/2
--learn-mu True \
--depth 1 \

You can find relevant checkpoint files from the previous Hugging Face link.

  1. Parameters:
Argument Type Default Description
--data-path str - Path to the dataset.
--num-classes int - Number of classes.
--path-type str Linear Directory to save the generated images.
--prediction str velocity Output type of network.
--ckpt str - Path to pretrained model checkpoint.
--model str SiT-B/2 Model type, any option from the model list.
--learn-mu bool True Whether to learn the mu parameter.
--depth int 1 Depth parameter for the SiTF2 model(Extra SiT Block).

Sampling

  1. Using the trained RN model to enhance the pre-trained model
torchrun --nnodes=1 --nproc_per_node=4  train_rectified_noise.py  \
--path-type Linear \
--prediction velocity  \
--ckpt /path/to/pretrained_model \
--sitf2-ckpt /path/to/pretrained_RN \
--model SiT-B/2
--learn-mu True \
--depth 1 \

Ackownledgement

This repo benefits from SiT. Thanks for their excellent works.

Contact

If you have any question about this project, please contact mguzhenyu@outlook.com.

Citation

If you find the code useful for your research, please consider citing our work:

@misc{gu2025rectifiednoisegenerativemodel,
      title={Rectified Noise: A Generative Model Using Positive-incentive Noise}, 
      author={Zhenyu Gu and Yanchen Xu and Sida Huang and Yubin Guo and Hongyuan Zhang},
      year={2025},
      eprint={2511.07911},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2511.07911}, 
}