
Furkan Horoz1, Ozgur Kara1, Kaan Oktay2, Adil Kaan Akan2, Atakan Kara2,
Anand Bhattad3,β , James Matthew Rehg1,β
1University of Illinois at Urbana-Champaign 2fal 3Johns Hopkins University
β Equal advising.
ReDiverse-FT adapter for SD3. Few-step distilled students keep their teacher's activation variance across seeds but
concentrate it into far fewer directions at one block of the first denoising step, so different seeds give near-identical
samples. This rank-32 LoRA on the student's blocks up to transformer_blocks.12 is trained to match the teacher's activations there and
is active in the first sampling step only; the remaining steps run the unmodified student.
| Teacher | 4-step student | This adapter |
|---|---|---|
| SD3-Medium | TDM, distilled from the teacher | ReDiverse-FT LoRA of the student, rediverse_ft.safetensors (89 MB) |

Usage
git clone https://github.com/H-furkan/rediverse && cd rediverse # set up the environments of envs/README.md
hf download ReDiverse/ReDiverse-SD3 --local-dir ReDiverse-SD3
python -m sd3.generate --arm rediverse --adapter ReDiverse-SD3 --prompt "a photo of a fox in the snow" --num-samples 4 # train env
--arm rediverse_ft uses the adapter alone; --arm rediverse (above) also adds the training-free ReDiverse-TF directions, which first runs the teacher on 25 noises for each new prompt (about 15 s on an 80 GB H100) and caches the result. SD3-Medium is gated on the Hub: accept its license and run hf auth login first. Without --adapter, the code downloads the same file from ReDiverse/ReDiverse.
| DINO diversity β (GenEval) | Student | ReDiverse-FT (this adapter) | ReDiverse (FT + TF) | Teacher (multi-step) |
|---|---|---|---|---|
| SD3 | 48.4 | 53.5 | 60.1 | 61.6 |
License
A Derivative Work of Stable Diffusion 3 Medium under the Stability AI Community License; NOTICE holds the attribution notice. Powered by Stability AI.
Citation
@article{horoz2026rediverse,
title = {Restoring Diversity in Distilled Image and Video Generators by Probing Activations},
author = {Horoz, Furkan and Kara, Ozgur and Oktay, Kaan and Akan, Adil Kaan and Kara, Atakan
and Bhattad, Anand and Rehg, James Matthew},
journal = {arXiv preprint arXiv:2611.18550},
year = {2026}
}
- Downloads last month
- -
Model tree for ReDiverse/ReDiverse-SD3
Base model
stabilityai/stable-diffusion-3-medium