File size: 2,107 Bytes
5480438 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 | ---
license: apache-2.0
library_name: diffusers
tags:
- video
- diffusion
- vae
- decoder
- wan
- pixel-space
- pid
pipeline_tag: image-to-video
---
# Video-PiD: Pixel-Space Decoder for Wan 2.1
A small 3D pixel-space diffusion model that runs on top of Wan 2.1's VAE-decoded video frames to fix the "plastic" / waxy look of latent diffusion decoders.
**Status: pre-alpha. No weights yet.** This repo will hold the trained checkpoints. The source code lives at [github.com/madxmoron/video-pid](https://github.com/madxmoron/video-pid).
```
Wan 2.1 1.3B T2V Video-PiD
┌──────────┐ Wan-VAE ┌──────────┐ residual ┌──────────┐
│ text │──▶ decode ─────▶│ pixel │──▶ denoise ──▶│ pixel │──▶ video
│ latent │ (plastic) │ frames │ (4 steps) │ frames │ (sharp)
└──────────┘ └──────────┘ └──────────┘
```
## Why
Latent diffusion decoders (Wan-VAE, SD-VAE, etc.) throw away high-frequency detail and re-introduce a "waxy" smoothness. Video-PiD is a tiny post-pass that re-denoises the decoded frames in pixel space, conditioning on the original latent, and outputs a residual that adds back the detail.
Inspired by NVIDIA's [PiD](https://research.nvidia.com/labs/sil/projects/pid/) (image-only). We extend it to video, in 3D, as a plug-in for Wan 2.1.
## Roadmap
- [ ] Architecture spec pinned (in progress)
- [ ] Training run on Panda-70M / HD-VGGT
- [ ] First checkpoint release (v0.1.0)
- [ ] ComfyUI node
See [github.com/madxmoron/video-pid/blob/main/docs/ROADMAP.md](https://github.com/madxmoron/video-pid/blob/main/docs/ROADMAP.md) for the full plan.
## License
Apache 2.0.
## Citation
```bibtex
@software{video_pid_2026,
author = {madxmoron},
title = {Video-PiD: Pixel-Space Decoder for Wan 2.1},
year = {2026},
url = {https://github.com/madxmoron/video-pid}
}
```
|