File size: 1,590 Bytes
a3f4c34 1e7e21f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 |
---
license: mit
datasets:
- APRIL-AIGC/UltraVideo
- DropletX/DropletVideo-10M
language:
- en
---
# Pyramidal Spectrum
### Frequency-based Hierarchically Vector Quantized VAE for Videos
**Official Implementation — WACV 2026**
This repository provides the **official implementation** of the paper:
**Pyramidal Spectrum: Frequency-based Hierarchically Vector Quantized VAE for Videos**
*Accepted at WACV 2026*
We introduce a **new autoencoder trained on 4K-resolution video data**, featuring a **hierarchical frequency-based vector quantization** method.
The model leverages a **pyramidal spectral representation** to produce high-fidelity video reconstructions with an efficient latent structure.
---
## 📦 Installation
This implementation requires installing Diffusers from the custom branch:
```bash
pip install git+https://github.com/Onkarsus13/diffusers@MMVQVae
```
## 🚀 Features
- Novel **hierarchical frequency-domain quantization**
- Trained on **4K-resolution** video datasets
- Multi-level **pyramidal spectral decomposition**
- Highly efficient latent video representation
- High-quality reconstructions suitable for generative pipelines
---
```
@inproceedings{pyramidal_spectrum_wacv2026,
title = {Pyramidal Spectrum: Frequency-based Hierarchically Vector Quantized VAE for Videos},
author = {Tushar, Prakash and Onkar, Susladkar and Inderjit,
Inderjit Dhillon and Sparsh Mittal},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
year = {2026}
}
```
|