Update model card with metadata, links, and usage example

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +34 -9
README.md CHANGED
@@ -1,20 +1,32 @@
1
-
 
 
 
 
2
 
3
  ## EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling
4
- Arxiv: https://arxiv.org/abs/2502.09509 <br>
5
-
 
6
 
7
- **EQ-VAE** regularizes the latent space of pretrained autoencoders by enforcing equivariance under scaling and rotation transformations.
8
 
9
  ---
10
- #### Model Description
11
- This model is a regularized version of [SD-VAE](https://github.com/CompVis/latent-diffusion). We finetune it with EQ-VAE regularization for 5 epochs on OpenImages.
12
-
13
 
14
  ## Model Usage
15
- These weights are intended to be used with the [EQ-VAE codebase](https://github.com/zelaki/eqvae) or the [CompVis Stable Diffusion codebase](https://github.com/CompVis/stable-diffusion).
16
  If you are looking for the model to use with the 🧨 diffusers library, [come here](https://huggingface.co/zelaki/eq-vae).
17
 
 
 
 
 
 
 
 
 
18
 
19
  #### Metrics
20
  Reconstruction performance of eq-vae-ema on Imagenet Validation Set.
@@ -27,4 +39,17 @@ Reconstruction performance of eq-vae-ema on Imagenet Validation Set.
27
  | **SSIM** | 0.72 |
28
  ---
29
 
30
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: diffusers
4
+ pipeline_tag: image-to-image
5
+ ---
6
 
7
  ## EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling
8
+ Arxiv: [https://arxiv.org/abs/2502.09509](https://arxiv.org/abs/2502.09509)
9
+ Project Page: [https://eq-vae.github.io/](https://eq-vae.github.io/)
10
+ Code: [https://github.com/zelaki/eqvae](https://github.com/zelaki/eqvae)
11
 
12
+ **EQ-VAE** regularizes the latent space of pretrained autoencoders by enforcing equivariance under scaling and rotation transformations.
13
 
14
  ---
15
+ #### Model Description
16
+ This model is a regularized version of [SD-VAE](https://github.com/CompVis/latent-diffusion). We finetune it with EQ-VAE regularization for 5 epochs on OpenImages.
 
17
 
18
  ## Model Usage
19
+ These weights are intended to be used with the [EQ-VAE codebase](https://github.com/zelaki/eqvae) or the [CompVis Stable Diffusion codebase](https://github.com/CompVis/stable-diffusion).
20
  If you are looking for the model to use with the 🧨 diffusers library, [come here](https://huggingface.co/zelaki/eq-vae).
21
 
22
+ ### Quick Start with 🧨 Diffusers
23
+ If you just want to use EQ-VAE to speed up 🚀 the training on your diffusion model, you can use our HuggingFace checkpoints 🤗. We provide two models: [eq-vae](https://huggingface.co/zelaki/eq-vae) and [eq-vae-ema](https://huggingface.co/zelaki/eq-vae-ema).
24
+
25
+ ```python
26
+ from diffusers import AutoencoderKL
27
+ eqvae = AutoencoderKL.from_pretrained("zelaki/eq-vae")
28
+ ```
29
+ If you are looking for the weights in the original LDM format you can find them here: [eq-vae-ldm](https://huggingface.co/zelaki/eq-vae-ldm), [eq-vae-ema-ldm](https://huggingface.co/zelaki/eq-vae-ema-ldm)
30
 
31
  #### Metrics
32
  Reconstruction performance of eq-vae-ema on Imagenet Validation Set.
 
39
  | **SSIM** | 0.72 |
40
  ---
41
 
42
+ ## Acknowledgement
43
+ This code is mainly built upon [LDM](https://github.com/CompVis/latent-diffusion) and [fastDiT](https://github.com/chuanyangjin/fast-DiT).
44
+
45
+ ## Citation
46
+ ```bibtex
47
+ @inproceedings{
48
+ kouzelis2025eqvae,
49
+ title={{EQ}-{VAE}: Equivariance Regularized Latent Space for Improved Generative Image Modeling},
50
+ author={Theodoros Kouzelis and Ioannis Kakogeorgiou and Spyros Gidaris and Nikos Komodakis},
51
+ booktitle={Forty-second International Conference on Machine Learning},
52
+ year={2025},
53
+ url={https://openreview.net/forum?id=UWhW5YYLo6}
54
+ }
55
+ ```