Buckets:
| # AutoencoderKLMagvit | |
| The 3D variational autoencoder (VAE) model with KL loss used in [EasyAnimate](https://github.com/aigc-apps/EasyAnimate) was introduced by Alibaba PAI. | |
| The model can be loaded with the following code snippet. | |
| ```python | |
| from diffusers import AutoencoderKLMagvit | |
| vae = AutoencoderKLMagvit.from_pretrained("alibaba-pai/EasyAnimateV5.1-12b-zh", subfolder="vae", torch_dtype=torch.float16).to("cuda") | |
| ``` | |
| ## AutoencoderKLMagvit[[diffusers.AutoencoderKLMagvit]] | |
| A VAE model with KL loss for encoding images into latents and decoding latent representations into images. This | |
| model is used in [EasyAnimate](https://huggingface.co/papers/2405.18991). | |
| This model inherits from [ModelMixin](/docs/diffusers/pr_13881/en/api/models/overview#diffusers.ModelMixin). Check the superclass documentation for it's generic methods implemented | |
| for all models (such as downloading or saving). | |
| - **z** (`torch.Tensor`) -- Input batch of latent vectors. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether to return a `~models.vae.DecoderOutput` instead of a plain tuple.`~models.vae.DecoderOutput` or `tuple`If return_dict is True, a `~models.vae.DecoderOutput` is returned, otherwise a plain `tuple` is | |
| returned. | |
| Decode a batch of images. | |
| - **x** (`torch.Tensor`) -- Input batch of images. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether to return a `~models.autoencoder_kl.AutoencoderKLOutput` instead of a plain tuple.The latent representations of the encoded videos. If `return_dict` is True, a | |
| `~models.autoencoder_kl.AutoencoderKLOutput` is returned, otherwise a plain `tuple` is returned. | |
| Encode a batch of images into latents. | |
| - **tile_sample_min_height** (`int`, *optional*) -- | |
| The minimum height required for a sample to be separated into tiles across the height dimension. | |
| - **tile_sample_min_width** (`int`, *optional*) -- | |
| The minimum width required for a sample to be separated into tiles across the width dimension. | |
| - **tile_sample_stride_height** (`int`, *optional*) -- | |
| The minimum amount of overlap between two consecutive vertical tiles. This is to ensure that there are | |
| no tiling artifacts produced across the height dimension. | |
| - **tile_sample_stride_width** (`int`, *optional*) -- | |
| The stride between two consecutive horizontal tiles. This is to ensure that there are no tiling | |
| artifacts produced across the width dimension. | |
| Enable tiled VAE decoding. When this option is enabled, the VAE will split the input tensor into tiles to | |
| compute decoding and encoding in several steps. This is useful for saving a large amount of memory and to allow | |
| processing larger images. | |
| - **sample** (`torch.Tensor`) -- Input sample. | |
| - **sample_posterior** (`bool`, *optional*, defaults to `False`) -- | |
| Whether to sample from the posterior. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether or not to return a `DecoderOutput` instead of a plain tuple. | |
| - **generator** (`torch.Generator`, *optional*) -- | |
| A [`torch.Generator`](https://pytorch.org/docs/stable/generated/torch.Generator.html) to make sampling | |
| deterministic.`~models.vae.DecoderOutput` or `tuple`If `return_dict` is True, a `~models.vae.DecoderOutput` is returned, otherwise a plain `tuple` is | |
| returned. | |
| ## AutoencoderKLOutput[[diffusers.models.modeling_outputs.AutoencoderKLOutput]] | |
| - **latent_dist** (`DiagonalGaussianDistribution`) -- | |
| Encoded outputs of `Encoder` represented as the mean and logvar of `DiagonalGaussianDistribution`. | |
| `DiagonalGaussianDistribution` allows for sampling latents from the distribution. | |
| Output of AutoencoderKL encoding method. | |
| ## DecoderOutput[[diffusers.models.autoencoders.vae.DecoderOutput]] | |
| - **sample** (`torch.Tensor` of shape `(batch_size, num_channels, height, width)`) -- | |
| The decoded output sample from the last layer of the model. | |
| Output of decoding method. | |
Xet Storage Details
- Size:
- 3.87 kB
- Xet hash:
- d07aea959f70ec6a1ce302f8b310790d1416c88761267836f80a3c99f9822a6d
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.