Buckets:
| # AutoencoderKLMochi | |
| The 3D variational autoencoder (VAE) model with KL loss used in [Mochi](https://github.com/genmoai/models) was introduced in [Mochi 1 Preview](https://huggingface.co/genmo/mochi-1-preview) by Tsinghua University & ZhipuAI. | |
| The model can be loaded with the following code snippet. | |
| ```python | |
| from diffusers import AutoencoderKLMochi | |
| vae = AutoencoderKLMochi.from_pretrained("genmo/mochi-1-preview", subfolder="vae", torch_dtype=torch.float32).to("cuda") | |
| ``` | |
| ## AutoencoderKLMochi[[diffusers.AutoencoderKLMochi]] | |
| - **in_channels** (int, *optional*, defaults to 3) -- Number of channels in the input image. | |
| - **out_channels** (int, *optional*, defaults to 3) -- Number of channels in the output. | |
| - **block_out_channels** (`tuple[int]`, *optional*, defaults to `(64,)`) -- | |
| tuple of block output channels. | |
| - **act_fn** (`str`, *optional*, defaults to `"silu"`) -- The activation function to use. | |
| - **scaling_factor** (`float`, *optional*, defaults to `1.15258426`) -- | |
| The component-wise standard deviation of the trained latent space computed using the first batch of the | |
| training set. This is used to scale the latent space to have unit variance when training the diffusion | |
| model. The latents are scaled with the formula `z = z * scaling_factor` before being passed to the | |
| diffusion model. When decoding, the latents are scaled back to the original scale with the formula: `z = 1 | |
| / scaling_factor * z`. For more details, refer to sections 4.3.2 and D.1 of the [High-Resolution Image | |
| Synthesis with Latent Diffusion Models](https://huggingface.co/papers/2112.10752) paper. | |
| A VAE model with KL loss for encoding images into latents and decoding latent representations into images. Used in | |
| [Mochi 1 preview](https://github.com/genmoai/models). | |
| This model inherits from [ModelMixin](/docs/diffusers/pr_13881/en/api/models/overview#diffusers.ModelMixin). Check the superclass documentation for it's generic methods implemented | |
| for all models (such as downloading or saving). | |
| - **z** (`torch.Tensor`) -- Input batch of latent vectors. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether to return a `~models.vae.DecoderOutput` instead of a plain tuple.`~models.vae.DecoderOutput` or `tuple`If return_dict is True, a `~models.vae.DecoderOutput` is returned, otherwise a plain `tuple` is | |
| returned. | |
| Decode a batch of images. | |
| - **tile_sample_min_height** (`int`, *optional*) -- | |
| The minimum height required for a sample to be separated into tiles across the height dimension. | |
| - **tile_sample_min_width** (`int`, *optional*) -- | |
| The minimum width required for a sample to be separated into tiles across the width dimension. | |
| - **tile_sample_stride_height** (`int`, *optional*) -- | |
| The minimum amount of overlap between two consecutive vertical tiles. This is to ensure that there are | |
| no tiling artifacts produced across the height dimension. | |
| - **tile_sample_stride_width** (`int`, *optional*) -- | |
| The stride between two consecutive horizontal tiles. This is to ensure that there are no tiling | |
| artifacts produced across the width dimension. | |
| Enable tiled VAE decoding. When this option is enabled, the VAE will split the input tensor into tiles to | |
| compute decoding and encoding in several steps. This is useful for saving a large amount of memory and to allow | |
| processing larger images. | |
| - **x** (`torch.Tensor`) -- Input batch of images. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether to return a `~models.autoencoder_kl.AutoencoderKLOutput` instead of a plain tuple.The latent representations of the encoded videos. If `return_dict` is True, a | |
| `~models.autoencoder_kl.AutoencoderKLOutput` is returned, otherwise a plain `tuple` is returned. | |
| Encode a batch of images into latents. | |
| - **sample** (`torch.Tensor`) -- Input sample. | |
| - **sample_posterior** (`bool`, *optional*, defaults to `False`) -- | |
| Whether to sample from the posterior. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether or not to return a `DecoderOutput` instead of a plain tuple. | |
| - **generator** (`torch.Generator`, *optional*) -- | |
| A [`torch.Generator`](https://pytorch.org/docs/stable/generated/torch.Generator.html) to make sampling | |
| deterministic.`~models.vae.DecoderOutput` or `tuple`If `return_dict` is True, a `~models.vae.DecoderOutput` is returned, otherwise a plain `tuple` is | |
| returned. | |
| - **z** (`torch.Tensor`) -- Input batch of latent vectors. | |
| - **return_dict** (`bool`, *optional*, defaults to `True`) -- | |
| Whether or not to return a `~models.vae.DecoderOutput` instead of a plain tuple.`~models.vae.DecoderOutput` or `tuple`If return_dict is True, a `~models.vae.DecoderOutput` is returned, otherwise a plain `tuple` is | |
| returned. | |
| Decode a batch of images using a tiled decoder. | |
| - **x** (`torch.Tensor`) -- Input batch of videos.`torch.Tensor`The latent representation of the encoded videos. | |
| Encode a batch of images using a tiled encoder. | |
| ## DecoderOutput[[diffusers.models.autoencoders.vae.DecoderOutput]] | |
| - **sample** (`torch.Tensor` of shape `(batch_size, num_channels, height, width)`) -- | |
| The decoded output sample from the last layer of the model. | |
| Output of decoding method. | |
Xet Storage Details
- Size:
- 5.18 kB
- Xet hash:
- 3ede37bbeb37944ec2dcc4021e23b094a93cc7b4a919d265d842da7c64478beb
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.