Instructions to use PrunaAI/PrunaVAED with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use PrunaAI/PrunaVAED with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("PrunaAI/PrunaVAED", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - LTX.io
How to use PrunaAI/PrunaVAED with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download PrunaAI/PrunaVAED --local-dir models/PrunaVAED hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Fast pipeline (distilled model, no distilled LoRA needed) uv run python -m ltx_pipelines.distilled \ --distilled-checkpoint-path models/PrunaVAED/<distilled-checkpoint>.safetensors \ --spatial-upsampler-path models/PrunaVAED/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8# HQ pipeline (two-stage, higher quality) uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path models/PrunaVAED/<checkpoint>.safetensors \ --distilled-lora models/PrunaVAED/<distilled-lora>.safetensors 0.8 \ --spatial-upsampler-path models/PrunaVAED/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -58,29 +58,33 @@ Both columns decode the same LTX-2.3 latent from the distilled pipeline.
|
|
| 58 |
|
| 59 |
<table>
|
| 60 |
<tr>
|
| 61 |
-
<th align="center">LTX-2.3 decoder</th>
|
| 62 |
-
<th align="center">⚡ PrunaVAED</th>
|
| 63 |
</tr>
|
| 64 |
<tr>
|
| 65 |
-
<td>
|
| 66 |
<video controls autoplay muted loop playsinline
|
|
|
|
| 67 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/04MhZs7YN08-Scene-0048.mp4">
|
| 68 |
</video>
|
| 69 |
</td>
|
| 70 |
-
<td>
|
| 71 |
<video controls autoplay muted loop playsinline
|
|
|
|
| 72 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/04MhZs7YN08-Scene-0048.mp4">
|
| 73 |
</video>
|
| 74 |
</td>
|
| 75 |
</tr>
|
| 76 |
<tr>
|
| 77 |
-
<td>
|
| 78 |
<video controls autoplay muted loop playsinline
|
|
|
|
| 79 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/FAfMSWi0FSA-Scene-0200.mp4">
|
| 80 |
</video>
|
| 81 |
</td>
|
| 82 |
-
<td>
|
| 83 |
<video controls autoplay muted loop playsinline
|
|
|
|
| 84 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/FAfMSWi0FSA-Scene-0200.mp4">
|
| 85 |
</video>
|
| 86 |
</td>
|
|
@@ -94,27 +98,26 @@ Both columns decode the same LTX-2.3 latent from the distilled pipeline.
|
|
| 94 |
|
| 95 |
<table>
|
| 96 |
<tr>
|
| 97 |
-
<th align="center">LTX-2.3 decoder</th>
|
| 98 |
-
<th align="center">⚡ PrunaVAED</th>
|
| 99 |
</tr>
|
| 100 |
<tr>
|
| 101 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/8YSha7iU2ZI-Scene-1025.mp4"></video></td>
|
| 102 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/8YSha7iU2ZI-Scene-1025.mp4"></video></td>
|
| 103 |
</tr>
|
| 104 |
<tr>
|
| 105 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/DZt-RtpcJZQ-Scene-0043.mp4"></video></td>
|
| 106 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/DZt-RtpcJZQ-Scene-0043.mp4"></video></td>
|
| 107 |
</tr>
|
| 108 |
<tr>
|
| 109 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/9GDE5-rOOfk-Scene-0010.mp4"></video></td>
|
| 110 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/9GDE5-rOOfk-Scene-0010.mp4"></video></td>
|
| 111 |
</tr>
|
| 112 |
<tr>
|
| 113 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/7y57zc-GvBA-Scene-0009.mp4"></video></td>
|
| 114 |
-
<td><video controls autoplay muted loop playsinline src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/7y57zc-GvBA-Scene-0009.mp4"></video></td>
|
| 115 |
</tr>
|
| 116 |
</table>
|
| 117 |
-
|
| 118 |
</details>
|
| 119 |
|
| 120 |
|
|
|
|
| 58 |
|
| 59 |
<table>
|
| 60 |
<tr>
|
| 61 |
+
<th align="center" width="50%">LTX-2.3 decoder</th>
|
| 62 |
+
<th align="center" width="50%">⚡ PrunaVAED</th>
|
| 63 |
</tr>
|
| 64 |
<tr>
|
| 65 |
+
<td width="50%">
|
| 66 |
<video controls autoplay muted loop playsinline
|
| 67 |
+
style="width:100%; display:block;"
|
| 68 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/04MhZs7YN08-Scene-0048.mp4">
|
| 69 |
</video>
|
| 70 |
</td>
|
| 71 |
+
<td width="50%">
|
| 72 |
<video controls autoplay muted loop playsinline
|
| 73 |
+
style="width:100%; display:block;"
|
| 74 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/04MhZs7YN08-Scene-0048.mp4">
|
| 75 |
</video>
|
| 76 |
</td>
|
| 77 |
</tr>
|
| 78 |
<tr>
|
| 79 |
+
<td width="50%">
|
| 80 |
<video controls autoplay muted loop playsinline
|
| 81 |
+
style="width:100%; display:block;"
|
| 82 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/FAfMSWi0FSA-Scene-0200.mp4">
|
| 83 |
</video>
|
| 84 |
</td>
|
| 85 |
+
<td width="50%">
|
| 86 |
<video controls autoplay muted loop playsinline
|
| 87 |
+
style="width:100%; display:block;"
|
| 88 |
src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/FAfMSWi0FSA-Scene-0200.mp4">
|
| 89 |
</video>
|
| 90 |
</td>
|
|
|
|
| 98 |
|
| 99 |
<table>
|
| 100 |
<tr>
|
| 101 |
+
<th align="center" width="50%">LTX-2.3 decoder</th>
|
| 102 |
+
<th align="center" width="50%">⚡ PrunaVAED</th>
|
| 103 |
</tr>
|
| 104 |
<tr>
|
| 105 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/8YSha7iU2ZI-Scene-1025.mp4"></video></td>
|
| 106 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/8YSha7iU2ZI-Scene-1025.mp4"></video></td>
|
| 107 |
</tr>
|
| 108 |
<tr>
|
| 109 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/DZt-RtpcJZQ-Scene-0043.mp4"></video></td>
|
| 110 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/DZt-RtpcJZQ-Scene-0043.mp4"></video></td>
|
| 111 |
</tr>
|
| 112 |
<tr>
|
| 113 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/9GDE5-rOOfk-Scene-0010.mp4"></video></td>
|
| 114 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/9GDE5-rOOfk-Scene-0010.mp4"></video></td>
|
| 115 |
</tr>
|
| 116 |
<tr>
|
| 117 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/Ltx23VAED/7y57zc-GvBA-Scene-0009.mp4"></video></td>
|
| 118 |
+
<td width="50%"><video controls autoplay muted loop playsinline style="width:100%; display:block;" src="https://huggingface.co/PrunaAI/PrunaVAED/resolve/main/example/PrunaVAED/7y57zc-GvBA-Scene-0009.mp4"></video></td>
|
| 119 |
</tr>
|
| 120 |
</table>
|
|
|
|
| 121 |
</details>
|
| 122 |
|
| 123 |
|