Instructions to use RuneXX/LTX-2.3-Workflows with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LTX.io
How to use RuneXX/LTX-2.3-Workflows with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download RuneXX/LTX-2.3-Workflows --local-dir models/LTX-2.3-Workflows hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Fast pipeline (distilled model, no distilled LoRA needed) uv run python -m ltx_pipelines.distilled \ --distilled-checkpoint-path models/LTX-2.3-Workflows/<distilled-checkpoint>.safetensors \ --spatial-upsampler-path models/LTX-2.3-Workflows/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8# HQ pipeline (two-stage, higher quality) uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path models/LTX-2.3-Workflows/<checkpoint>.safetensors \ --distilled-lora models/LTX-2.3-Workflows/<distilled-lora>.safetensors 0.8 \ --spatial-upsampler-path models/LTX-2.3-Workflows/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
You can use the video extending workflow as a cameo, just like in Sora 2.
I've discovered something really cool with LTX. Let's say you record a short video of yourself, say 3 to 5 seconds, talking in it. Then you use this video for the video extending workflow and write something like this prompt:
Instant video cut: the scene and background change to a busy beach. The same man, wearing the same shirt, is now walking along a beach in beautiful weather and says, "What beautiful weather, and especially what beautiful women are here!". Vlog style, the man looks at the viewer.
You can now see yourself walking on the beach and what's being said is now your own voice, cool, right? I've already made several videos with this, and it works incredibly well if you use the right prompt. It's important to mention that it's the same person. Try it out yourself and let me know how well it worked for you.
Oh nice ;-) thats a creative idea for sure.
And yes LTX is capable of creating scene cuts via the prompting, even time stamps etc. Its quite a "jack of all trades" and got quite a lot of creative potential
Will try your idea too ;-)