Instructions to use RuneXX/LTX-2.3-Workflows with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LTX.io
How to use RuneXX/LTX-2.3-Workflows with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download RuneXX/LTX-2.3-Workflows --local-dir models/LTX-2.3-Workflows hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Fast pipeline (distilled model, no distilled LoRA needed) uv run python -m ltx_pipelines.distilled \ --distilled-checkpoint-path models/LTX-2.3-Workflows/<distilled-checkpoint>.safetensors \ --spatial-upsampler-path models/LTX-2.3-Workflows/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8# HQ pipeline (two-stage, higher quality) uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path models/LTX-2.3-Workflows/<checkpoint>.safetensors \ --distilled-lora models/LTX-2.3-Workflows/<distilled-lora>.safetensors 0.8 \ --spatial-upsampler-path models/LTX-2.3-Workflows/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
Lip-Sync Tips
I learned this from Civitai: If lip‑sync is not working, convert your audio to stereo and ensure that it doesn't start immediately but with a short pause of 0.2–0.5 seconds at the beginning (both f.ex. using ffmpeg). After following these two hints, lip‑sync worked perfectly with your great workflows. Thanks!
Oh nice tip ;-) Will try that next time I run into one that "refuse" to talk.
Stereo actually makes sense, thinking about it. People talking is wide stereo kind of sound usually, fills the room. And mono/"center-placed" audio being more typical for voice over narrator.
Might be a good trick ;-)
To add to this if you are not using custom audio and are writing dialogue in the prompt and put the video time too short it is like the person(s) in your video thinks "I don't have time to say all that" and instead let a narrator say it.
So try increasing the length if you get a narrator on your prompt.
yes I seen that too, also with actions. If the video length is just to short to be able to do all you put in your prompt, it just wont happen ;-)