Instructions to use RuneXX/LTX-2.3-Workflows with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use RuneXX/LTX-2.3-Workflows with LTX-2:

# Install the LTX-2 pipelines
git clone https://github.com/Lightricks/LTX-2.git
cd LTX-2
uv sync --extra natten

# Download weights from this repo
# Substitute filenames from this repo's "Files and versions" if they differ
hf download RuneXX/LTX-2.3-Workflows \
    diffusion_models/<distilled-transformer>.safetensors \
    text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \
    vae/<video-vae>.safetensors \
    vae/<audio-vae>.safetensors \
    latent_upscale_models/<spatial-upsampler>.safetensors \
    latent_upscale_models/<temporal-upsampler>.safetensors \
    --local-dir models/LTX-2.3-Workflows
# DFR requires the detailing IC-LoRA (separate repo; strength is fixed at 0.5)
hf download Lightricks/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler --local-dir models/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler

# Distilled LTX-2.5 pipeline (fast)
uv run python -m ltx_pipelines.distilled \
    --transformer-path models/LTX-2.3-Workflows/diffusion_models/<distilled-transformer>.safetensors \
    --text-encoder-path models/LTX-2.3-Workflows/text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \
    --video-vae-path models/LTX-2.3-Workflows/vae/<video-vae>.safetensors \
    --audio-vae-path models/LTX-2.3-Workflows/vae/<audio-vae>.safetensors \
    --spatial-upsampler-path models/LTX-2.3-Workflows/latent_upscale_models/<spatial-upsampler>.safetensors \
    --num-frames 121 \
    --prompt "A beautiful sunset over the ocean" \
    --output-path output.mp4
# For image-to-video, add: --image path/to/image.jpg 0 0.8

# DFR pipeline (higher detail fidelity; optional temporal 2x/4x)
uv run python -m ltx_pipelines.dfr_pipeline \
    --transformer-path models/LTX-2.3-Workflows/diffusion_models/<distilled-transformer>.safetensors \
    --text-encoder-path models/LTX-2.3-Workflows/text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \
    --video-vae-path models/LTX-2.3-Workflows/vae/<video-vae>.safetensors \
    --audio-vae-path models/LTX-2.3-Workflows/vae/<audio-vae>.safetensors \
    --spatial-upsampler-path models/LTX-2.3-Workflows/latent_upscale_models/<spatial-upsampler>.safetensors \
    --temporal-upsampler-path models/LTX-2.3-Workflows/latent_upscale_models/<temporal-upsampler>.safetensors \
    --detailing-lora models/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler/ltx-2.5-22b-ic-lora-pixel-spatial-upscaler-x2-1.0.safetensors \
    --spatial-upscalings 1 \
    --temporal-upscalings 1 \
    --height 1088 \
    --width 1920 \
    --num-frames 121 \
    --prompt "A beautiful sunset over the ocean" \
    --output-path output.mp4
# For 4K: --spatial-upscalings 2 --width 3840 --height 2176
# For image-to-video, add: --image path/to/image.jpg 0 0.8

Notebooks
Google Colab
Kaggle

Id lora with reference image and audio

#84

by kanetsuguH - opened Apr 6

Discussion

kanetsuguH

Apr 6

Hello, I'm trying to use the LTX-2.3_-_I2V_T2V_Basic_ID-Lora_reference_audio workflow. I want to maintain the exact same character from my reference image throughout the generated video. Is there a way to do that?

RuneXX

Owner Apr 6

The ID-Lora is for the voice (only).
Unfortunately all video models do lose a bit of facial consistency over time.

There is a new lora that might help, I didnt try it yet, but seems to aim at helping character consistency
https://huggingface.co/elix3r/LTX-2.3-22b-AV-LoRA-talking-head
I'll try that lora soon ;-)

Other remedies can be to start with a close up face portrait as first frame, and also use the latent reference image node to guide (but i think that node is already in use in the workflow, i'll check)

RuneXX

Owner Apr 6

a quick test run with the talking head lora. Didnt do a 1-1 comparison, but perhaps it helps a bit

kanetsuguH

Apr 6

oh great i'll try it out thanks alot!

kanetsuguH changed discussion status to closed Apr 6

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment