Instructions to use vidfom/Ltx-3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use vidfom/Ltx-3 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="vidfom/Ltx-3", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-qat-UD-Q4_K_XL.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use vidfom/Ltx-3 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use Docker
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- LM Studio
- Jan
- Ollama
How to use vidfom/Ltx-3 with Ollama:
ollama run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Unsloth Studio new
How to use vidfom/Ltx-3 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for vidfom/Ltx-3 to start chatting
- Docker Model Runner
How to use vidfom/Ltx-3 with Docker Model Runner:
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Lemonade
How to use vidfom/Ltx-3 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull vidfom/Ltx-3:UD-Q4_K_XL
Run and chat with the model
lemonade run user.Ltx-3-UD-Q4_K_XL
List all available models
lemonade list
| { | |
| "last_node_id": 9, | |
| "last_link_id": 8, | |
| "nodes": [ | |
| { | |
| "id": 3, | |
| "type": "LoadImage", | |
| "pos": [ | |
| 290, | |
| 340 | |
| ], | |
| "size": [ | |
| 315, | |
| 314 | |
| ], | |
| "flags": {}, | |
| "order": 0, | |
| "mode": 0, | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 2 | |
| ], | |
| "shape": 3 | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null, | |
| "shape": 3 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "1280x720car.jpg", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 4, | |
| "type": "LoadImage", | |
| "pos": [ | |
| 290, | |
| 710 | |
| ], | |
| "size": [ | |
| 315, | |
| 314.0000114440918 | |
| ], | |
| "flags": {}, | |
| "order": 1, | |
| "mode": 0, | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 3 | |
| ], | |
| "shape": 3, | |
| "slot_index": 0 | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null, | |
| "shape": 3 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "1344x768_redcar.png", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 7, | |
| "type": "LoadImage", | |
| "pos": [ | |
| 990, | |
| 650 | |
| ], | |
| "size": { | |
| "0": 315, | |
| "1": 314 | |
| }, | |
| "flags": {}, | |
| "order": 2, | |
| "mode": 0, | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 5 | |
| ], | |
| "shape": 3, | |
| "slot_index": 0 | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null, | |
| "shape": 3 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "1344x768_hair.png", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 8, | |
| "type": "LoadImage", | |
| "pos": [ | |
| 980, | |
| 1020 | |
| ], | |
| "size": { | |
| "0": 315, | |
| "1": 314 | |
| }, | |
| "flags": {}, | |
| "order": 3, | |
| "mode": 0, | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 8 | |
| ], | |
| "shape": 3, | |
| "slot_index": 0 | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null, | |
| "shape": 3 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "768x1344_dress.png", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 1, | |
| "type": "LayerUtility: ImageReel", | |
| "pos": [ | |
| 650, | |
| 590 | |
| ], | |
| "size": { | |
| "0": 315, | |
| "1": 238 | |
| }, | |
| "flags": {}, | |
| "order": 5, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "image1", | |
| "type": "IMAGE", | |
| "link": 2 | |
| }, | |
| { | |
| "name": "image2", | |
| "type": "IMAGE", | |
| "link": 3 | |
| }, | |
| { | |
| "name": "image3", | |
| "type": "IMAGE", | |
| "link": null | |
| }, | |
| { | |
| "name": "image4", | |
| "type": "IMAGE", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "reel", | |
| "type": "Reel", | |
| "links": [ | |
| 1 | |
| ], | |
| "shape": 3, | |
| "slot_index": 0 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LayerUtility: ImageReel" | |
| }, | |
| "widgets_values": [ | |
| "image1 on reel1", | |
| "image2 on reel1", | |
| "image3", | |
| "image4", | |
| 768, | |
| 32 | |
| ] | |
| }, | |
| { | |
| "id": 5, | |
| "type": "LayerUtility: ImageReel", | |
| "pos": [ | |
| 1350, | |
| 750 | |
| ], | |
| "size": { | |
| "0": 315, | |
| "1": 238 | |
| }, | |
| "flags": {}, | |
| "order": 6, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "image1", | |
| "type": "IMAGE", | |
| "link": 4 | |
| }, | |
| { | |
| "name": "image2", | |
| "type": "IMAGE", | |
| "link": 5 | |
| }, | |
| { | |
| "name": "image3", | |
| "type": "IMAGE", | |
| "link": 8 | |
| }, | |
| { | |
| "name": "image4", | |
| "type": "IMAGE", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "reel", | |
| "type": "Reel", | |
| "links": [ | |
| 6 | |
| ], | |
| "shape": 3, | |
| "slot_index": 0 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LayerUtility: ImageReel" | |
| }, | |
| "widgets_values": [ | |
| "image1 on reel2", | |
| "image2 on reel2", | |
| "image3 on reel2", | |
| "image4", | |
| 1024, | |
| 32 | |
| ] | |
| }, | |
| { | |
| "id": 2, | |
| "type": "LayerUtility: ImageReelComposit", | |
| "pos": [ | |
| 1690, | |
| 590 | |
| ], | |
| "size": { | |
| "0": 315, | |
| "1": 190 | |
| }, | |
| "flags": {}, | |
| "order": 7, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "reel_1", | |
| "type": "Reel", | |
| "link": 1 | |
| }, | |
| { | |
| "name": "reel_2", | |
| "type": "Reel", | |
| "link": 6 | |
| }, | |
| { | |
| "name": "reel_3", | |
| "type": "Reel", | |
| "link": null | |
| }, | |
| { | |
| "name": "reel_4", | |
| "type": "Reel", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "image1", | |
| "type": "IMAGE", | |
| "links": [ | |
| 7 | |
| ], | |
| "shape": 3, | |
| "slot_index": 0 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LayerUtility: ImageReelComposit" | |
| }, | |
| "widgets_values": [ | |
| "Alibaba-PuHuiTi-Heavy.ttf", | |
| 40, | |
| 32, | |
| "light" | |
| ] | |
| }, | |
| { | |
| "id": 9, | |
| "type": "PreviewImage", | |
| "pos": [ | |
| 2060, | |
| 380 | |
| ], | |
| "size": [ | |
| 1023.9856266119964, | |
| 713.8515867095819 | |
| ], | |
| "flags": {}, | |
| "order": 8, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "images", | |
| "type": "IMAGE", | |
| "link": 7 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "PreviewImage" | |
| } | |
| }, | |
| { | |
| "id": 6, | |
| "type": "LoadImage", | |
| "pos": [ | |
| 990, | |
| 280 | |
| ], | |
| "size": { | |
| "0": 315, | |
| "1": 314 | |
| }, | |
| "flags": {}, | |
| "order": 4, | |
| "mode": 0, | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 4 | |
| ], | |
| "shape": 3 | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null, | |
| "shape": 3 | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "768x1344_beach.png", | |
| "image" | |
| ] | |
| } | |
| ], | |
| "links": [ | |
| [ | |
| 1, | |
| 1, | |
| 0, | |
| 2, | |
| 0, | |
| "Reel" | |
| ], | |
| [ | |
| 2, | |
| 3, | |
| 0, | |
| 1, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 3, | |
| 4, | |
| 0, | |
| 1, | |
| 1, | |
| "IMAGE" | |
| ], | |
| [ | |
| 4, | |
| 6, | |
| 0, | |
| 5, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 5, | |
| 7, | |
| 0, | |
| 5, | |
| 1, | |
| "IMAGE" | |
| ], | |
| [ | |
| 6, | |
| 5, | |
| 0, | |
| 2, | |
| 1, | |
| "Reel" | |
| ], | |
| [ | |
| 7, | |
| 2, | |
| 0, | |
| 9, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 8, | |
| 8, | |
| 0, | |
| 5, | |
| 2, | |
| "IMAGE" | |
| ] | |
| ], | |
| "groups": [], | |
| "config": {}, | |
| "extra": { | |
| "ds": { | |
| "scale": 0.6209213230591553, | |
| "offset": [ | |
| 304.4138606804165, | |
| 388.12270422110066 | |
| ] | |
| } | |
| }, | |
| "version": 0.4 | |
| } |