Instructions to use vidfom/Ltx-3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use vidfom/Ltx-3 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="vidfom/Ltx-3", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-qat-UD-Q4_K_XL.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use vidfom/Ltx-3 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use Docker
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- LM Studio
- Jan
- Ollama
How to use vidfom/Ltx-3 with Ollama:
ollama run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Unsloth Studio new
How to use vidfom/Ltx-3 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for vidfom/Ltx-3 to start chatting
- Docker Model Runner
How to use vidfom/Ltx-3 with Docker Model Runner:
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Lemonade
How to use vidfom/Ltx-3 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull vidfom/Ltx-3:UD-Q4_K_XL
Run and chat with the model
lemonade run user.Ltx-3-UD-Q4_K_XL
List all available models
lemonade list
| { | |
| "last_node_id": 19, | |
| "last_link_id": 20, | |
| "nodes": [ | |
| { | |
| "id": 18, | |
| "type": "PrimitiveNode", | |
| "pos": [ | |
| 318, | |
| 618 | |
| ], | |
| "size": [ | |
| 210, | |
| 82 | |
| ], | |
| "flags": {}, | |
| "order": 0, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "INT", | |
| "type": "INT", | |
| "links": [ | |
| 18 | |
| ], | |
| "widget": { | |
| "name": "crf" | |
| } | |
| } | |
| ], | |
| "properties": { | |
| "Run widget replace on values": false | |
| }, | |
| "widgets_values": [ | |
| 60, | |
| "fixed" | |
| ] | |
| }, | |
| { | |
| "id": 11, | |
| "type": "LoadImage", | |
| "pos": [ | |
| 260.4530029296875, | |
| 233.2003173828125 | |
| ], | |
| "size": [ | |
| 315, | |
| 314 | |
| ], | |
| "flags": {}, | |
| "order": 1, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 19 | |
| ], | |
| "slot_index": 0 | |
| }, | |
| { | |
| "name": "MASK", | |
| "type": "MASK", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "LoadImage" | |
| }, | |
| "widgets_values": [ | |
| "example.png", | |
| "image" | |
| ] | |
| }, | |
| { | |
| "id": 17, | |
| "type": "VHS_VideoCombine", | |
| "pos": [ | |
| 733.3749389648438, | |
| 338.28924560546875 | |
| ], | |
| "size": [ | |
| 222.91415405273438, | |
| 522.9141845703125 | |
| ], | |
| "flags": {}, | |
| "order": 3, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "images", | |
| "type": "IMAGE", | |
| "link": 19 | |
| }, | |
| { | |
| "name": "audio", | |
| "type": "AUDIO", | |
| "link": null, | |
| "shape": 7 | |
| }, | |
| { | |
| "name": "meta_batch", | |
| "type": "VHS_BatchManager", | |
| "link": null, | |
| "shape": 7 | |
| }, | |
| { | |
| "name": "vae", | |
| "type": "VAE", | |
| "link": null, | |
| "shape": 7 | |
| }, | |
| { | |
| "name": "crf", | |
| "type": "INT", | |
| "link": 18, | |
| "widget": { | |
| "name": "crf" | |
| } | |
| }, | |
| { | |
| "name": "pix_fmt", | |
| "type": [ | |
| "yuv420p", | |
| "yuv420p10le" | |
| ], | |
| "link": 20, | |
| "widget": { | |
| "name": "pix_fmt" | |
| } | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "Filenames", | |
| "type": "VHS_FILENAMES", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VHS_VideoCombine" | |
| }, | |
| "widgets_values": { | |
| "frame_rate": 8, | |
| "loop_count": 0, | |
| "filename_prefix": "AnimateDiff", | |
| "format": "video/h264-mp4", | |
| "pix_fmt": "yuv420p10le", | |
| "crf": 60, | |
| "save_metadata": true, | |
| "pingpong": false, | |
| "save_output": false, | |
| "videopreview": { | |
| "hidden": false, | |
| "paused": false, | |
| "params": { | |
| "filename": "AnimateDiff_00001.mp4", | |
| "subfolder": "", | |
| "type": "temp", | |
| "format": "video/h264-mp4", | |
| "frame_rate": 8 | |
| }, | |
| "muted": false | |
| } | |
| } | |
| }, | |
| { | |
| "id": 19, | |
| "type": "PrimitiveNode", | |
| "pos": [ | |
| 300, | |
| 760 | |
| ], | |
| "size": [ | |
| 290, | |
| 110 | |
| ], | |
| "flags": {}, | |
| "order": 2, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "COMBO", | |
| "type": "COMBO", | |
| "links": [ | |
| 20 | |
| ], | |
| "widget": { | |
| "name": "pix_fmt" | |
| } | |
| } | |
| ], | |
| "properties": { | |
| "Run widget replace on values": false | |
| }, | |
| "widgets_values": [ | |
| "yuv420p10le", | |
| "fixed", | |
| "" | |
| ] | |
| } | |
| ], | |
| "links": [ | |
| [ | |
| 18, | |
| 18, | |
| 0, | |
| 17, | |
| 4, | |
| "INT" | |
| ], | |
| [ | |
| 19, | |
| 11, | |
| 0, | |
| 17, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 20, | |
| 19, | |
| 0, | |
| 17, | |
| 5, | |
| [ | |
| "yuv420p", | |
| "yuv420p10le" | |
| ] | |
| ] | |
| ], | |
| "groups": [], | |
| "config": {}, | |
| "extra": { | |
| "ds": { | |
| "scale": 0.8264462809917354, | |
| "offset": [ | |
| 45.8650452880864, | |
| -157.46987175292935 | |
| ] | |
| } | |
| }, | |
| "version": 0.4, | |
| "tests": { | |
| "17": [{"type": "video", "key": "pix_fmt", "value": "yuv420p10le"} | |
| ], | |
| "length": 1 | |
| } | |
| } | |