Instructions to use vidfom/Ltx-3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use vidfom/Ltx-3 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="vidfom/Ltx-3", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-qat-UD-Q4_K_XL.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use vidfom/Ltx-3 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use Docker
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- LM Studio
- Jan
- Ollama
How to use vidfom/Ltx-3 with Ollama:
ollama run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Unsloth Studio
How to use vidfom/Ltx-3 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for vidfom/Ltx-3 to start chatting
- Docker Model Runner
How to use vidfom/Ltx-3 with Docker Model Runner:
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Lemonade
How to use vidfom/Ltx-3 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull vidfom/Ltx-3:UD-Q4_K_XL
Run and chat with the model
lemonade run user.Ltx-3-UD-Q4_K_XL
List all available models
lemonade list
| { | |
| "id": "07b812b5-5037-4878-90bc-32d3a1f36619", | |
| "revision": 0, | |
| "last_node_id": 7, | |
| "last_link_id": 5, | |
| "nodes": [ | |
| { | |
| "id": 5, | |
| "type": "VHS_VideoCombine", | |
| "pos": [ | |
| 732, | |
| -23 | |
| ], | |
| "size": [ | |
| 210, | |
| 334 | |
| ], | |
| "flags": {}, | |
| "order": 2, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "images", | |
| "type": "IMAGE", | |
| "link": 2 | |
| }, | |
| { | |
| "name": "audio", | |
| "shape": 7, | |
| "type": "AUDIO", | |
| "link": 3 | |
| }, | |
| { | |
| "name": "meta_batch", | |
| "shape": 7, | |
| "type": "VHS_BatchManager", | |
| "link": null | |
| }, | |
| { | |
| "name": "vae", | |
| "shape": 7, | |
| "type": "VAE", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "Filenames", | |
| "type": "VHS_FILENAMES", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VHS_VideoCombine" | |
| }, | |
| "widgets_values": { | |
| "frame_rate": 8, | |
| "loop_count": 0, | |
| "filename_prefix": "AnimateDiff", | |
| "format": "video/webm", | |
| "pix_fmt": "yuv420p", | |
| "crf": 20, | |
| "save_metadata": true, | |
| "trim_to_audio": false, | |
| "pingpong": false, | |
| "save_output": false, | |
| "videopreview": { | |
| "hidden": false, | |
| "paused": false, | |
| "params": {} | |
| } | |
| } | |
| }, | |
| { | |
| "id": 6, | |
| "type": "VHS_VideoCombine", | |
| "pos": [ | |
| 503, | |
| 363 | |
| ], | |
| "size": [ | |
| 210, | |
| 334 | |
| ], | |
| "flags": {}, | |
| "order": 3, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "images", | |
| "type": "IMAGE", | |
| "link": 4 | |
| }, | |
| { | |
| "name": "audio", | |
| "shape": 7, | |
| "type": "AUDIO", | |
| "link": 5 | |
| }, | |
| { | |
| "name": "meta_batch", | |
| "shape": 7, | |
| "type": "VHS_BatchManager", | |
| "link": null | |
| }, | |
| { | |
| "name": "vae", | |
| "shape": 7, | |
| "type": "VAE", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "Filenames", | |
| "type": "VHS_FILENAMES", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VHS_VideoCombine" | |
| }, | |
| "widgets_values": { | |
| "frame_rate": 8, | |
| "loop_count": 0, | |
| "filename_prefix": "AnimateDiff", | |
| "format": "video/h264-mp4", | |
| "pix_fmt": "yuv420p", | |
| "crf": 19, | |
| "save_metadata": true, | |
| "trim_to_audio": false, | |
| "pingpong": false, | |
| "save_output": false, | |
| "videopreview": { | |
| "hidden": false, | |
| "paused": false, | |
| "params": {} | |
| } | |
| } | |
| }, | |
| { | |
| "id": 4, | |
| "type": "VHS_LoadVideoPath", | |
| "pos": [ | |
| 29, | |
| 16 | |
| ], | |
| "size": [ | |
| 221.27618408203125, | |
| 413.1552734375 | |
| ], | |
| "flags": {}, | |
| "order": 0, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "meta_batch", | |
| "shape": 7, | |
| "type": "VHS_BatchManager", | |
| "link": null | |
| }, | |
| { | |
| "name": "vae", | |
| "shape": 7, | |
| "type": "VAE", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "IMAGE", | |
| "type": "IMAGE", | |
| "links": [ | |
| 2, | |
| 4 | |
| ] | |
| }, | |
| { | |
| "name": "frame_count", | |
| "type": "INT", | |
| "links": null | |
| }, | |
| { | |
| "name": "audio", | |
| "type": "AUDIO", | |
| "links": [ | |
| 3 | |
| ] | |
| }, | |
| { | |
| "name": "video_info", | |
| "type": "VHS_VIDEOINFO", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VHS_LoadVideoPath" | |
| }, | |
| "widgets_values": { | |
| "video": "input/bigbuckbunny.mp4", | |
| "force_rate": 8, | |
| "custom_width": 0, | |
| "custom_height": 0, | |
| "frame_load_cap": 30, | |
| "skip_first_frames": 0, | |
| "select_every_nth": 1, | |
| "format": "AnimateDiff", | |
| "videopreview": { | |
| "hidden": false, | |
| "paused": false, | |
| "params": { | |
| "filename": "input/bigbuckbunny.mp4", | |
| "type": "path", | |
| "format": "video/mp4", | |
| "force_rate": 8, | |
| "custom_width": 0, | |
| "custom_height": 0, | |
| "frame_load_cap": 30, | |
| "skip_first_frames": 0, | |
| "select_every_nth": 1 | |
| } | |
| } | |
| } | |
| }, | |
| { | |
| "id": 7, | |
| "type": "VHS_LoadAudio", | |
| "pos": [ | |
| 83, | |
| 564 | |
| ], | |
| "size": [ | |
| 218.93820190429688, | |
| 126 | |
| ], | |
| "flags": {}, | |
| "order": 1, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "audio", | |
| "type": "AUDIO", | |
| "links": [ | |
| 5 | |
| ] | |
| }, | |
| { | |
| "name": "duration", | |
| "type": "FLOAT", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "VHS_LoadAudio" | |
| }, | |
| "widgets_values": { | |
| "audio_file": "input/bigbuckbunny.mp4", | |
| "seek_seconds": 0, | |
| "duration": 5 | |
| } | |
| } | |
| ], | |
| "links": [ | |
| [ | |
| 2, | |
| 4, | |
| 0, | |
| 5, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 3, | |
| 4, | |
| 2, | |
| 5, | |
| 1, | |
| "AUDIO" | |
| ], | |
| [ | |
| 4, | |
| 4, | |
| 0, | |
| 6, | |
| 0, | |
| "IMAGE" | |
| ], | |
| [ | |
| 5, | |
| 7, | |
| 0, | |
| 6, | |
| 1, | |
| "AUDIO" | |
| ] | |
| ], | |
| "groups": [], | |
| "config": {}, | |
| "extra": { | |
| "frontendVersion": "1.25.0", | |
| "VHS_latentpreview": true, | |
| "VHS_latentpreviewrate": 0, | |
| "VHS_MetadataImage": true, | |
| "VHS_KeepIntermediate": true | |
| }, | |
| "version": 0.4, | |
| "tests": { | |
| "5": [{"type": "audio", "key": "nb_read_packets", "value": "177"}], | |
| "6": [{"type": "audio", "key": "nb_read_packets", "value": "176"}], | |
| "length": 2 | |
| } | |
| } |