Instructions to use dumpy50222/ComfyUI_LTX_Wan_Models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use dumpy50222/ComfyUI_LTX_Wan_Models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: llama cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: llama cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Use Docker
docker model run hf.co/dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
- LM Studio
- Jan
- Ollama
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Ollama:
ollama run hf.co/dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
- Unsloth Studio
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for dumpy50222/ComfyUI_LTX_Wan_Models to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for dumpy50222/ComfyUI_LTX_Wan_Models to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for dumpy50222/ComfyUI_LTX_Wan_Models to start chatting
- Pi
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use dumpy50222/ComfyUI_LTX_Wan_Models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Docker Model Runner:
docker model run hf.co/dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
- Lemonade
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Run and chat with the model
lemonade run user.ComfyUI_LTX_Wan_Models-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Run Hermes
hermes
- Atomic Chat
| { | |
| "file_name": "LTX23_audio_vae_bf16", | |
| "model_name": "LTX2.3 FP4", | |
| "file_path": "G:/AI/ComfyUI/models/checkpoints/LTX23_audio_vae_bf16.safetensors", | |
| "size": 364855188, | |
| "modified": 1782017998.667268, | |
| "sha256": "5bc10fa4adecf99dda132d916e23048cbd56797702c5fa50eb5d2079048a38c3", | |
| "base_model": "LTXV2", | |
| "preview_url": "G:/AI/ComfyUI/models/checkpoints/LTX23_audio_vae_bf16.mp4", | |
| "preview_nsfw_level": 1, | |
| "notes": "", | |
| "from_civitai": true, | |
| "civitai": { | |
| "id": 2750820, | |
| "modelId": 2445970, | |
| "name": "LTX2.3 Audio Vae", | |
| "nsfwLevel": 1, | |
| "createdAt": "2026-03-07T03:09:46.946Z", | |
| "updatedAt": "2026-03-18T04:45:04.597Z", | |
| "status": "Published", | |
| "publishedAt": "2026-03-07T03:12:01.493Z", | |
| "trainedWords": [], | |
| "trainingStatus": null, | |
| "trainingDetails": null, | |
| "baseModel": "LTXV2", | |
| "baseModelType": "Standard", | |
| "earlyAccessEndsAt": null, | |
| "earlyAccessConfig": null, | |
| "description": "<p>Audio vae for TFO model</p>", | |
| "uploadType": "Created", | |
| "usageControl": "Download", | |
| "licensingFee": null, | |
| "air": "urn:air:ltxv2:checkpoint:civitai:2445970@2750820", | |
| "stats": { | |
| "downloadCount": 592, | |
| "thumbsUpCount": 12 | |
| }, | |
| "model": { | |
| "name": "LTX2.3 FP4", | |
| "type": "Checkpoint", | |
| "nsfw": false, | |
| "poi": false, | |
| "description": "<h1 id=\"ltx2.3-fp4-models\"><strong>LTX2.3 FP4 Models</strong></h1><h3 id=\"because-no-one-uploads-fp4-here.-and-they-should-(fp4-works-on-3xxx-and-above-for-vram-savings.)\">Because no one uploads FP4 here. and they should (fp4 works on 3xxx and above for vram savings.)</h3><p>LTX2.3 Distilled FP4ME - Distilled FP4 Mixed Extreme - 14.1GB**<br />LTX2.3 Full Dev FP4ME - Full Dev FP4 Mixed Extreme - 14.1GB**<br />LTX2.3 Official NVFP4 - From Lightricks - Updated 3/17/2026 - 21GB<br />LTX2.3 Dev NVFP4 - from <a target=\"_blank\" rel=\"ugc\" href=\"https://huggingface.co/Hippotes\">Hippotes / </a><a target=\"_blank\" rel=\"ugc\" href=\"https://huggingface.co/Hippotes/LTX-2.3-various-formats\">LTX-2.3-various-formats </a>- 18.15GB<br />LTX2.3 Dev FP4 STFO - from Kijai's Transformers only Scaled FP8 - 16.63GB**<br />LTX2.3 Distilled FP4 - My first FP4 - Transformers Only - 18.15GB**<br /><br />** Are transformers only, or I broke vae/text projection :) needs seperate Vae and Text projection downloads.</p><p>I have a fix for lora issue on FP4ME models. Comfy Bathroom, custom lora loader with presets as well as custom config. <a target=\"_blank\" rel=\"ugc\" href=\"https://huggingface.co/MrReclusive/LTX-2.3-FP4\">https://huggingface.co/MrReclusive/LTX-2.3-FP4</a></p><p>Diffusion model loader/unet loader seems to get confused with these, use the checkpoint loader even though it has no clip/vae</p>", | |
| "tags": [ | |
| "ltx2", | |
| "base model", | |
| "ltx2.3", | |
| "fp4" | |
| ], | |
| "allowNoCredit": true, | |
| "allowCommercialUse": [ | |
| "Image", | |
| "RentCivit", | |
| "Rent" | |
| ], | |
| "allowDerivatives": true, | |
| "allowDifferentLicense": true | |
| }, | |
| "files": [ | |
| { | |
| "id": 2637308, | |
| "sizeKB": 356303.89453125, | |
| "name": "ltx23FP4_ltx23AudioVae.safetensors", | |
| "type": "Model", | |
| "pickleScanResult": "Success", | |
| "pickleScanMessage": "No Pickle imports", | |
| "virusScanResult": "Success", | |
| "virusScanMessage": null, | |
| "scannedAt": "2026-03-07T03:15:33.023Z", | |
| "metadata": { | |
| "format": "SafeTensor", | |
| "size": "full", | |
| "fp": "bf16" | |
| }, | |
| "hashes": { | |
| "AutoV1": "1324F6CB", | |
| "AutoV2": "5BC10FA4AD", | |
| "SHA256": "5BC10FA4ADECF99DDA132D916E23048CBD56797702C5FA50EB5D2079048A38C3", | |
| "CRC32": "EA02D754", | |
| "BLAKE3": "3215B775195E9306B7B704970D9B5D15AB40CA42AC5AA861574E83ABEA130684", | |
| "AutoV3": "28CEB51ED018" | |
| }, | |
| "primary": true, | |
| "downloadUrl": "https://civitai.red/api/download/models/2750820" | |
| } | |
| ], | |
| "images": [ | |
| { | |
| "url": "https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/803c5d4c-b254-47fd-b6e9-0f3b113f79fa/original=true/123401038.mp4", | |
| "nsfwLevel": 1, | |
| "width": 1280, | |
| "height": 640, | |
| "hash": "UAAJ~8MwD%-:~oM|D*WU_2M|IUoe_2adIUxZ", | |
| "type": "video", | |
| "metadata": { | |
| "hash": "UAAJ~8MwD%-:~oM|D*WU_2M|IUoe_2adIUxZ", | |
| "size": 5073813, | |
| "audio": true, | |
| "width": 1280, | |
| "height": 640, | |
| "duration": 9.75 | |
| }, | |
| "minor": false, | |
| "poi": false, | |
| "meta": { | |
| "prompt": "Style: cinematic-realistic with muted color palette. A young woman with striking features walks down a busy city street, oblivious to her surroundings as she intensely focuses on her phone. Her long, dark hair cascades down her back like a waterfall of night, framing a pale complexion adorned with subtle freckles and bold, black eyeliner. She wears a fitted, high-collared black dress that accentuates her slender figure, drawing attention to the intricate lace patterns on its hem. The woman's eyes are glued to the screen, her expression one of absorption rather than concern for her environment. As she stumbles forward, passersby weave around her without noticing her impending collision with a large, colorful sign featuring an animated bong in the foreground. With a comical jolt, the woman collides with the sign, causing her to lose balance and tumble backward onto the pavement with a soft thud. Her phone goes flying from her grasp as she lets out a startled \"Oww\" in a deep, throaty voice, her eyes widening with surprise. The sound of scuffling footsteps echoes through the area, followed by the muted murmur of onlookers' concerned whispers. Amidst this commotion, a city bus rumbles by in the background, releasing a gentle whoosh of air as it passes, while the soundscape is also filled with distant traffic hum and muffled conversations from nearby pedestrians. As the woman struggles to stand up, brushing off her dress with a hint of embarrassment, text appears on screen at the bottom, displayed in a playful, sans-serif font: 'Don't Text & Adult'. The words remain for several seconds before fading out as the scene gradually returns to the bustling city atmosphere, the woman's expression now one of sheepishness and awareness." | |
| }, | |
| "availability": "Public", | |
| "hasMeta": true, | |
| "hasPositivePrompt": true, | |
| "onSite": false, | |
| "remixOfId": null | |
| } | |
| ], | |
| "downloadUrl": "https://civitai.red/api/download/models/2750820", | |
| "creator": { | |
| "username": "MrReclusive666", | |
| "image": null | |
| } | |
| }, | |
| "tags": [ | |
| "ltx2", | |
| "base model", | |
| "ltx2.3", | |
| "fp4" | |
| ], | |
| "modelDescription": "<h1 id=\"ltx2.3-fp4-models\"><strong>LTX2.3 FP4 Models</strong></h1><h3 id=\"because-no-one-uploads-fp4-here.-and-they-should-(fp4-works-on-3xxx-and-above-for-vram-savings.)\">Because no one uploads FP4 here. and they should (fp4 works on 3xxx and above for vram savings.)</h3><p>LTX2.3 Distilled FP4ME - Distilled FP4 Mixed Extreme - 14.1GB**<br />LTX2.3 Full Dev FP4ME - Full Dev FP4 Mixed Extreme - 14.1GB**<br />LTX2.3 Official NVFP4 - From Lightricks - Updated 3/17/2026 - 21GB<br />LTX2.3 Dev NVFP4 - from <a target=\"_blank\" rel=\"ugc\" href=\"https://huggingface.co/Hippotes\">Hippotes / </a><a target=\"_blank\" rel=\"ugc\" href=\"https://huggingface.co/Hippotes/LTX-2.3-various-formats\">LTX-2.3-various-formats </a>- 18.15GB<br />LTX2.3 Dev FP4 STFO - from Kijai's Transformers only Scaled FP8 - 16.63GB**<br />LTX2.3 Distilled FP4 - My first FP4 - Transformers Only - 18.15GB**<br /><br />** Are transformers only, or I broke vae/text projection :) needs seperate Vae and Text projection downloads.</p><p>I have a fix for lora issue on FP4ME models. Comfy Bathroom, custom lora loader with presets as well as custom config. <a target=\"_blank\" rel=\"ugc\" href=\"https://huggingface.co/MrReclusive/LTX-2.3-FP4\">https://huggingface.co/MrReclusive/LTX-2.3-FP4</a></p><p>Diffusion model loader/unet loader seems to get confused with these, use the checkpoint loader even though it has no clip/vae</p>", | |
| "civitai_deleted": false, | |
| "favorite": false, | |
| "exclude": false, | |
| "db_checked": false, | |
| "skip_metadata_refresh": false, | |
| "metadata_source": "civitai_api", | |
| "last_checked_at": 1782019053.220402, | |
| "hash_status": "completed", | |
| "usage_tips": "{}", | |
| "sub_type": "checkpoint" | |
| } |