Instructions to use vidfom/Ltx-3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use vidfom/Ltx-3 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="vidfom/Ltx-3", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-qat-UD-Q4_K_XL.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use vidfom/Ltx-3 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf vidfom/Ltx-3:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf vidfom/Ltx-3:UD-Q4_K_XL
Use Docker
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- LM Studio
- Jan
- Ollama
How to use vidfom/Ltx-3 with Ollama:
ollama run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Unsloth Studio new
How to use vidfom/Ltx-3 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for vidfom/Ltx-3 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for vidfom/Ltx-3 to start chatting
- Docker Model Runner
How to use vidfom/Ltx-3 with Docker Model Runner:
docker model run hf.co/vidfom/Ltx-3:UD-Q4_K_XL
- Lemonade
How to use vidfom/Ltx-3 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull vidfom/Ltx-3:UD-Q4_K_XL
Run and chat with the model
lemonade run user.Ltx-3-UD-Q4_K_XL
List all available models
lemonade list
| ## ComfyUI-Manager: installing dependencies done. | |
| [2026-03-29 19:50:26.924] ** ComfyUI startup time: 2026-03-29 19:50:26.924 | |
| [2026-03-29 19:50:26.924] ** Platform: Linux | |
| [2026-03-29 19:50:26.924] ** Python version: 3.12.13 (main, Mar 4 2026, 09:23:07) [GCC 11.4.0] | |
| [2026-03-29 19:50:26.924] ** Python executable: /usr/bin/python3 | |
| [2026-03-29 19:50:26.924] ** ComfyUI Path: /content/ComfyUI | |
| [2026-03-29 19:50:26.924] ** ComfyUI Base Folder Path: /content/ComfyUI | |
| [2026-03-29 19:50:26.924] ** User directory: /content/ComfyUI/user | |
| [2026-03-29 19:50:26.924] ** ComfyUI-Manager config path: /content/ComfyUI/user/__manager/config.ini | |
| [2026-03-29 19:50:26.924] ** Log path: /content/ComfyUI/user/comfyui.log | |
| Prestartup times for custom nodes: | |
| [2026-03-29 19:50:27.073] 0.0 seconds: /content/ComfyUI/custom_nodes/rgthree-comfy | |
| [2026-03-29 19:50:27.073] 0.0 seconds: /content/ComfyUI/custom_nodes/ComfyUI-Easy-Use | |
| [2026-03-29 19:50:27.073] 1.1 seconds: /content/ComfyUI/custom_nodes/ComfyUI-Manager | |
| [2026-03-29 19:50:27.074] | |
| [2026-03-29 19:50:31.775] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations. | |
| [2026-03-29 19:50:31.776] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']} | |
| [2026-03-29 19:50:31.776] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']} | |
| [2026-03-29 19:50:31.776] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_nvfp4']} | |
| [2026-03-29 19:50:31.786] Checkpoint files will always be loaded safely. | |
| [2026-03-29 19:50:32.034] Total VRAM 14913 MB, total RAM 12976 MB | |
| [2026-03-29 19:50:32.034] pytorch version: 2.10.0+cu128 | |
| [2026-03-29 19:50:32.912] xformers version: 0.0.35 | |
| [2026-03-29 19:50:32.913] Set vram state to: NORMAL_VRAM | |
| [2026-03-29 19:50:32.913] Device: cuda:0 Tesla T4 : cudaMallocAsync | |
| [2026-03-29 19:50:32.913] Using async weight offloading with 2 streams | |
| [2026-03-29 19:50:32.913] Enabled pinned memory 12326.0 | |
| [2026-03-29 19:50:32.923] working around nvidia conv3d memory bug. | |
| [2026-03-29 19:50:33.512] Using xformers attention | |
| [2026-03-29 19:50:37.766] DynamicVRAM support detected and enabled | |
| [2026-03-29 19:50:37.766] Python version: 3.12.13 (main, Mar 4 2026, 09:23:07) [GCC 11.4.0] | |
| [2026-03-29 19:50:37.766] ComfyUI version: 0.18.1 | |
| [2026-03-29 19:50:37.767] comfy-aimdo version: 0.2.12 | |
| [2026-03-29 19:50:37.768] comfy-kitchen version: 0.2.8 | |
| [2026-03-29 19:50:37.769] ComfyUI frontend version: 1.42.8 | |
| [2026-03-29 19:50:37.771] [Prompt Server] web root: /usr/local/lib/python3.12/dist-packages/comfyui_frontend_package/static | |
| [2026-03-29 19:50:37.772] Asset seeder disabled | |
| [2026-03-29 19:50:39.456] ComfyUI-GGUF: Allowing full torch compile | |
| [2026-03-29 19:50:39.953] NumExpr defaulting to 2 threads. | |
| [2026-03-29 19:50:41.051] Using xformers attention | |
| [2026-03-29 19:50:41.690] (RES4LYF) Init | |
| [2026-03-29 19:50:41.690] (RES4LYF) Importing beta samplers. | |
| [2026-03-29 19:50:41.703] (RES4LYF) Importing legacy samplers. | |
| [2026-03-29 19:50:41.716] [LTX2-Qwen] transformers 5.4.0 — OK | |
| [2026-03-29 19:50:41.806] | |
| [2026-03-29 19:50:41.806] [92m[rgthree-comfy] Loaded 48 exciting nodes. 🎉[0m | |
| [2026-03-29 19:50:41.806] | |
| [2026-03-29 19:50:41.806] [33m[rgthree-comfy] ComfyUI's new Node 2.0 rendering may be incompatible with some rgthree-comfy nodes and features, breaking some rendering as well as losing the ability to access a node's properties (a vital part of many nodes). It also appears to run MUCH more slowly spiking CPU usage and causing jankiness and unresponsiveness, especially with large workflows. Personally I am not planning to use the new Nodes 2.0 and, unfortunately, am not able to invest the time to investigate and overhaul rgthree-comfy where needed. If you have issues when Nodes 2.0 is enabled, I'd urge you to switch it off as well and join me in hoping ComfyUI is not planning to deprecate the existing, stable canvas rendering all together. | |
| [0m | |
| [2026-03-29 19:50:45.051] Flax classes are deprecated and will be removed in Diffusers v1.0.0. We recommend migrating to PyTorch classes or pinning your version of Diffusers. | |
| [2026-03-29 19:50:45.053] Flax classes are deprecated and will be removed in Diffusers v1.0.0. We recommend migrating to PyTorch classes or pinning your version of Diffusers. | |
| [2026-03-29 19:50:45.130] [34m[ComfyUI-Easy-Use] server: [0mv1.3.7 [92mLoaded[0m | |
| [2026-03-29 19:50:45.131] [34m[ComfyUI-Easy-Use] web root: [0m/content/ComfyUI/custom_nodes/ComfyUI-Easy-Use/web_version/v2 [92mLoaded[0m | |
| [2026-03-29 19:50:45.812] ### Loading: ComfyUI-Manager (V3.39.2) | |
| [2026-03-29 19:50:45.813] [ComfyUI-Manager] network_mode: public | |
| [2026-03-29 19:50:45.813] [ComfyUI-Manager] ComfyUI per-queue preview override detected (PR #11261). Manager's preview method feature is disabled. Use ComfyUI's --preview-method CLI option or 'Settings > Execution > Live preview method'. | |
| [2026-03-29 19:50:45.906] ### ComfyUI Version: v0.18.1-33-ga500f1ed | Released on '2026-03-28' | |
| [2026-03-29 19:50:45.967] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json | |
| [2026-03-29 19:50:46.027] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json | |
| [2026-03-29 19:50:46.061] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json | |
| [2026-03-29 19:50:46.124] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json | |
| [2026-03-29 19:50:46.205] [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json | |
| [2026-03-29 19:50:46.300] Traceback (most recent call last): | |
| File "/content/ComfyUI/nodes.py", line 2227, in load_custom_node | |
| module_spec.loader.exec_module(module) | |
| File "<frozen importlib._bootstrap_external>", line 995, in exec_module | |
| File "<frozen importlib._bootstrap_external>", line 1132, in get_code | |
| File "<frozen importlib._bootstrap_external>", line 1190, in get_data | |
| FileNotFoundError: [Errno 2] No such file or directory: '/content/ComfyUI/custom_nodes/.ipynb_checkpoints/__init__.py' | |
| [2026-03-29 19:50:46.300] Cannot import /content/ComfyUI/custom_nodes/.ipynb_checkpoints module for custom nodes: [Errno 2] No such file or directory: '/content/ComfyUI/custom_nodes/.ipynb_checkpoints/__init__.py' | |
| [2026-03-29 19:50:46.301] | |
| Import times for custom nodes: | |
| [2026-03-29 19:50:46.301] 0.0 seconds (IMPORT FAILED): /content/ComfyUI/custom_nodes/.ipynb_checkpoints | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/LTX2-Master-Loader | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/websocket_image_save.py | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/ComfyUI-MelBandRoFormer | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/rgthree-comfy | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/LTX2EasyPrompt-LD1 | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/ComfyUI-KJNodes | |
| [2026-03-29 19:50:46.301] 0.0 seconds: /content/ComfyUI/custom_nodes/ComfyUI-GGUF | |
| [2026-03-29 19:50:46.301] 0.1 seconds: /content/ComfyUI/custom_nodes/ComfyUI-LTXVideo | |
| [2026-03-29 19:50:46.301] 0.1 seconds: /content/ComfyUI/custom_nodes/ComfyUI-Manager | |
| [2026-03-29 19:50:46.301] 0.3 seconds: /content/ComfyUI/custom_nodes/ComfyUI_LayerStyle | |
| [2026-03-29 19:50:46.302] 0.7 seconds: /content/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite | |
| [2026-03-29 19:50:46.302] 0.8 seconds: /content/ComfyUI/custom_nodes/RES4LYF | |
| [2026-03-29 19:50:46.302] 1.5 seconds: /content/ComfyUI/custom_nodes/LTX2EasyPrompt-LD | |
| [2026-03-29 19:50:46.302] 3.3 seconds: /content/ComfyUI/custom_nodes/ComfyUI-Easy-Use | |
| [2026-03-29 19:50:46.302] | |
| [2026-03-29 19:50:46.305] Context impl SQLiteImpl. | |
| [2026-03-29 19:50:46.305] Will assume non-transactional DDL. | |
| [2026-03-29 19:50:46.377] Disabling intermediate node cache. | |
| [2026-03-29 19:50:49.687] FETCH ComfyRegistry Data: 5/135 | |
| [2026-03-29 19:50:53.168] FETCH ComfyRegistry Data: 10/135 | |
| [2026-03-29 19:50:56.788] FETCH ComfyRegistry Data: 15/135 | |
| [2026-03-29 19:51:00.114] FETCH ComfyRegistry Data: 20/135 | |
| [2026-03-29 19:51:03.425] FETCH ComfyRegistry Data: 25/135 | |
| [2026-03-29 19:51:06.922] FETCH ComfyRegistry Data: 30/135 | |
| [2026-03-29 19:51:10.419] FETCH ComfyRegistry Data: 35/135 | |
| [2026-03-29 19:51:13.310] [DEPRECATION WARNING] Detected import of deprecated legacy API: /scripts/ui.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. | |
| [2026-03-29 19:51:13.314] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/groupNode.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. | |
| [2026-03-29 19:51:13.529] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. | |
| [2026-03-29 19:51:13.746] FETCH ComfyRegistry Data: 40/135 | |
| [2026-03-29 19:51:17.663] [DEPRECATION WARNING] Detected import of deprecated legacy API: /scripts/ui/components/buttonGroup.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. | |
| [2026-03-29 19:51:17.725] FETCH ComfyRegistry Data: 45/135 | |
| [2026-03-29 19:51:18.017] [DEPRECATION WARNING] Detected import of deprecated legacy API: /scripts/ui/components/button.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. | |
| [2026-03-29 19:51:20.972] FETCH ComfyRegistry Data: 50/135 | |
| [2026-03-29 19:51:24.499] FETCH ComfyRegistry Data: 55/135 | |
| [2026-03-29 19:51:28.326] FETCH ComfyRegistry Data: 60/135 | |
| [2026-03-29 19:51:31.930] FETCH ComfyRegistry Data: 65/135 | |
| [2026-03-29 19:51:35.663] FETCH ComfyRegistry Data: 70/135 | |
| [2026-03-29 19:51:39.266] FETCH ComfyRegistry Data: 75/135 | |
| [2026-03-29 19:51:40.151] got prompt | |
| [2026-03-29 19:51:40.572] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/revision/main "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.683] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/GGUF/ggml-model-Q4_K_M.gguf "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:40.703] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/added_tokens.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.705] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/GGUF/ggml-model-f16.gguf "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:40.707] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/GGUF/mmproj-ggml-model-f16.gguf "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:40.716] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/README.md "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.716] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/added_tokens.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.727] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/added_tokens.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.729] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/README.md "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.733] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/LICENSE "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.734] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. | |
| [2026-03-29 19:51:40.737] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/GGUF/ggml-model-q8_0.gguf "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:40.741] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/README.md "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.751] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/.gitattributes "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.758] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/LICENSE "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.769] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/.gitattributes "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.774] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/LICENSE "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.782] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/.gitattributes "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.810] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/xet-read-token/a0d1323db855b5989928f1e4845733c52b2d817c "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.816] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/xet-read-token/a0d1323db855b5989928f1e4845733c52b2d817c "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.818] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/xet-read-token/a0d1323db855b5989928f1e4845733c52b2d817c "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.839] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/chat_template.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.843] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/xet-read-token/a0d1323db855b5989928f1e4845733c52b2d817c "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.846] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.855] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/chat_template.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.859] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.865] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/chat_template.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.871] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.881] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/generation_config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.885] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/merges.txt "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:40.897] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/generation_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.914] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/generation_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.915] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/merges.txt "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.931] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/merges.txt "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:40.974] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/model-00001-of-00002.safetensors "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:40.990] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/model-00002-of-00002.safetensors "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:41.020] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/model.safetensors.index.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:41.043] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/model.safetensors.index.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.058] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/model.safetensors.index.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.079] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/preprocessor_config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:41.100] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/preprocessor_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.119] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/preprocessor_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.171] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/special_tokens_map.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:41.183] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/special_tokens_map.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.196] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/special_tokens_map.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.298] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:41.308] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/tokenizer_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.320] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/tokenizer_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.369] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/tokenizer.json "HTTP/1.1 302 Found" | |
| [2026-03-29 19:51:41.427] HTTP Request: HEAD https://huggingface.co/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/resolve/a0d1323db855b5989928f1e4845733c52b2d817c/vocab.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 19:51:41.438] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/vocab.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:41.449] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/a0d1323db855b5989928f1e4845733c52b2d817c/vocab.json "HTTP/1.1 200 OK" | |
| [2026-03-29 19:51:43.208] FETCH ComfyRegistry Data: 80/135 | |
| [2026-03-29 19:51:46.599] FETCH ComfyRegistry Data: 85/135 | |
| [2026-03-29 19:51:50.453] FETCH ComfyRegistry Data: 90/135 | |
| [2026-03-29 19:51:53.949] FETCH ComfyRegistry Data: 95/135 | |
| [2026-03-29 19:51:57.556] FETCH ComfyRegistry Data: 100/135 | |
| [2026-03-29 19:52:01.633] FETCH ComfyRegistry Data: 105/135 | |
| [2026-03-29 19:52:05.077] FETCH ComfyRegistry Data: 110/135 | |
| [2026-03-29 19:52:08.992] FETCH ComfyRegistry Data: 115/135 | |
| [2026-03-29 19:52:14.999] FETCH ComfyRegistry Data: 120/135 | |
| [2026-03-29 19:52:20.338] FETCH ComfyRegistry Data: 125/135 | |
| [2026-03-29 19:52:25.957] FETCH ComfyRegistry Data: 130/135 | |
| [2026-03-29 19:52:32.465] FETCH ComfyRegistry Data: 135/135 | |
| [2026-03-29 19:52:34.460] FETCH ComfyRegistry Data [DONE] | |
| [2026-03-29 19:52:35.737] [ComfyUI-Manager] default cache updated: https://api.comfy.org/nodes | |
| [2026-03-29 19:52:36.985] FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json [DONE] | |
| [2026-03-29 19:52:41.118] [ComfyUI-Manager] All startup tasks have been completed. | |
| [2026-03-29 19:59:12.073] Fetching 20 files: 100% 20/20 [07:31<00:00, 22.57s/it] | |
| [2026-03-29 19:59:12.115] [VisionDescribe] Loading Qwen2.5-VL-3B — Fast (huihui abliterated)... | |
| [2026-03-29 19:59:43.827] Loading weights: 100% 821/824 [00:30<00:00, 54.57it/s] Loading weights: 100% 824/824 [00:30<00:00, 27.11it/s] | |
| [2026-03-29 19:59:44.105] [VisionDescribe] Loaded. | |
| [2026-03-29 19:59:44.112] [VisionDescribe] Image: (768, 768) | |
| [2026-03-29 19:59:59.919] [VisionDescribe] Output: 141 words. | |
| [2026-03-29 19:59:59.919] [VisionDescribe] Unloading — full hard VRAM free... | |
| [2026-03-29 20:00:01.501] [VisionDescribe] ComfyUI mm.unload_all_models + soft_empty_cache done. | |
| [2026-03-29 20:00:01.502] [VisionDescribe] VRAM after free: 0.01GB allocated / 0.12GB reserved | |
| [2026-03-29 20:00:01.590] [LTX2] Offline mode OFF — will download if needed. | |
| [2026-03-29 20:00:01.591] [LTX2] Auto-downloading if needed: huihui-ai/Llama-3.2-3B-Instruct-abliterated | |
| [2026-03-29 20:00:02.247] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/revision/main "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.396] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/generation_config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.409] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/README.md "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.410] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/generation_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.420] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/.gitattributes "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.425] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/README.md "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.428] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/generation_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.431] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/.gitattributes "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.441] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/README.md "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.461] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/model-00001-of-00002.safetensors "HTTP/1.1 302 Found" | |
| [2026-03-29 20:00:02.494] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/.gitattributes "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.541] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/USE_POLICY.md "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.553] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/USE_POLICY.md "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.565] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/USE_POLICY.md "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.568] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/model-00002-of-00002.safetensors "HTTP/1.1 302 Found" | |
| [2026-03-29 20:00:02.592] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/xet-read-token/ba0be3c4683117ffe70be5cc767723e0210e437e "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.595] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/LICENSE.txt "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.597] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/model.safetensors.index.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.611] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/model.safetensors.index.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.631] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/model.safetensors.index.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.676] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/tokenizer.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.686] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/xet-read-token/ba0be3c4683117ffe70be5cc767723e0210e437e "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.690] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/tokenizer.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.694] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/LICENSE.txt "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.721] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/special_tokens_map.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.725] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/tokenizer.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.756] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.770] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/tokenizer_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.789] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/tokenizer_config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.844] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/LICENSE.txt "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.858] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/special_tokens_map.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:02.947] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/eval.sh "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.971] HTTP Request: HEAD https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/resolve/ba0be3c4683117ffe70be5cc767723e0210e437e/config.json "HTTP/1.1 307 Temporary Redirect" | |
| [2026-03-29 20:00:02.988] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/eval.sh "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:03.030] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:03.067] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/special_tokens_map.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:03.072] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/eval.sh "HTTP/1.1 200 OK" | |
| [2026-03-29 20:00:03.073] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/ba0be3c4683117ffe70be5cc767723e0210e437e/config.json "HTTP/1.1 200 OK" | |
| [2026-03-29 20:02:53.846] Fetching 13 files: 100% 13/13 [02:51<00:00, 13.20s/it] | |
| [2026-03-29 20:02:53.849] [LTX2] Model ready at: /root/.cache/huggingface/hub/models--huihui-ai--Llama-3.2-3B-Instruct-abliterated/snapshots/ba0be3c4683117ffe70be5cc767723e0210e437e | |
| [2026-03-29 20:02:53.850] [LTX2] Loading: 3B - Llama-3.2 Abliterated (Low VRAM) | |
| [2026-03-29 20:02:55.528] `torch_dtype` is deprecated! Use `dtype` instead! | |
| [2026-03-29 20:03:23.968] Loading weights: 100% 255/255 [00:28<00:00, 9.01it/s] | |
| [2026-03-29 20:03:24.158] The tied weights mapping and config for this model specifies to tie model.embed_tokens.weight to lm_head.weight, but both are present in the checkpoints with different values, so we will NOT tie them. You should update the config with `tie_word_embeddings=False` to silence this warning. | |
| [2026-03-29 20:03:24.163] [LTX2] Loaded: 3B - Llama-3.2 Abliterated (Low VRAM) | |
| [2026-03-29 20:03:24.178] [LTX2] Dynamic token budget: 600 target / 630 max (actions: 5, frames: 480, seconds: 20) | |
| [2026-03-29 20:03:24.184] [LTX2] Stop token IDs: [128009, 78191, 882, 9125, 27, 25130, 14711] | |
| [2026-03-29 20:03:24.233] The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. | |
| [2026-03-29 20:04:00.390] [LTX2] Model unloaded. | |
| [2026-03-29 20:04:02.122] VAE load device: cuda:0, offload device: cpu, dtype: torch.float32 | |
| [2026-03-29 20:04:02.530] Requested to load VideoVAE | |
| [2026-03-29 20:04:02.556] Model VideoVAE prepared for dynamic VRAM loading. 2769MB Staged. 0 patches attached. | |
| [2026-03-29 20:04:20.536] gguf qtypes: F32 (289), Q6_K (67), Q5_K (30), Q4_K (220), IQ4_XS (20) | |
| [2026-03-29 20:04:20.737] Attempting to recreate sentencepiece tokenizer from GGUF file metadata... | |
| [2026-03-29 20:04:35.830] Created tokenizer with vocab size of 262208 | |
| [2026-03-29 20:04:36.474] Dequantizing token_embd.weight to prevent runtime OOM. | |
| [2026-03-29 20:04:54.868] clip missing: ['multi_modal_projector.mm_input_projection_weight', 'multi_modal_projector.mm_soft_emb_norm.weight', 'vision_model.embeddings.patch_embedding.weight', 'vision_model.embeddings.patch_embedding.bias', 'vision_model.embeddings.position_embedding.weight', 'vision_model.encoder.layers.0.layer_norm1.weight', 'vision_model.encoder.layers.0.layer_norm1.bias', 'vision_model.encoder.layers.0.self_attn.q_proj.weight', 'vision_model.encoder.layers.0.self_attn.k_proj.weight', 'vision_model.encoder.layers.0.self_attn.v_proj.weight', 'vision_model.encoder.layers.0.self_attn.out_proj.weight', 'vision_model.encoder.layers.0.layer_norm2.weight', 'vision_model.encoder.layers.0.layer_norm2.bias', 'vision_model.encoder.layers.0.mlp.fc1.weight', 'vision_model.encoder.layers.0.mlp.fc2.weight', 'vision_model.encoder.layers.1.layer_norm1.weight', 'vision_model.encoder.layers.1.layer_norm1.bias', 'vision_model.encoder.layers.1.self_attn.q_proj.weight', 'vision_model.encoder.layers.1.self_attn.k_proj.weight', 'vision_model.encoder.layers.1.self_attn.v_proj.weight', 'vision_model.encoder.layers.1.self_attn.out_proj.weight', 'vision_model.encoder.layers.1.layer_norm2.weight', 'vision_model.encoder.layers.1.layer_norm2.bias', 'vision_model.encoder.layers.1.mlp.fc1.weight', 'vision_model.encoder.layers.1.mlp.fc2.weight', 'vision_model.encoder.layers.2.layer_norm1.weight', 'vision_model.encoder.layers.2.layer_norm1.bias', 'vision_model.encoder.layers.2.self_attn.q_proj.weight', 'vision_model.encoder.layers.2.self_attn.k_proj.weight', 'vision_model.encoder.layers.2.self_attn.v_proj.weight', 'vision_model.encoder.layers.2.self_attn.out_proj.weight', 'vision_model.encoder.layers.2.layer_norm2.weight', 'vision_model.encoder.layers.2.layer_norm2.bias', 'vision_model.encoder.layers.2.mlp.fc1.weight', 'vision_model.encoder.layers.2.mlp.fc2.weight', 'vision_model.encoder.layers.3.layer_norm1.weight', 'vision_model.encoder.layers.3.layer_norm1.bias', 'vision_model.encoder.layers.3.self_attn.q_proj.weight', 'vision_model.encoder.layers.3.self_attn.k_proj.weight', 'vision_model.encoder.layers.3.self_attn.v_proj.weight', 'vision_model.encoder.layers.3.self_attn.out_proj.weight', 'vision_model.encoder.layers.3.layer_norm2.weight', 'vision_model.encoder.layers.3.layer_norm2.bias', 'vision_model.encoder.layers.3.mlp.fc1.weight', 'vision_model.encoder.layers.3.mlp.fc2.weight', 'vision_model.encoder.layers.4.layer_norm1.weight', 'vision_model.encoder.layers.4.layer_norm1.bias', 'vision_model.encoder.layers.4.self_attn.q_proj.weight', 'vision_model.encoder.layers.4.self_attn.k_proj.weight', 'vision_model.encoder.layers.4.self_attn.v_proj.weight', 'vision_model.encoder.layers.4.self_attn.out_proj.weight', 'vision_model.encoder.layers.4.layer_norm2.weight', 'vision_model.encoder.layers.4.layer_norm2.bias', 'vision_model.encoder.layers.4.mlp.fc1.weight', 'vision_model.encoder.layers.4.mlp.fc2.weight', 'vision_model.encoder.layers.5.layer_norm1.weight', 'vision_model.encoder.layers.5.layer_norm1.bias', 'vision_model.encoder.layers.5.self_attn.q_proj.weight', 'vision_model.encoder.layers.5.self_attn.k_proj.weight', 'vision_model.encoder.layers.5.self_attn.v_proj.weight', 'vision_model.encoder.layers.5.self_attn.out_proj.weight', 'vision_model.encoder.layers.5.layer_norm2.weight', 'vision_model.encoder.layers.5.layer_norm2.bias', 'vision_model.encoder.layers.5.mlp.fc1.weight', 'vision_model.encoder.layers.5.mlp.fc2.weight', 'vision_model.encoder.layers.6.layer_norm1.weight', 'vision_model.encoder.layers.6.layer_norm1.bias', 'vision_model.encoder.layers.6.self_attn.q_proj.weight', 'vision_model.encoder.layers.6.self_attn.k_proj.weight', 'vision_model.encoder.layers.6.self_attn.v_proj.weight', 'vision_model.encoder.layers.6.self_attn.out_proj.weight', 'vision_model.encoder.layers.6.layer_norm2.weight', 'vision_model.encoder.layers.6.layer_norm2.bias', 'vision_model.encoder.layers.6.mlp.fc1.weight', 'vision_model.encoder.layers.6.mlp.fc2.weight', 'vision_model.encoder.layers.7.layer_norm1.weight', 'vision_model.encoder.layers.7.layer_norm1.bias', 'vision_model.encoder.layers.7.self_attn.q_proj.weight', 'vision_model.encoder.layers.7.self_attn.k_proj.weight', 'vision_model.encoder.layers.7.self_attn.v_proj.weight', 'vision_model.encoder.layers.7.self_attn.out_proj.weight', 'vision_model.encoder.layers.7.layer_norm2.weight', 'vision_model.encoder.layers.7.layer_norm2.bias', 'vision_model.encoder.layers.7.mlp.fc1.weight', 'vision_model.encoder.layers.7.mlp.fc2.weight', 'vision_model.encoder.layers.8.layer_norm1.weight', 'vision_model.encoder.layers.8.layer_norm1.bias', 'vision_model.encoder.layers.8.self_attn.q_proj.weight', 'vision_model.encoder.layers.8.self_attn.k_proj.weight', 'vision_model.encoder.layers.8.self_attn.v_proj.weight', 'vision_model.encoder.layers.8.self_attn.out_proj.weight', 'vision_model.encoder.layers.8.layer_norm2.weight', 'vision_model.encoder.layers.8.layer_norm2.bias', 'vision_model.encoder.layers.8.mlp.fc1.weight', 'vision_model.encoder.layers.8.mlp.fc2.weight', 'vision_model.encoder.layers.9.layer_norm1.weight', 'vision_model.encoder.layers.9.layer_norm1.bias', 'vision_model.encoder.layers.9.self_attn.q_proj.weight', 'vision_model.encoder.layers.9.self_attn.k_proj.weight', 'vision_model.encoder.layers.9.self_attn.v_proj.weight', 'vision_model.encoder.layers.9.self_attn.out_proj.weight', 'vision_model.encoder.layers.9.layer_norm2.weight', 'vision_model.encoder.layers.9.layer_norm2.bias', 'vision_model.encoder.layers.9.mlp.fc1.weight', 'vision_model.encoder.layers.9.mlp.fc2.weight', 'vision_model.encoder.layers.10.layer_norm1.weight', 'vision_model.encoder.layers.10.layer_norm1.bias', 'vision_model.encoder.layers.10.self_attn.q_proj.weight', 'vision_model.encoder.layers.10.self_attn.k_proj.weight', 'vision_model.encoder.layers.10.self_attn.v_proj.weight', 'vision_model.encoder.layers.10.self_attn.out_proj.weight', 'vision_model.encoder.layers.10.layer_norm2.weight', 'vision_model.encoder.layers.10.layer_norm2.bias', 'vision_model.encoder.layers.10.mlp.fc1.weight', 'vision_model.encoder.layers.10.mlp.fc2.weight', 'vision_model.encoder.layers.11.layer_norm1.weight', 'vision_model.encoder.layers.11.layer_norm1.bias', 'vision_model.encoder.layers.11.self_attn.q_proj.weight', 'vision_model.encoder.layers.11.self_attn.k_proj.weight', 'vision_model.encoder.layers.11.self_attn.v_proj.weight', 'vision_model.encoder.layers.11.self_attn.out_proj.weight', 'vision_model.encoder.layers.11.layer_norm2.weight', 'vision_model.encoder.layers.11.layer_norm2.bias', 'vision_model.encoder.layers.11.mlp.fc1.weight', 'vision_model.encoder.layers.11.mlp.fc2.weight', 'vision_model.encoder.layers.12.layer_norm1.weight', 'vision_model.encoder.layers.12.layer_norm1.bias', 'vision_model.encoder.layers.12.self_attn.q_proj.weight', 'vision_model.encoder.layers.12.self_attn.k_proj.weight', 'vision_model.encoder.layers.12.self_attn.v_proj.weight', 'vision_model.encoder.layers.12.self_attn.out_proj.weight', 'vision_model.encoder.layers.12.layer_norm2.weight', 'vision_model.encoder.layers.12.layer_norm2.bias', 'vision_model.encoder.layers.12.mlp.fc1.weight', 'vision_model.encoder.layers.12.mlp.fc2.weight', 'vision_model.encoder.layers.13.layer_norm1.weight', 'vision_model.encoder.layers.13.layer_norm1.bias', 'vision_model.encoder.layers.13.self_attn.q_proj.weight', 'vision_model.encoder.layers.13.self_attn.k_proj.weight', 'vision_model.encoder.layers.13.self_attn.v_proj.weight', 'vision_model.encoder.layers.13.self_attn.out_proj.weight', 'vision_model.encoder.layers.13.layer_norm2.weight', 'vision_model.encoder.layers.13.layer_norm2.bias', 'vision_model.encoder.layers.13.mlp.fc1.weight', 'vision_model.encoder.layers.13.mlp.fc2.weight', 'vision_model.encoder.layers.14.layer_norm1.weight', 'vision_model.encoder.layers.14.layer_norm1.bias', 'vision_model.encoder.layers.14.self_attn.q_proj.weight', 'vision_model.encoder.layers.14.self_attn.k_proj.weight', 'vision_model.encoder.layers.14.self_attn.v_proj.weight', 'vision_model.encoder.layers.14.self_attn.out_proj.weight', 'vision_model.encoder.layers.14.layer_norm2.weight', 'vision_model.encoder.layers.14.layer_norm2.bias', 'vision_model.encoder.layers.14.mlp.fc1.weight', 'vision_model.encoder.layers.14.mlp.fc2.weight', 'vision_model.encoder.layers.15.layer_norm1.weight', 'vision_model.encoder.layers.15.layer_norm1.bias', 'vision_model.encoder.layers.15.self_attn.q_proj.weight', 'vision_model.encoder.layers.15.self_attn.k_proj.weight', 'vision_model.encoder.layers.15.self_attn.v_proj.weight', 'vision_model.encoder.layers.15.self_attn.out_proj.weight', 'vision_model.encoder.layers.15.layer_norm2.weight', 'vision_model.encoder.layers.15.layer_norm2.bias', 'vision_model.encoder.layers.15.mlp.fc1.weight', 'vision_model.encoder.layers.15.mlp.fc2.weight', 'vision_model.encoder.layers.16.layer_norm1.weight', 'vision_model.encoder.layers.16.layer_norm1.bias', 'vision_model.encoder.layers.16.self_attn.q_proj.weight', 'vision_model.encoder.layers.16.self_attn.k_proj.weight', 'vision_model.encoder.layers.16.self_attn.v_proj.weight', 'vision_model.encoder.layers.16.self_attn.out_proj.weight', 'vision_model.encoder.layers.16.layer_norm2.weight', 'vision_model.encoder.layers.16.layer_norm2.bias', 'vision_model.encoder.layers.16.mlp.fc1.weight', 'vision_model.encoder.layers.16.mlp.fc2.weight', 'vision_model.encoder.layers.17.layer_norm1.weight', 'vision_model.encoder.layers.17.layer_norm1.bias', 'vision_model.encoder.layers.17.self_attn.q_proj.weight', 'vision_model.encoder.layers.17.self_attn.k_proj.weight', 'vision_model.encoder.layers.17.self_attn.v_proj.weight', 'vision_model.encoder.layers.17.self_attn.out_proj.weight', 'vision_model.encoder.layers.17.layer_norm2.weight', 'vision_model.encoder.layers.17.layer_norm2.bias', 'vision_model.encoder.layers.17.mlp.fc1.weight', 'vision_model.encoder.layers.17.mlp.fc2.weight', 'vision_model.encoder.layers.18.layer_norm1.weight', 'vision_model.encoder.layers.18.layer_norm1.bias', 'vision_model.encoder.layers.18.self_attn.q_proj.weight', 'vision_model.encoder.layers.18.self_attn.k_proj.weight', 'vision_model.encoder.layers.18.self_attn.v_proj.weight', 'vision_model.encoder.layers.18.self_attn.out_proj.weight', 'vision_model.encoder.layers.18.layer_norm2.weight', 'vision_model.encoder.layers.18.layer_norm2.bias', 'vision_model.encoder.layers.18.mlp.fc1.weight', 'vision_model.encoder.layers.18.mlp.fc2.weight', 'vision_model.encoder.layers.19.layer_norm1.weight', 'vision_model.encoder.layers.19.layer_norm1.bias', 'vision_model.encoder.layers.19.self_attn.q_proj.weight', 'vision_model.encoder.layers.19.self_attn.k_proj.weight', 'vision_model.encoder.layers.19.self_attn.v_proj.weight', 'vision_model.encoder.layers.19.self_attn.out_proj.weight', 'vision_model.encoder.layers.19.layer_norm2.weight', 'vision_model.encoder.layers.19.layer_norm2.bias', 'vision_model.encoder.layers.19.mlp.fc1.weight', 'vision_model.encoder.layers.19.mlp.fc2.weight', 'vision_model.encoder.layers.20.layer_norm1.weight', 'vision_model.encoder.layers.20.layer_norm1.bias', 'vision_model.encoder.layers.20.self_attn.q_proj.weight', 'vision_model.encoder.layers.20.self_attn.k_proj.weight', 'vision_model.encoder.layers.20.self_attn.v_proj.weight', 'vision_model.encoder.layers.20.self_attn.out_proj.weight', 'vision_model.encoder.layers.20.layer_norm2.weight', 'vision_model.encoder.layers.20.layer_norm2.bias', 'vision_model.encoder.layers.20.mlp.fc1.weight', 'vision_model.encoder.layers.20.mlp.fc2.weight', 'vision_model.encoder.layers.21.layer_norm1.weight', 'vision_model.encoder.layers.21.layer_norm1.bias', 'vision_model.encoder.layers.21.self_attn.q_proj.weight', 'vision_model.encoder.layers.21.self_attn.k_proj.weight', 'vision_model.encoder.layers.21.self_attn.v_proj.weight', 'vision_model.encoder.layers.21.self_attn.out_proj.weight', 'vision_model.encoder.layers.21.layer_norm2.weight', 'vision_model.encoder.layers.21.layer_norm2.bias', 'vision_model.encoder.layers.21.mlp.fc1.weight', 'vision_model.encoder.layers.21.mlp.fc2.weight', 'vision_model.encoder.layers.22.layer_norm1.weight', 'vision_model.encoder.layers.22.layer_norm1.bias', 'vision_model.encoder.layers.22.self_attn.q_proj.weight', 'vision_model.encoder.layers.22.self_attn.k_proj.weight', 'vision_model.encoder.layers.22.self_attn.v_proj.weight', 'vision_model.encoder.layers.22.self_attn.out_proj.weight', 'vision_model.encoder.layers.22.layer_norm2.weight', 'vision_model.encoder.layers.22.layer_norm2.bias', 'vision_model.encoder.layers.22.mlp.fc1.weight', 'vision_model.encoder.layers.22.mlp.fc2.weight', 'vision_model.encoder.layers.23.layer_norm1.weight', 'vision_model.encoder.layers.23.layer_norm1.bias', 'vision_model.encoder.layers.23.self_attn.q_proj.weight', 'vision_model.encoder.layers.23.self_attn.k_proj.weight', 'vision_model.encoder.layers.23.self_attn.v_proj.weight', 'vision_model.encoder.layers.23.self_attn.out_proj.weight', 'vision_model.encoder.layers.23.layer_norm2.weight', 'vision_model.encoder.layers.23.layer_norm2.bias', 'vision_model.encoder.layers.23.mlp.fc1.weight', 'vision_model.encoder.layers.23.mlp.fc2.weight', 'vision_model.encoder.layers.24.layer_norm1.weight', 'vision_model.encoder.layers.24.layer_norm1.bias', 'vision_model.encoder.layers.24.self_attn.q_proj.weight', 'vision_model.encoder.layers.24.self_attn.k_proj.weight', 'vision_model.encoder.layers.24.self_attn.v_proj.weight', 'vision_model.encoder.layers.24.self_attn.out_proj.weight', 'vision_model.encoder.layers.24.layer_norm2.weight', 'vision_model.encoder.layers.24.layer_norm2.bias', 'vision_model.encoder.layers.24.mlp.fc1.weight', 'vision_model.encoder.layers.24.mlp.fc2.weight', 'vision_model.encoder.layers.25.layer_norm1.weight', 'vision_model.encoder.layers.25.layer_norm1.bias', 'vision_model.encoder.layers.25.self_attn.q_proj.weight', 'vision_model.encoder.layers.25.self_attn.k_proj.weight', 'vision_model.encoder.layers.25.self_attn.v_proj.weight', 'vision_model.encoder.layers.25.self_attn.out_proj.weight', 'vision_model.encoder.layers.25.layer_norm2.weight', 'vision_model.encoder.layers.25.layer_norm2.bias', 'vision_model.encoder.layers.25.mlp.fc1.weight', 'vision_model.encoder.layers.25.mlp.fc2.weight', 'vision_model.encoder.layers.26.layer_norm1.weight', 'vision_model.encoder.layers.26.layer_norm1.bias', 'vision_model.encoder.layers.26.self_attn.q_proj.weight', 'vision_model.encoder.layers.26.self_attn.k_proj.weight', 'vision_model.encoder.layers.26.self_attn.v_proj.weight', 'vision_model.encoder.layers.26.self_attn.out_proj.weight', 'vision_model.encoder.layers.26.layer_norm2.weight', 'vision_model.encoder.layers.26.layer_norm2.bias', 'vision_model.encoder.layers.26.mlp.fc1.weight', 'vision_model.encoder.layers.26.mlp.fc2.weight', 'vision_model.post_layernorm.weight', 'vision_model.post_layernorm.bias'] | |
| [2026-03-29 20:04:54.872] CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16 | |
| [2026-03-29 20:04:54.890] Requested to load LTXAVTEModel_ | |
| [2026-03-29 20:05:32.804] loaded partially; 10496.69 MB usable, 10439.94 MB loaded, 1567.68 MB offloaded, 56.74 MB buffer reserved, lowvram patches: 0 | |
| [2026-03-29 20:05:32.809] Attempting to release mmap (157) | |
| [2026-03-29 20:05:50.869] loaded partially; 10494.69 MB usable, 10437.94 MB loaded, 1570.26 MB offloaded, 56.74 MB buffer reserved, lowvram patches: 0 | |
| [2026-03-29 20:06:17.850] VAE load device: cuda:0, offload device: cpu, dtype: torch.float32 | |
| [2026-03-29 20:06:18.268] gguf qtypes: F32 (2672), BF16 (28), Q4_K (1268), Q6_K (368), Q5_K (108) | |
| [2026-03-29 20:06:18.424] model weight dtype torch.bfloat16, manual cast: torch.float32 | |
| [2026-03-29 20:06:18.438] model_type FLUX | |
| [2026-03-29 20:06:18.998] Using sage attention mode: auto | |
| [2026-03-29 20:06:19.711] Requested to load LTXAV | |
| [2026-03-29 20:07:21.361] loaded partially; 10721.88 MB usable, 10622.85 MB loaded, 3306.90 MB offloaded, 99.02 MB buffer reserved, lowvram patches: 0 | |
| [2026-03-29 20:07:33.795] | |
| [2026-03-29 20:07:33.918] !!! Exception during processing !!! PassManager::run failed | |
| [2026-03-29 20:07:33.999] Traceback (most recent call last): | |
| File "/content/ComfyUI/execution.py", line 534, in execute | |
| output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/execution.py", line 334, in get_output_data | |
| return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/execution.py", line 308, in _async_map_node_over_list | |
| await process_inputs(input_dict, i) | |
| File "/content/ComfyUI/execution.py", line 296, in process_inputs | |
| result = f(**inputs) | |
| ^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy_api/internal/__init__.py", line 149, in wrapped_func | |
| return method(locked_class, **inputs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy_api/latest/_io.py", line 1789, in EXECUTE_NORMALIZED | |
| to_return = cls.execute(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy_extras/nodes_custom_sampler.py", line 963, in execute | |
| samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 1052, in sample | |
| output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 113, in execute | |
| return self.wrappers[self.idx](self, *args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/custom_nodes/ComfyUI-KJNodes/nodes/ltxv_nodes.py", line 878, in __call__ | |
| out = executor(noise, latent_image, sampler, sigmas, denoise_mask, combined_callback, disable_pbar, seed, latent_shapes=latent_shapes) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 105, in __call__ | |
| return new_executor.execute(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 112, in execute | |
| return self.original(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 995, in outer_sample | |
| output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 981, in inner_sample | |
| samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 112, in execute | |
| return self.original(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 751, in sample | |
| samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/utils/_contextlib.py", line 124, in decorate_context | |
| return func(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/k_diffusion/sampling.py", line 218, in sample_euler_ancestral | |
| return sample_euler_ancestral_RF(model, x, sigmas, extra_args, callback, disable, eta, s_noise, noise_sampler) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/utils/_contextlib.py", line 124, in decorate_context | |
| return func(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/k_diffusion/sampling.py", line 247, in sample_euler_ancestral_RF | |
| denoised = model(x, sigmas[i] * s_in, **extra_args) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 400, in __call__ | |
| out = self.inner_model(x, sigma, model_options=model_options, seed=seed) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 954, in __call__ | |
| return self.outer_predict_noise(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 961, in outer_predict_noise | |
| ).execute(x, timestep, model_options, seed) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 112, in execute | |
| return self.original(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 964, in predict_noise | |
| return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 380, in sampling_function | |
| out = calc_cond_batch(model, conds, x, timestep, model_options) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 205, in calc_cond_batch | |
| return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 213, in _calc_cond_batch_outer | |
| return executor.execute(model, conds, x_in, timestep, model_options) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 112, in execute | |
| return self.original(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/samplers.py", line 325, in _calc_cond_batch | |
| output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/model_base.py", line 172, in apply_model | |
| return comfy.patcher_extension.WrapperExecutor.new_class_executor( | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 112, in execute | |
| return self.original(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/model_base.py", line 211, in _apply_model | |
| model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl | |
| return self._call_impl(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/nn/modules/module.py", line 1787, in _call_impl | |
| return forward_call(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/lightricks/av_model.py", line 1062, in forward | |
| return super().forward( | |
| ^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/lightricks/model.py", line 879, in forward | |
| return comfy.patcher_extension.WrapperExecutor.new_class_executor( | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/patcher_extension.py", line 112, in execute | |
| return self.original(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/lightricks/model.py", line 932, in _forward | |
| x = self._process_transformer_blocks( | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/lightricks/av_model.py", line 964, in _process_transformer_blocks | |
| vx, ax = block( | |
| ^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl | |
| return self._call_impl(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/nn/modules/module.py", line 1787, in _call_impl | |
| return forward_call(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/lightricks/av_model.py", line 276, in forward | |
| attn1_out = self.attn1(norm_vx, pe=v_pe, mask=self_attention_mask, transformer_options=transformer_options) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl | |
| return self._call_impl(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/nn/modules/module.py", line 1787, in _call_impl | |
| return forward_call(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/lightricks/model.py", line 414, in forward | |
| out = comfy.ldm.modules.attention.optimized_attention(q, k, v, self.heads, attn_precision=self.attn_precision, transformer_options=transformer_options) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/comfy/ldm/modules/attention.py", line 136, in wrapper | |
| return transformer_options["optimized_attention_override"](func, *args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/custom_nodes/ComfyUI-KJNodes/nodes/model_optimization_nodes.py", line 125, in attention_override_sage | |
| return new_attention.__wrapped__(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/custom_nodes/ComfyUI-KJNodes/nodes/model_optimization_nodes.py", line 83, in attention_sage | |
| out = sage_func(q, k, v, attn_mask=mask, is_causal=False, tensor_layout=tensor_layout).to(in_dtype) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/torch/_dynamo/eval_frame.py", line 1181, in _fn | |
| return fn(*args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^ | |
| File "/content/ComfyUI/custom_nodes/ComfyUI-KJNodes/nodes/model_optimization_nodes.py", line 31, in sage_func | |
| return sageattn(q, k, v, is_causal=is_causal, attn_mask=attn_mask, tensor_layout=tensor_layout) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/sageattention/core.py", line 110, in sageattn | |
| o = attn_false(q_int8, k_int8, v, q_scale, k_scale, tensor_layout=tensor_layout, output_dtype=dtype) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/sageattention/attn_qk_int8_per_block.py", line 113, in forward | |
| _attn_fwd[grid]( | |
| File "/usr/local/lib/python3.12/dist-packages/triton/runtime/jit.py", line 370, in <lambda> | |
| return lambda *args, **kwargs: self.run(grid=grid, warmup=False, *args, **kwargs) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/triton/runtime/jit.py", line 720, in run | |
| kernel = self._do_compile(key, signature, device, constexprs, options, attrs, warmup) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/triton/runtime/jit.py", line 849, in _do_compile | |
| kernel = self.compile(src, target=target, options=options.__dict__) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/triton/compiler/compiler.py", line 324, in compile | |
| next_module = compile_ir(module, metadata) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/triton/backends/nvidia/compiler.py", line 541, in <lambda> | |
| stages["ttgir"] = lambda src, metadata: self.make_ttgir(src, metadata, options, capability) | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| File "/usr/local/lib/python3.12/dist-packages/triton/backends/nvidia/compiler.py", line 316, in make_ttgir | |
| pm.run(mod, 'make_ttgir') | |
| RuntimeError: PassManager::run failed | |
| [2026-03-29 20:07:34.011] Prompt executed in 00:15:53 | |
| [2026-03-29 20:19:50.076] got prompt | |
| [2026-03-29 20:19:50.483] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated/revision/main "HTTP/1.1 200 OK" | |
| [2026-03-29 20:19:50.498] Fetching 20 files: 100% 20/20 [00:00<00:00, 46995.00it/s] | |
| [2026-03-29 20:19:50.500] [VisionDescribe] Loading Qwen2.5-VL-3B — Fast (huihui abliterated)... | |
| [2026-03-29 20:20:22.193] Loading weights: 100% 824/824 [00:30<00:00, 26.79it/s] | |
| [2026-03-29 20:20:22.349] [VisionDescribe] Loaded. | |
| [2026-03-29 20:20:22.359] [VisionDescribe] Image: (768, 768) | |
| [2026-03-29 20:20:34.002] [VisionDescribe] Output: 93 words. | |
| [2026-03-29 20:20:34.002] [VisionDescribe] Unloading — full hard VRAM free... | |
| [2026-03-29 20:20:35.569] [VisionDescribe] ComfyUI mm.unload_all_models + soft_empty_cache done. | |
| [2026-03-29 20:20:35.570] [VisionDescribe] VRAM after free: 0.01GB allocated / 0.09GB reserved | |
| [2026-03-29 20:20:35.627] [LTX2] Offline mode OFF — will download if needed. | |
| [2026-03-29 20:20:35.629] [LTX2] Auto-downloading if needed: huihui-ai/Llama-3.2-3B-Instruct-abliterated | |
| [2026-03-29 20:20:35.863] HTTP Request: GET https://huggingface.co/api/models/huihui-ai/Llama-3.2-3B-Instruct-abliterated/revision/main "HTTP/1.1 200 OK" | |
| [2026-03-29 20:20:35.873] Fetching 13 files: 100% 13/13 [00:00<00:00, 35406.46it/s] | |
| [2026-03-29 20:20:35.874] [LTX2] Model ready at: /root/.cache/huggingface/hub/models--huihui-ai--Llama-3.2-3B-Instruct-abliterated/snapshots/ba0be3c4683117ffe70be5cc767723e0210e437e | |
| [2026-03-29 20:20:35.874] [LTX2] Loading: 3B - Llama-3.2 Abliterated (Low VRAM) | |
| [2026-03-29 20:21:07.051] Loading weights: 100% 255/255 [00:29<00:00, 8.76it/s] | |
| [2026-03-29 20:21:07.216] The tied weights mapping and config for this model specifies to tie model.embed_tokens.weight to lm_head.weight, but both are present in the checkpoints with different values, so we will NOT tie them. You should update the config with `tie_word_embeddings=False` to silence this warning. | |
| [2026-03-29 20:21:07.220] [LTX2] Loaded: 3B - Llama-3.2 Abliterated (Low VRAM) | |
| [2026-03-29 20:21:07.221] [LTX2] Dynamic token budget: 600 target / 630 max (actions: 5, frames: 480, seconds: 20) | |
| [2026-03-29 20:21:07.231] [LTX2] Stop token IDs: [128009, 78191, 882, 9125, 27, 25130, 14711] | |
| [2026-03-29 20:21:41.152] [LTX2] Model unloaded. | |
| [2026-03-29 20:21:42.987] VAE load device: cuda:0, offload device: cpu, dtype: torch.float32 | |
| [2026-03-29 20:21:43.227] Requested to load VideoVAE | |
| [2026-03-29 20:21:43.256] Model VideoVAE prepared for dynamic VRAM loading. 2769MB Staged. 0 patches attached. | |
| [2026-03-29 20:22:00.682] gguf qtypes: F32 (289), Q6_K (67), Q5_K (30), Q4_K (220), IQ4_XS (20) | |
| [2026-03-29 20:22:00.892] Attempting to recreate sentencepiece tokenizer from GGUF file metadata... | |
| [2026-03-29 20:22:16.422] Created tokenizer with vocab size of 262208 | |
| [2026-03-29 20:22:17.122] Dequantizing token_embd.weight to prevent runtime OOM. | |
| [2026-03-29 20:22:36.356] clip missing: ['multi_modal_projector.mm_input_projection_weight', 'multi_modal_projector.mm_soft_emb_norm.weight', 'vision_model.embeddings.patch_embedding.weight', 'vision_model.embeddings.patch_embedding.bias', 'vision_model.embeddings.position_embedding.weight', 'vision_model.encoder.layers.0.layer_norm1.weight', 'vision_model.encoder.layers.0.layer_norm1.bias', 'vision_model.encoder.layers.0.self_attn.q_proj.weight', 'vision_model.encoder.layers.0.self_attn.k_proj.weight', 'vision_model.encoder.layers.0.self_attn.v_proj.weight', 'vision_model.encoder.layers.0.self_attn.out_proj.weight', 'vision_model.encoder.layers.0.layer_norm2.weight', 'vision_model.encoder.layers.0.layer_norm2.bias', 'vision_model.encoder.layers.0.mlp.fc1.weight', 'vision_model.encoder.layers.0.mlp.fc2.weight', 'vision_model.encoder.layers.1.layer_norm1.weight', 'vision_model.encoder.layers.1.layer_norm1.bias', 'vision_model.encoder.layers.1.self_attn.q_proj.weight', 'vision_model.encoder.layers.1.self_attn.k_proj.weight', 'vision_model.encoder.layers.1.self_attn.v_proj.weight', 'vision_model.encoder.layers.1.self_attn.out_proj.weight', 'vision_model.encoder.layers.1.layer_norm2.weight', 'vision_model.encoder.layers.1.layer_norm2.bias', 'vision_model.encoder.layers.1.mlp.fc1.weight', 'vision_model.encoder.layers.1.mlp.fc2.weight', 'vision_model.encoder.layers.2.layer_norm1.weight', 'vision_model.encoder.layers.2.layer_norm1.bias', 'vision_model.encoder.layers.2.self_attn.q_proj.weight', 'vision_model.encoder.layers.2.self_attn.k_proj.weight', 'vision_model.encoder.layers.2.self_attn.v_proj.weight', 'vision_model.encoder.layers.2.self_attn.out_proj.weight', 'vision_model.encoder.layers.2.layer_norm2.weight', 'vision_model.encoder.layers.2.layer_norm2.bias', 'vision_model.encoder.layers.2.mlp.fc1.weight', 'vision_model.encoder.layers.2.mlp.fc2.weight', 'vision_model.encoder.layers.3.layer_norm1.weight', 'vision_model.encoder.layers.3.layer_norm1.bias', 'vision_model.encoder.layers.3.self_attn.q_proj.weight', 'vision_model.encoder.layers.3.self_attn.k_proj.weight', 'vision_model.encoder.layers.3.self_attn.v_proj.weight', 'vision_model.encoder.layers.3.self_attn.out_proj.weight', 'vision_model.encoder.layers.3.layer_norm2.weight', 'vision_model.encoder.layers.3.layer_norm2.bias', 'vision_model.encoder.layers.3.mlp.fc1.weight', 'vision_model.encoder.layers.3.mlp.fc2.weight', 'vision_model.encoder.layers.4.layer_norm1.weight', 'vision_model.encoder.layers.4.layer_norm1.bias', 'vision_model.encoder.layers.4.self_attn.q_proj.weight', 'vision_model.encoder.layers.4.self_attn.k_proj.weight', 'vision_model.encoder.layers.4.self_attn.v_proj.weight', 'vision_model.encoder.layers.4.self_attn.out_proj.weight', 'vision_model.encoder.layers.4.layer_norm2.weight', 'vision_model.encoder.layers.4.layer_norm2.bias', 'vision_model.encoder.layers.4.mlp.fc1.weight', 'vision_model.encoder.layers.4.mlp.fc2.weight', 'vision_model.encoder.layers.5.layer_norm1.weight', 'vision_model.encoder.layers.5.layer_norm1.bias', 'vision_model.encoder.layers.5.self_attn.q_proj.weight', 'vision_model.encoder.layers.5.self_attn.k_proj.weight', 'vision_model.encoder.layers.5.self_attn.v_proj.weight', 'vision_model.encoder.layers.5.self_attn.out_proj.weight', 'vision_model.encoder.layers.5.layer_norm2.weight', 'vision_model.encoder.layers.5.layer_norm2.bias', 'vision_model.encoder.layers.5.mlp.fc1.weight', 'vision_model.encoder.layers.5.mlp.fc2.weight', 'vision_model.encoder.layers.6.layer_norm1.weight', 'vision_model.encoder.layers.6.layer_norm1.bias', 'vision_model.encoder.layers.6.self_attn.q_proj.weight', 'vision_model.encoder.layers.6.self_attn.k_proj.weight', 'vision_model.encoder.layers.6.self_attn.v_proj.weight', 'vision_model.encoder.layers.6.self_attn.out_proj.weight', 'vision_model.encoder.layers.6.layer_norm2.weight', 'vision_model.encoder.layers.6.layer_norm2.bias', 'vision_model.encoder.layers.6.mlp.fc1.weight', 'vision_model.encoder.layers.6.mlp.fc2.weight', 'vision_model.encoder.layers.7.layer_norm1.weight', 'vision_model.encoder.layers.7.layer_norm1.bias', 'vision_model.encoder.layers.7.self_attn.q_proj.weight', 'vision_model.encoder.layers.7.self_attn.k_proj.weight', 'vision_model.encoder.layers.7.self_attn.v_proj.weight', 'vision_model.encoder.layers.7.self_attn.out_proj.weight', 'vision_model.encoder.layers.7.layer_norm2.weight', 'vision_model.encoder.layers.7.layer_norm2.bias', 'vision_model.encoder.layers.7.mlp.fc1.weight', 'vision_model.encoder.layers.7.mlp.fc2.weight', 'vision_model.encoder.layers.8.layer_norm1.weight', 'vision_model.encoder.layers.8.layer_norm1.bias', 'vision_model.encoder.layers.8.self_attn.q_proj.weight', 'vision_model.encoder.layers.8.self_attn.k_proj.weight', 'vision_model.encoder.layers.8.self_attn.v_proj.weight', 'vision_model.encoder.layers.8.self_attn.out_proj.weight', 'vision_model.encoder.layers.8.layer_norm2.weight', 'vision_model.encoder.layers.8.layer_norm2.bias', 'vision_model.encoder.layers.8.mlp.fc1.weight', 'vision_model.encoder.layers.8.mlp.fc2.weight', 'vision_model.encoder.layers.9.layer_norm1.weight', 'vision_model.encoder.layers.9.layer_norm1.bias', 'vision_model.encoder.layers.9.self_attn.q_proj.weight', 'vision_model.encoder.layers.9.self_attn.k_proj.weight', 'vision_model.encoder.layers.9.self_attn.v_proj.weight', 'vision_model.encoder.layers.9.self_attn.out_proj.weight', 'vision_model.encoder.layers.9.layer_norm2.weight', 'vision_model.encoder.layers.9.layer_norm2.bias', 'vision_model.encoder.layers.9.mlp.fc1.weight', 'vision_model.encoder.layers.9.mlp.fc2.weight', 'vision_model.encoder.layers.10.layer_norm1.weight', 'vision_model.encoder.layers.10.layer_norm1.bias', 'vision_model.encoder.layers.10.self_attn.q_proj.weight', 'vision_model.encoder.layers.10.self_attn.k_proj.weight', 'vision_model.encoder.layers.10.self_attn.v_proj.weight', 'vision_model.encoder.layers.10.self_attn.out_proj.weight', 'vision_model.encoder.layers.10.layer_norm2.weight', 'vision_model.encoder.layers.10.layer_norm2.bias', 'vision_model.encoder.layers.10.mlp.fc1.weight', 'vision_model.encoder.layers.10.mlp.fc2.weight', 'vision_model.encoder.layers.11.layer_norm1.weight', 'vision_model.encoder.layers.11.layer_norm1.bias', 'vision_model.encoder.layers.11.self_attn.q_proj.weight', 'vision_model.encoder.layers.11.self_attn.k_proj.weight', 'vision_model.encoder.layers.11.self_attn.v_proj.weight', 'vision_model.encoder.layers.11.self_attn.out_proj.weight', 'vision_model.encoder.layers.11.layer_norm2.weight', 'vision_model.encoder.layers.11.layer_norm2.bias', 'vision_model.encoder.layers.11.mlp.fc1.weight', 'vision_model.encoder.layers.11.mlp.fc2.weight', 'vision_model.encoder.layers.12.layer_norm1.weight', 'vision_model.encoder.layers.12.layer_norm1.bias', 'vision_model.encoder.layers.12.self_attn.q_proj.weight', 'vision_model.encoder.layers.12.self_attn.k_proj.weight', 'vision_model.encoder.layers.12.self_attn.v_proj.weight', 'vision_model.encoder.layers.12.self_attn.out_proj.weight', 'vision_model.encoder.layers.12.layer_norm2.weight', 'vision_model.encoder.layers.12.layer_norm2.bias', 'vision_model.encoder.layers.12.mlp.fc1.weight', 'vision_model.encoder.layers.12.mlp.fc2.weight', 'vision_model.encoder.layers.13.layer_norm1.weight', 'vision_model.encoder.layers.13.layer_norm1.bias', 'vision_model.encoder.layers.13.self_attn.q_proj.weight', 'vision_model.encoder.layers.13.self_attn.k_proj.weight', 'vision_model.encoder.layers.13.self_attn.v_proj.weight', 'vision_model.encoder.layers.13.self_attn.out_proj.weight', 'vision_model.encoder.layers.13.layer_norm2.weight', 'vision_model.encoder.layers.13.layer_norm2.bias', 'vision_model.encoder.layers.13.mlp.fc1.weight', 'vision_model.encoder.layers.13.mlp.fc2.weight', 'vision_model.encoder.layers.14.layer_norm1.weight', 'vision_model.encoder.layers.14.layer_norm1.bias', 'vision_model.encoder.layers.14.self_attn.q_proj.weight', 'vision_model.encoder.layers.14.self_attn.k_proj.weight', 'vision_model.encoder.layers.14.self_attn.v_proj.weight', 'vision_model.encoder.layers.14.self_attn.out_proj.weight', 'vision_model.encoder.layers.14.layer_norm2.weight', 'vision_model.encoder.layers.14.layer_norm2.bias', 'vision_model.encoder.layers.14.mlp.fc1.weight', 'vision_model.encoder.layers.14.mlp.fc2.weight', 'vision_model.encoder.layers.15.layer_norm1.weight', 'vision_model.encoder.layers.15.layer_norm1.bias', 'vision_model.encoder.layers.15.self_attn.q_proj.weight', 'vision_model.encoder.layers.15.self_attn.k_proj.weight', 'vision_model.encoder.layers.15.self_attn.v_proj.weight', 'vision_model.encoder.layers.15.self_attn.out_proj.weight', 'vision_model.encoder.layers.15.layer_norm2.weight', 'vision_model.encoder.layers.15.layer_norm2.bias', 'vision_model.encoder.layers.15.mlp.fc1.weight', 'vision_model.encoder.layers.15.mlp.fc2.weight', 'vision_model.encoder.layers.16.layer_norm1.weight', 'vision_model.encoder.layers.16.layer_norm1.bias', 'vision_model.encoder.layers.16.self_attn.q_proj.weight', 'vision_model.encoder.layers.16.self_attn.k_proj.weight', 'vision_model.encoder.layers.16.self_attn.v_proj.weight', 'vision_model.encoder.layers.16.self_attn.out_proj.weight', 'vision_model.encoder.layers.16.layer_norm2.weight', 'vision_model.encoder.layers.16.layer_norm2.bias', 'vision_model.encoder.layers.16.mlp.fc1.weight', 'vision_model.encoder.layers.16.mlp.fc2.weight', 'vision_model.encoder.layers.17.layer_norm1.weight', 'vision_model.encoder.layers.17.layer_norm1.bias', 'vision_model.encoder.layers.17.self_attn.q_proj.weight', 'vision_model.encoder.layers.17.self_attn.k_proj.weight', 'vision_model.encoder.layers.17.self_attn.v_proj.weight', 'vision_model.encoder.layers.17.self_attn.out_proj.weight', 'vision_model.encoder.layers.17.layer_norm2.weight', 'vision_model.encoder.layers.17.layer_norm2.bias', 'vision_model.encoder.layers.17.mlp.fc1.weight', 'vision_model.encoder.layers.17.mlp.fc2.weight', 'vision_model.encoder.layers.18.layer_norm1.weight', 'vision_model.encoder.layers.18.layer_norm1.bias', 'vision_model.encoder.layers.18.self_attn.q_proj.weight', 'vision_model.encoder.layers.18.self_attn.k_proj.weight', 'vision_model.encoder.layers.18.self_attn.v_proj.weight', 'vision_model.encoder.layers.18.self_attn.out_proj.weight', 'vision_model.encoder.layers.18.layer_norm2.weight', 'vision_model.encoder.layers.18.layer_norm2.bias', 'vision_model.encoder.layers.18.mlp.fc1.weight', 'vision_model.encoder.layers.18.mlp.fc2.weight', 'vision_model.encoder.layers.19.layer_norm1.weight', 'vision_model.encoder.layers.19.layer_norm1.bias', 'vision_model.encoder.layers.19.self_attn.q_proj.weight', 'vision_model.encoder.layers.19.self_attn.k_proj.weight', 'vision_model.encoder.layers.19.self_attn.v_proj.weight', 'vision_model.encoder.layers.19.self_attn.out_proj.weight', 'vision_model.encoder.layers.19.layer_norm2.weight', 'vision_model.encoder.layers.19.layer_norm2.bias', 'vision_model.encoder.layers.19.mlp.fc1.weight', 'vision_model.encoder.layers.19.mlp.fc2.weight', 'vision_model.encoder.layers.20.layer_norm1.weight', 'vision_model.encoder.layers.20.layer_norm1.bias', 'vision_model.encoder.layers.20.self_attn.q_proj.weight', 'vision_model.encoder.layers.20.self_attn.k_proj.weight', 'vision_model.encoder.layers.20.self_attn.v_proj.weight', 'vision_model.encoder.layers.20.self_attn.out_proj.weight', 'vision_model.encoder.layers.20.layer_norm2.weight', 'vision_model.encoder.layers.20.layer_norm2.bias', 'vision_model.encoder.layers.20.mlp.fc1.weight', 'vision_model.encoder.layers.20.mlp.fc2.weight', 'vision_model.encoder.layers.21.layer_norm1.weight', 'vision_model.encoder.layers.21.layer_norm1.bias', 'vision_model.encoder.layers.21.self_attn.q_proj.weight', 'vision_model.encoder.layers.21.self_attn.k_proj.weight', 'vision_model.encoder.layers.21.self_attn.v_proj.weight', 'vision_model.encoder.layers.21.self_attn.out_proj.weight', 'vision_model.encoder.layers.21.layer_norm2.weight', 'vision_model.encoder.layers.21.layer_norm2.bias', 'vision_model.encoder.layers.21.mlp.fc1.weight', 'vision_model.encoder.layers.21.mlp.fc2.weight', 'vision_model.encoder.layers.22.layer_norm1.weight', 'vision_model.encoder.layers.22.layer_norm1.bias', 'vision_model.encoder.layers.22.self_attn.q_proj.weight', 'vision_model.encoder.layers.22.self_attn.k_proj.weight', 'vision_model.encoder.layers.22.self_attn.v_proj.weight', 'vision_model.encoder.layers.22.self_attn.out_proj.weight', 'vision_model.encoder.layers.22.layer_norm2.weight', 'vision_model.encoder.layers.22.layer_norm2.bias', 'vision_model.encoder.layers.22.mlp.fc1.weight', 'vision_model.encoder.layers.22.mlp.fc2.weight', 'vision_model.encoder.layers.23.layer_norm1.weight', 'vision_model.encoder.layers.23.layer_norm1.bias', 'vision_model.encoder.layers.23.self_attn.q_proj.weight', 'vision_model.encoder.layers.23.self_attn.k_proj.weight', 'vision_model.encoder.layers.23.self_attn.v_proj.weight', 'vision_model.encoder.layers.23.self_attn.out_proj.weight', 'vision_model.encoder.layers.23.layer_norm2.weight', 'vision_model.encoder.layers.23.layer_norm2.bias', 'vision_model.encoder.layers.23.mlp.fc1.weight', 'vision_model.encoder.layers.23.mlp.fc2.weight', 'vision_model.encoder.layers.24.layer_norm1.weight', 'vision_model.encoder.layers.24.layer_norm1.bias', 'vision_model.encoder.layers.24.self_attn.q_proj.weight', 'vision_model.encoder.layers.24.self_attn.k_proj.weight', 'vision_model.encoder.layers.24.self_attn.v_proj.weight', 'vision_model.encoder.layers.24.self_attn.out_proj.weight', 'vision_model.encoder.layers.24.layer_norm2.weight', 'vision_model.encoder.layers.24.layer_norm2.bias', 'vision_model.encoder.layers.24.mlp.fc1.weight', 'vision_model.encoder.layers.24.mlp.fc2.weight', 'vision_model.encoder.layers.25.layer_norm1.weight', 'vision_model.encoder.layers.25.layer_norm1.bias', 'vision_model.encoder.layers.25.self_attn.q_proj.weight', 'vision_model.encoder.layers.25.self_attn.k_proj.weight', 'vision_model.encoder.layers.25.self_attn.v_proj.weight', 'vision_model.encoder.layers.25.self_attn.out_proj.weight', 'vision_model.encoder.layers.25.layer_norm2.weight', 'vision_model.encoder.layers.25.layer_norm2.bias', 'vision_model.encoder.layers.25.mlp.fc1.weight', 'vision_model.encoder.layers.25.mlp.fc2.weight', 'vision_model.encoder.layers.26.layer_norm1.weight', 'vision_model.encoder.layers.26.layer_norm1.bias', 'vision_model.encoder.layers.26.self_attn.q_proj.weight', 'vision_model.encoder.layers.26.self_attn.k_proj.weight', 'vision_model.encoder.layers.26.self_attn.v_proj.weight', 'vision_model.encoder.layers.26.self_attn.out_proj.weight', 'vision_model.encoder.layers.26.layer_norm2.weight', 'vision_model.encoder.layers.26.layer_norm2.bias', 'vision_model.encoder.layers.26.mlp.fc1.weight', 'vision_model.encoder.layers.26.mlp.fc2.weight', 'vision_model.post_layernorm.weight', 'vision_model.post_layernorm.bias'] | |
| [2026-03-29 20:22:36.366] CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16 | |
| [2026-03-29 20:22:36.381] Requested to load LTXAVTEModel_ | |
| [2026-03-29 20:23:14.449] loaded partially; 10494.69 MB usable, 10437.94 MB loaded, 1570.26 MB offloaded, 56.74 MB buffer reserved, lowvram patches: 0 | |
| [2026-03-29 20:23:14.458] Attempting to release mmap (120) | |
| [2026-03-29 20:23:31.490] loaded partially; 10492.69 MB usable, 10435.94 MB loaded, 1570.27 MB offloaded, 56.74 MB buffer reserved, lowvram patches: 0 | |
| [2026-03-29 20:23:57.468] VAE load device: cuda:0, offload device: cpu, dtype: torch.float32 | |
| [2026-03-29 20:23:57.884] gguf qtypes: F32 (2672), BF16 (28), Q4_K (1268), Q6_K (368), Q5_K (108) | |
| [2026-03-29 20:23:58.040] model weight dtype torch.bfloat16, manual cast: torch.float32 | |
| [2026-03-29 20:23:58.086] model_type FLUX | |
| [2026-03-29 20:23:59.395] Requested to load LTXAV | |
| [2026-03-29 20:24:59.858] loaded partially; 10719.88 MB usable, 10620.85 MB loaded, 3308.90 MB offloaded, 99.02 MB buffer reserved, lowvram patches: 0 | |
| [2026-03-29 20:44:42.286] 100% 8/8 [19:38<00:00, 147.53s/it] 100% 8/8 [19:38<00:00, 147.33s/it] | |
| [2026-03-29 20:44:51.282] Unloaded partially: 675.36 MB freed, 9945.49 MB remains loaded, 99.05 MB buffer reserved, lowvram patches: 79 | |
| [2026-03-29 20:44:59.869] Requested to load VideoVAE | |
| [2026-03-29 20:44:59.891] Model VideoVAE prepared for dynamic VRAM loading. 2769MB Staged. 0 patches attached. | |
| [2026-03-29 20:45:02.536] Requested to load LTXAV | |
| [2026-03-29 20:45:02.699] 0 models unloaded. | |