Instructions to use gbrx/GonzaLomo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use gbrx/GonzaLomo with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="gbrx/GonzaLomo", filename="LTX/gemma-3-12b-it-Q2_K.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use gbrx/GonzaLomo with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf gbrx/GonzaLomo:Q2_K # Run inference directly in the terminal: llama-cli -hf gbrx/GonzaLomo:Q2_K
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf gbrx/GonzaLomo:Q2_K # Run inference directly in the terminal: llama-cli -hf gbrx/GonzaLomo:Q2_K
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf gbrx/GonzaLomo:Q2_K # Run inference directly in the terminal: ./llama-cli -hf gbrx/GonzaLomo:Q2_K
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf gbrx/GonzaLomo:Q2_K # Run inference directly in the terminal: ./build/bin/llama-cli -hf gbrx/GonzaLomo:Q2_K
Use Docker
docker model run hf.co/gbrx/GonzaLomo:Q2_K
- LM Studio
- Jan
- Ollama
How to use gbrx/GonzaLomo with Ollama:
ollama run hf.co/gbrx/GonzaLomo:Q2_K
- Unsloth Studio
How to use gbrx/GonzaLomo with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for gbrx/GonzaLomo to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for gbrx/GonzaLomo to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for gbrx/GonzaLomo to start chatting
- Docker Model Runner
How to use gbrx/GonzaLomo with Docker Model Runner:
docker model run hf.co/gbrx/GonzaLomo:Q2_K
- Lemonade
How to use gbrx/GonzaLomo with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull gbrx/GonzaLomo:Q2_K
Run and chat with the model
lemonade run user.GonzaLomo-Q2_K
List all available models
lemonade list
Update LTX/GBRX-LTX23-I2V-T2V-Single_runpod_ubuntu2404_v12.sh
Browse files
LTX/GBRX-LTX23-I2V-T2V-Single_runpod_ubuntu2404_v12.sh
CHANGED
|
@@ -1,83 +1,86 @@
|
|
| 1 |
-
#!/bin/bash
|
| 2 |
-
|
| 3 |
-
# GBRX-LTX23-I2V-T2V Runpod Setup Script (v1.2)
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
comfy
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
hf download
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
hf download
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
hf download
|
| 48 |
-
|
| 49 |
-
echo "
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
git clone https://github.com/
|
| 54 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 55 |
-
|
| 56 |
-
git clone https://github.com/
|
| 57 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 58 |
-
|
| 59 |
-
git clone https://github.com/
|
| 60 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 61 |
-
|
| 62 |
-
git clone https://github.com/
|
| 63 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 64 |
-
|
| 65 |
-
git clone https://github.com/
|
| 66 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 67 |
-
|
| 68 |
-
git clone https://github.com/
|
| 69 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 70 |
-
|
| 71 |
-
git clone https://github.com/
|
| 72 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 73 |
-
|
| 74 |
-
git clone https://github.com/
|
| 75 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 76 |
-
|
| 77 |
-
git clone https://github.com/
|
| 78 |
-
pip install -r $COMFYUI_DIR/custom_nodes/
|
| 79 |
-
|
| 80 |
-
git clone https://github.com/
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#!/bin/bash
|
| 2 |
+
|
| 3 |
+
# GBRX-LTX23-I2V-T2V Runpod Setup Script (v1.2)
|
| 4 |
+
# pip install huggingface_hub[hf_transfer] -q
|
| 5 |
+
# hf download gbrx/GonzaLomo LTX/GBRX-LTX23-I2V-T2V-Single_runpod_ubuntu2404_v12.sh --local-dir .
|
| 6 |
+
# chmod +x LTX/GBRX-LTX23-I2V-T2V-Single_runpod_ubuntu2404_v12.sh
|
| 7 |
+
# ./LTX/GBRX-LTX23-I2V-T2V-Single_runpod_ubuntu2404_v12.sh
|
| 8 |
+
|
| 9 |
+
set -e # Exit on error
|
| 10 |
+
|
| 11 |
+
echo "Installing ComfyUI"
|
| 12 |
+
cd /workspace
|
| 13 |
+
pip install comfy-cli
|
| 14 |
+
comfy --install-completion
|
| 15 |
+
comfy --here install --fast-deps
|
| 16 |
+
COMFYUI_DIR="/workspace/ComfyUI"
|
| 17 |
+
MODELS_DIR=$COMFYUI_DIR/models
|
| 18 |
+
comfy tracking disable
|
| 19 |
+
|
| 20 |
+
echo "Install Huggingface CLI"
|
| 21 |
+
pip install huggingface_hub
|
| 22 |
+
|
| 23 |
+
echo "Downloading LTX Model"
|
| 24 |
+
hf download unsloth/LTX-2.3-GGUF distilled-1.1/ltx-2.3-22b-distilled-1.1-Q4_K_M.gguf --local-dir $MODELS_DIR/unet
|
| 25 |
+
mv $MODELS_DIR/unet/distilled-1.1/ltx-2.3-22b-distilled-1.1-Q4_K_M.gguf $MODELS_DIR/unet/ltx-2.3-22b-distilled-1.1-Q4_K_M.gguf
|
| 26 |
+
rm -rf $MODELS_DIR/unet/distilled-1.1
|
| 27 |
+
|
| 28 |
+
echo "Downloading LoRAs"
|
| 29 |
+
hf download gbrx/GonzaLomo LTX/DR34ML4Y_LTXXX_PREVIEW_RC1.safetensors --local-dir $MODELS_DIR/loras
|
| 30 |
+
mv $MODELS_DIR/loras/LTX/DR34ML4Y_LTXXX_PREVIEW_RC1.safetensors $MODELS_DIR/loras/DR34ML4Y_LTXXX_PREVIEW_RC1.safetensors
|
| 31 |
+
hf download Lightricks/LTX-2-19b-IC-LoRA-Detailer ltx-2-19b-ic-lora-detailer.safetensors --local-dir $MODELS_DIR/loras
|
| 32 |
+
hf download gbrx/GonzaLomo LTX/LTX2.3-Rogue-Miss-Cowl-v3.safetensors --local-dir $MODELS_DIR/loras
|
| 33 |
+
mv $MODELS_DIR/loras/LTX/LTX2.3-Rogue-Miss-Cowl-v3.safetensors $MODELS_DIR/loras/LTX2.3-Rogue-Miss-Cowl-v3.safetensors
|
| 34 |
+
hf download gbrx/GonzaLomo LTX/LTX2-i2v-SxThrust.safetensors --local-dir $MODELS_DIR/loras
|
| 35 |
+
mv $MODELS_DIR/loras/LTX/LTX2-i2v-SxThrust.safetensors $MODELS_DIR/loras/LTX2-i2v-SexThrust.safetensors
|
| 36 |
+
rm -rf $MODELS_DIR/loras/LTX
|
| 37 |
+
|
| 38 |
+
echo "Downloading VAE files"
|
| 39 |
+
hf download unsloth/LTX-2.3-GGUF vae/ltx-2.3-22b-distilled_video_vae.safetensors --local-dir $MODELS_DIR/
|
| 40 |
+
hf download unsloth/LTX-2.3-GGUF vae/ltx-2.3-22b-distilled_audio_vae.safetensors --local-dir $MODELS_DIR/
|
| 41 |
+
hf download Kijai/LTX2.3_comfy vae/taeltx2_3.safetensors --local-dir $MODELS_DIR/
|
| 42 |
+
|
| 43 |
+
echo "Downloading Text Encoders"
|
| 44 |
+
hf download DreamFast/gemma-3-12b-it-heretic-v2 comfyui/gemma-3-12b-it-heretic-v2_nvfp4.safetensors --local-dir $MODELS_DIR/text_encoders
|
| 45 |
+
mv $MODELS_DIR/text_encoders/comfyui/gemma-3-12b-it-heretic-v2_nvfp4.safetensors $MODELS_DIR/text_encoders/gemma-3-12b-it-heretic-v2_nvfp4.safetensors
|
| 46 |
+
rm -rf $MODELS_DIR/text_encoders/comfyui
|
| 47 |
+
hf download Kijai/LTX2.3_comfy text_encoders/ltx-2.3_text_projection_bf16.safetensors --local-dir $COMFYUI_DIR/models/
|
| 48 |
+
|
| 49 |
+
echo "Downloading Upscale Models"
|
| 50 |
+
hf download Kyca/KycasFiles 2xNomosUni_esrgan_multijpg.pth --local-dir $COMFYUI_DIR/models/upscale_models
|
| 51 |
+
|
| 52 |
+
echo "Installing ComfyUI Nodes"
|
| 53 |
+
git clone https://github.com/Comfy-Org/Nvidia_RTX_Nodes_ComfyUI.git $COMFYUI_DIR/custom_nodes/Nvidia_RTX_Nodes_ComfyUI
|
| 54 |
+
pip install -r $COMFYUI_DIR/custom_nodes/Nvidia_RTX_Nodes_ComfyUI/requirements.txt 2>/dev/null || true
|
| 55 |
+
|
| 56 |
+
git clone https://github.com/cubiq/ComfyUI_essentials.git $COMFYUI_DIR/custom_nodes/ComfyUI_essentials
|
| 57 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI_essentials/requirements.txt
|
| 58 |
+
|
| 59 |
+
git clone https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git $COMFYUI_DIR/custom_nodes/ComfyUI-VideoHelperSuite
|
| 60 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI-VideoHelperSuite/requirements.txt
|
| 61 |
+
|
| 62 |
+
git clone https://github.com/vrgamegirl19/comfyui-vrgamedevgirl.git $COMFYUI_DIR/custom_nodes/comfyui-vrgamedevgirl
|
| 63 |
+
pip install -r $COMFYUI_DIR/custom_nodes/comfyui-vrgamedevgirl/requirements.txt
|
| 64 |
+
|
| 65 |
+
git clone https://github.com/filliptm/ComfyUI_Fill-Nodes.git $COMFYUI_DIR/custom_nodes/ComfyUI_Fill-Nodes
|
| 66 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI_Fill-Nodes/requirements.txt
|
| 67 |
+
|
| 68 |
+
git clone https://github.com/chflame163/ComfyUI_LayerStyle.git $COMFYUI_DIR/custom_nodes/ComfyUI_LayerStyle
|
| 69 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI_LayerStyle/requirements.txt
|
| 70 |
+
|
| 71 |
+
git clone https://github.com/city96/ComfyUI-GGUF.git $COMFYUI_DIR/custom_nodes/ComfyUI-GGUF
|
| 72 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI-GGUF/requirements.txt
|
| 73 |
+
|
| 74 |
+
git clone https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes.git $COMFYUI_DIR/custom_nodes/ComfyUI_Comfyroll_CustomNodes
|
| 75 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI_Comfyroll_CustomNodes/requirements.txt 2>/dev/null || true
|
| 76 |
+
|
| 77 |
+
git clone https://github.com/kijai/ComfyUI-KJNodes.git $COMFYUI_DIR/custom_nodes/ComfyUI-KJNodes
|
| 78 |
+
pip install -r $COMFYUI_DIR/custom_nodes/ComfyUI-KJNodes/requirements.txt
|
| 79 |
+
|
| 80 |
+
git clone https://github.com/rgthree/rgthree-comfy.git $COMFYUI_DIR/custom_nodes/rgthree-comfy
|
| 81 |
+
pip install -r $COMFYUI_DIR/custom_nodes/rgthree-comfy/requirements.txt
|
| 82 |
+
|
| 83 |
+
git clone https://github.com/calcuis/gguf.git $COMFYUI_DIR/custom_nodes/gguf
|
| 84 |
+
|
| 85 |
+
echo "🚀Starting ComfyUI."
|
| 86 |
+
comfy launch -- --listen 0.0.0.0 --enable-cors-header '*' --enable-manager
|