Instructions to use saik0s/comfy_backup with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use saik0s/comfy_backup with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="saik0s/comfy_backup", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-q2_k.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use saik0s/comfy_backup with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./llama-cli -hf saik0s/comfy_backup:Q4_K_S
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama-cli -hf saik0s/comfy_backup:Q4_K_S
Use Docker
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- LM Studio
- Jan
- Ollama
How to use saik0s/comfy_backup with Ollama:
ollama run hf.co/saik0s/comfy_backup:Q4_K_S
- Unsloth Studio
How to use saik0s/comfy_backup with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for saik0s/comfy_backup to start chatting
- Pi
How to use saik0s/comfy_backup with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "saik0s/comfy_backup:Q4_K_S" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use saik0s/comfy_backup with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default saik0s/comfy_backup:Q4_K_S
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use saik0s/comfy_backup with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "saik0s/comfy_backup:Q4_K_S" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use saik0s/comfy_backup with Docker Model Runner:
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- Lemonade
How to use saik0s/comfy_backup with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull saik0s/comfy_backup:Q4_K_S
Run and chat with the model
lemonade run user.comfy_backup-Q4_K_S
List all available models
lemonade list
| { | |
| "id": "ce319ced-e662-4184-98eb-d142fb7b245f", | |
| "revision": 0, | |
| "last_node_id": 32, | |
| "last_link_id": 34, | |
| "nodes": [ | |
| { | |
| "id": 17, | |
| "type": "GetModelsFromWorkflow", | |
| "pos": [ | |
| -972.2092895507812, | |
| -184.9186248779297 | |
| ], | |
| "size": [ | |
| 480.0000305175781, | |
| 115.73332214355469 | |
| ], | |
| "flags": {}, | |
| "order": 0, | |
| "mode": 2, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "pa", | |
| "type": "STRING", | |
| "slot_index": 0, | |
| "links": [ | |
| 33 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "GetModelsFromWorkflow" | |
| }, | |
| "widgets_values": [ | |
| "/workspace/ComfyUI/user/default/workflows/wanvideo_480p_I2V_FLUXLORA (1).json", | |
| "/workspace/ComfyUI/models/" | |
| ] | |
| }, | |
| { | |
| "id": 31, | |
| "type": "Display Any (rgthree)", | |
| "pos": [ | |
| -379.0292053222656, | |
| -190.2797393798828 | |
| ], | |
| "size": [ | |
| 397.38232421875, | |
| 232.47381591796875 | |
| ], | |
| "flags": {}, | |
| "order": 3, | |
| "mode": 2, | |
| "inputs": [ | |
| { | |
| "name": "source", | |
| "type": "*", | |
| "link": 33 | |
| } | |
| ], | |
| "outputs": [], | |
| "properties": { | |
| "Node name for S&R": "Display Any (rgthree)" | |
| }, | |
| "widgets_values": [ | |
| "(umt5-xxl-enc-bf16.safetensors~~~text_encoders),(4x_NMKD-Siax_200k.pth~~~upscale_models),(open-clip-xlm-roberta-large-vit-huge-14_visual_fp16.safetensors~~~clip),(Wan2_1_VAE_fp32.safetensors~~~vae),(4x_NMKD-Siax_200k.pth~~~upscale_models),(FluxMythV2.safetensors~~~clip),(aidmaFLUXpro1.1-FLUX-V0.2.safetensors~~~clip),(aidmaHyperRealism-FLUX-V0.2.safetensors~~~clip),(film_net_fp32.pt~~~configs),(film_net_fp32.pt~~~configs),(flux1-dev-fp8.safetensors~~~vae),(Wan2_1-I2V-14B-720P_fp8_e4m3fn.safetensors~~~loras)" | |
| ] | |
| }, | |
| { | |
| "id": 30, | |
| "type": "Fast Groups Muter (rgthree)", | |
| "pos": [ | |
| -1744.7056884765625, | |
| -120.06262969970703 | |
| ], | |
| "size": [ | |
| 519.0283203125, | |
| 149.43731689453125 | |
| ], | |
| "flags": {}, | |
| "order": 1, | |
| "mode": 0, | |
| "inputs": [], | |
| "outputs": [ | |
| { | |
| "name": "OPT_CONNECTION", | |
| "type": "*", | |
| "links": null | |
| } | |
| ], | |
| "properties": { | |
| "matchColors": "", | |
| "matchTitle": "", | |
| "showNav": true, | |
| "sort": "position", | |
| "customSortAlphabet": "", | |
| "toggleRestriction": "default" | |
| } | |
| }, | |
| { | |
| "id": 20, | |
| "type": "Power Prompt - Simple (rgthree)", | |
| "pos": [ | |
| -980.2467041015625, | |
| 724.5652465820312 | |
| ], | |
| "size": [ | |
| 833.0332641601562, | |
| 217.1599884033203 | |
| ], | |
| "flags": {}, | |
| "order": 2, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "dir": 3, | |
| "name": "opt_clip", | |
| "shape": 7, | |
| "type": "CLIP", | |
| "link": null | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "color_off": "#666665", | |
| "color_on": "#666665", | |
| "dir": 4, | |
| "name": "CONDITIONING", | |
| "type": "CONDITIONING", | |
| "links": null | |
| }, | |
| { | |
| "color_off": "#7F7", | |
| "color_on": "#7F7", | |
| "dir": 4, | |
| "name": "TEXT", | |
| "type": "STRING", | |
| "slot_index": 1, | |
| "links": [ | |
| 31 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "Power Prompt - Simple (rgthree)", | |
| "combos_filter": "" | |
| }, | |
| "widgets_values": [ | |
| "(umt5-xxl-enc-bf16.safetensors~~~clip),(4x_NMKD-Siax_200k.pth~~~upscale_models),(open-clip-xlm-roberta-large-vit-huge-14_visual_fp16.safetensors~~~clip),(Wan2_1_VAE_fp32.safetensors~~~vae),(FluxMythV2.safetensors~~~loras),(aidmaFLUXpro1.1-FLUX-V0.2.safetensors~~~loras),(aidmaHyperRealism-FLUX-V0.2.safetensors~~~loras),(flux1-dev-fp8.safetensors~~~unet),(Wan2_1-I2V-14B-720P_fp8_e4m3fn.safetensors~~~unet)" | |
| ] | |
| }, | |
| { | |
| "id": 28, | |
| "type": "AutoDownloadALLModels", | |
| "pos": [ | |
| -582.1441650390625, | |
| 537.7410888671875 | |
| ], | |
| "size": [ | |
| 490.72662353515625, | |
| 110.66668701171875 | |
| ], | |
| "flags": {}, | |
| "order": 4, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "modelandpath", | |
| "type": "STRING", | |
| "widget": { | |
| "name": "modelandpath" | |
| }, | |
| "link": 31 | |
| } | |
| ], | |
| "outputs": [ | |
| { | |
| "name": "status", | |
| "type": "STRING", | |
| "links": [ | |
| 34 | |
| ] | |
| } | |
| ], | |
| "properties": { | |
| "Node name for S&R": "AutoDownloadALLModels" | |
| }, | |
| "widgets_values": [ | |
| "", | |
| "Kijai/WanVideo_comfy,latent-consistency/lcm-lora-sdv1-5" | |
| ] | |
| }, | |
| { | |
| "id": 32, | |
| "type": "Display Any (rgthree)", | |
| "pos": [ | |
| 38.63861083984375, | |
| 664.4175415039062 | |
| ], | |
| "size": [ | |
| 430.5312805175781, | |
| 179.4630584716797 | |
| ], | |
| "flags": {}, | |
| "order": 5, | |
| "mode": 0, | |
| "inputs": [ | |
| { | |
| "name": "source", | |
| "type": "*", | |
| "link": 34 | |
| } | |
| ], | |
| "outputs": [], | |
| "properties": { | |
| "Node name for S&R": "Display Any (rgthree)" | |
| }, | |
| "widgets_values": [ | |
| "" | |
| ] | |
| } | |
| ], | |
| "links": [ | |
| [ | |
| 31, | |
| 20, | |
| 1, | |
| 28, | |
| 0, | |
| "STRING" | |
| ], | |
| [ | |
| 33, | |
| 17, | |
| 0, | |
| 31, | |
| 0, | |
| "*" | |
| ], | |
| [ | |
| 34, | |
| 28, | |
| 0, | |
| 32, | |
| 0, | |
| "*" | |
| ] | |
| ], | |
| "groups": [ | |
| { | |
| "id": 1, | |
| "title": "Step1", | |
| "bounding": [ | |
| -1059.1004638671875, | |
| -397.3572998046875, | |
| 1683.384033203125, | |
| 695.924560546875 | |
| ], | |
| "color": "#3f789e", | |
| "font_size": 24, | |
| "flags": {} | |
| }, | |
| { | |
| "id": 2, | |
| "title": "Step2", | |
| "bounding": [ | |
| -1064.10205078125, | |
| 340.75189208984375, | |
| 1843.4385986328125, | |
| 764.5194702148438 | |
| ], | |
| "color": "#3f789e", | |
| "font_size": 24, | |
| "flags": {} | |
| } | |
| ], | |
| "config": {}, | |
| "extra": { | |
| "ds": { | |
| "scale": 0.42409761837248494, | |
| "offset": [ | |
| 1269.256013741986, | |
| -114.20634772143546 | |
| ] | |
| }, | |
| "VHS_latentpreview": false, | |
| "VHS_latentpreviewrate": 0, | |
| "VHS_MetadataImage": true, | |
| "VHS_KeepIntermediate": true, | |
| "node_versions": { | |
| "ComfyUI_AutoDownloadModels": "efa381365abe8b02e640cd231cbf8e8cc2af5f74", | |
| "rgthree-comfy": "ab37a0bd377a4443d04896b34a9491ddb1cb014b" | |
| } | |
| }, | |
| "version": 0.4 | |
| } |