Instructions to use saik0s/comfy_backup with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use saik0s/comfy_backup with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="saik0s/comfy_backup", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-q2_k.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use saik0s/comfy_backup with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./llama-cli -hf saik0s/comfy_backup:Q4_K_S
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama-cli -hf saik0s/comfy_backup:Q4_K_S
Use Docker
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- LM Studio
- Jan
- Ollama
How to use saik0s/comfy_backup with Ollama:
ollama run hf.co/saik0s/comfy_backup:Q4_K_S
- Unsloth Studio
How to use saik0s/comfy_backup with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for saik0s/comfy_backup to start chatting
- Pi
How to use saik0s/comfy_backup with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "saik0s/comfy_backup:Q4_K_S" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use saik0s/comfy_backup with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default saik0s/comfy_backup:Q4_K_S
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use saik0s/comfy_backup with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "saik0s/comfy_backup:Q4_K_S" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use saik0s/comfy_backup with Docker Model Runner:
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- Lemonade
How to use saik0s/comfy_backup with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull saik0s/comfy_backup:Q4_K_S
Run and chat with the model
lemonade run user.comfy_backup-Q4_K_S
List all available models
lemonade list
| .cn-manager { | |
| --grid-font: -apple-system, BlinkMacSystemFont, "Segoe UI", "Noto Sans", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; | |
| z-index: 1099; | |
| width: 80vw; | |
| height: 75vh; | |
| min-height: 30em; | |
| display: flex; | |
| flex-direction: column; | |
| gap: 10px; | |
| color: var(--fg-color); | |
| font-family: arial, sans-serif; | |
| text-underline-offset: 3px; | |
| outline: none; | |
| margin: calc(var(--spacing)*2); | |
| } | |
| .cn-manager .cn-flex-auto { | |
| flex: auto; | |
| } | |
| .cn-manager button { | |
| width: auto; | |
| position: relative; | |
| overflow: hidden; | |
| font-size: 16px; | |
| color: var(--input-text); | |
| background-color: var(--comfy-input-bg); | |
| border-color: var(--border-color); | |
| margin: 0; | |
| min-width: 100px; | |
| } | |
| .cn-manager button:hover { | |
| filter: brightness(125%); | |
| } | |
| .cn-manager button:disabled, | |
| .cn-manager input:disabled, | |
| .cn-manager select:disabled { | |
| color: gray; | |
| } | |
| .cn-manager button:disabled { | |
| background-color: var(--comfy-input-bg); | |
| } | |
| .cn-manager .cn-manager-restart { | |
| display: none; | |
| background-color: #500000 ; | |
| border-color: #88181b ; | |
| color: white ; | |
| } | |
| .cn-manager .cn-manager-restart:hover { | |
| background-color: #88181b ; | |
| } | |
| .cn-manager .cn-manager-stop { | |
| display: none; | |
| background-color: #500000; | |
| color: white; | |
| } | |
| .cn-manager .cn-manager-back { | |
| align-items: center; | |
| justify-content: center; | |
| } | |
| .arrow-icon { | |
| height: 1em; | |
| width: 1em; | |
| margin-right: 5px; | |
| transform: translateY(2px); | |
| } | |
| .cn-icon { | |
| display: block; | |
| width: 16px; | |
| height: 16px; | |
| } | |
| .cn-icon svg { | |
| display: block; | |
| margin: 0; | |
| pointer-events: none; | |
| } | |
| .cn-manager-header { | |
| display: flex; | |
| flex-wrap: wrap; | |
| gap: 5px; | |
| align-items: center; | |
| } | |
| .cn-manager-header label { | |
| display: flex; | |
| gap: 5px; | |
| align-items: center; | |
| } | |
| .cn-manager-filter { | |
| height: 28px; | |
| line-height: 28px; | |
| cursor: pointer; | |
| padding: 0.5em 0.5em; | |
| border: 1px solid var(--border-color); | |
| border-radius: 6px; | |
| background: var(--comfy-input-bg); | |
| } | |
| .cn-manager-filter:hover { | |
| filter: brightness(125%); | |
| } | |
| .cn-manager-keywords { | |
| height: 28px; | |
| line-height: 28px; | |
| padding: 0 5px 0 26px; | |
| background: var(--comfy-input-bg); | |
| background-size: 16px; | |
| background-position: 5px center; | |
| background-repeat: no-repeat; | |
| background-image: url("data:image/svg+xml;charset=utf8,%3Csvg%20viewBox%3D%220%200%2024%2024%22%20width%3D%22100%25%22%20height%3D%22100%25%22%20pointer-events%3D%22none%22%20xmlns%3D%22http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%22%3E%3Cpath%20fill%3D%22none%22%20stroke%3D%22%23888%22%20stroke-linecap%3D%22round%22%20stroke-linejoin%3D%22round%22%20stroke-width%3D%222%22%20d%3D%22m21%2021-4.486-4.494M19%2010.5a8.5%208.5%200%201%201-17%200%208.5%208.5%200%200%201%2017%200%22%2F%3E%3C%2Fsvg%3E"); | |
| border: 1px solid var(--border-color); | |
| border-radius: 6px; | |
| outline-color: transparent; | |
| } | |
| .cn-manager-status { | |
| padding-left: 10px; | |
| } | |
| .cn-manager-grid { | |
| flex: auto; | |
| border: 1px solid var(--border-color); | |
| overflow: hidden; | |
| position: relative; | |
| } | |
| .cn-manager-selection { | |
| display: flex; | |
| flex-wrap: wrap; | |
| gap: 10px; | |
| align-items: center; | |
| } | |
| .cn-manager-message { | |
| position: relative; | |
| } | |
| .cn-manager-footer { | |
| display: flex; | |
| flex-wrap: wrap; | |
| gap: 10px; | |
| align-items: center; | |
| } | |
| .cn-manager-grid .tg-turbogrid { | |
| font-family: var(--grid-font); | |
| font-size: 15px; | |
| background: var(--bg-color); | |
| } | |
| .cn-manager-grid .tg-turbogrid .tg-highlight::after { | |
| position: absolute; | |
| top: 0; | |
| left: 0; | |
| content: ""; | |
| display: block; | |
| width: 100%; | |
| height: 100%; | |
| box-sizing: border-box; | |
| background-color: #80bdff11; | |
| pointer-events: none; | |
| } | |
| .cn-manager-grid .cn-pack-name a { | |
| color: skyblue; | |
| text-decoration: none; | |
| word-break: break-word; | |
| } | |
| .cn-manager-grid .cn-pack-desc a { | |
| color: #5555FF; | |
| font-weight: bold; | |
| text-decoration: none; | |
| } | |
| .cn-manager-grid .tg-cell a:hover { | |
| text-decoration: underline; | |
| } | |
| .cn-manager-grid .cn-pack-version { | |
| line-height: 100%; | |
| display: flex; | |
| flex-direction: column; | |
| justify-content: center; | |
| height: 100%; | |
| gap: 5px; | |
| } | |
| .cn-manager-grid .cn-pack-nodes { | |
| line-height: 100%; | |
| display: flex; | |
| flex-direction: column; | |
| justify-content: center; | |
| gap: 5px; | |
| cursor: pointer; | |
| height: 100%; | |
| } | |
| .cn-manager-grid .cn-pack-nodes:hover { | |
| text-decoration: underline; | |
| } | |
| .cn-manager-grid .cn-pack-conflicts { | |
| color: orange; | |
| } | |
| .cn-popover { | |
| position: fixed; | |
| z-index: 10000; | |
| padding: 20px; | |
| color: #1e1e1e; | |
| filter: drop-shadow(1px 5px 5px rgb(0 0 0 / 30%)); | |
| overflow: hidden; | |
| } | |
| .cn-flyover { | |
| position: absolute; | |
| top: 0; | |
| right: 0; | |
| z-index: 1000; | |
| display: none; | |
| width: 50%; | |
| height: 100%; | |
| background-color: var(--comfy-menu-bg); | |
| animation-duration: 0.2s; | |
| animation-fill-mode: both; | |
| flex-direction: column; | |
| } | |
| .cn-flyover::before { | |
| position: absolute; | |
| top: 0; | |
| content: ""; | |
| z-index: 10; | |
| display: block; | |
| width: 10px; | |
| height: 100%; | |
| pointer-events: none; | |
| left: -10px; | |
| background-image: linear-gradient(to left, rgb(0 0 0 / 20%), rgb(0 0 0 / 0%)); | |
| } | |
| .cn-flyover-header { | |
| height: 45px; | |
| display: flex; | |
| align-items: center; | |
| gap: 5px; | |
| border-bottom: 1px solid var(--border-color); | |
| } | |
| .cn-flyover-close { | |
| display: flex; | |
| align-items: center; | |
| padding: 0 10px; | |
| justify-content: center; | |
| cursor: pointer; | |
| opacity: 0.8; | |
| height: 100%; | |
| } | |
| .cn-flyover-close:hover { | |
| opacity: 1; | |
| } | |
| .cn-flyover-close svg { | |
| display: block; | |
| margin: 0; | |
| pointer-events: none; | |
| width: 20px; | |
| height: 20px; | |
| } | |
| .cn-flyover-title { | |
| display: flex; | |
| align-items: center; | |
| font-weight: bold; | |
| gap: 10px; | |
| flex: auto; | |
| } | |
| .cn-flyover-body { | |
| height: calc(100% - 45px); | |
| overflow-y: auto; | |
| position: relative; | |
| background-color: var(--comfy-menu-secondary-bg); | |
| } | |
| @keyframes cn-slide-in-right { | |
| from { | |
| visibility: visible; | |
| transform: translate3d(100%, 0, 0); | |
| } | |
| to { | |
| transform: translate3d(0, 0, 0); | |
| } | |
| } | |
| .cn-slide-in-right { | |
| animation-name: cn-slide-in-right; | |
| } | |
| @keyframes cn-slide-out-right { | |
| from { | |
| transform: translate3d(0, 0, 0); | |
| } | |
| to { | |
| visibility: hidden; | |
| transform: translate3d(100%, 0, 0); | |
| } | |
| } | |
| .cn-slide-out-right { | |
| animation-name: cn-slide-out-right; | |
| } | |
| .cn-nodes-list { | |
| width: 100%; | |
| } | |
| .cn-nodes-row { | |
| display: flex; | |
| align-items: center; | |
| gap: 10px; | |
| } | |
| .cn-nodes-row:nth-child(odd) { | |
| background-color: rgb(0 0 0 / 5%); | |
| } | |
| .cn-nodes-row:hover { | |
| background-color: rgb(0 0 0 / 10%); | |
| } | |
| .cn-nodes-sn { | |
| text-align: right; | |
| min-width: 35px; | |
| color: var(--drag-text); | |
| flex-shrink: 0; | |
| font-size: 12px; | |
| padding: 8px 5px; | |
| } | |
| .cn-nodes-name { | |
| cursor: pointer; | |
| white-space: nowrap; | |
| flex-shrink: 0; | |
| position: relative; | |
| padding: 8px 5px; | |
| } | |
| .cn-nodes-name::after { | |
| content: attr(action); | |
| position: absolute; | |
| pointer-events: none; | |
| top: 50%; | |
| left: 100%; | |
| transform: translate(5px, -50%); | |
| font-size: 12px; | |
| color: var(--drag-text); | |
| background-color: var(--comfy-input-bg); | |
| border-radius: 10px; | |
| border: 1px solid var(--border-color); | |
| padding: 3px 8px; | |
| display: none; | |
| } | |
| .cn-nodes-name.action::after { | |
| display: block; | |
| } | |
| .cn-nodes-name:hover { | |
| text-decoration: underline; | |
| } | |
| .cn-nodes-conflict .cn-nodes-name, | |
| .cn-nodes-conflict .cn-icon { | |
| color: orange; | |
| } | |
| .cn-conflicts-list { | |
| display: flex; | |
| flex-wrap: wrap; | |
| gap: 5px; | |
| align-items: center; | |
| padding: 5px 0; | |
| } | |
| .cn-conflicts-list b { | |
| font-weight: normal; | |
| color: var(--descrip-text); | |
| } | |
| .cn-nodes-pack { | |
| cursor: pointer; | |
| color: skyblue; | |
| } | |
| .cn-nodes-pack:hover { | |
| text-decoration: underline; | |
| } | |
| .cn-pack-badge { | |
| font-size: 12px; | |
| font-weight: normal; | |
| background-color: var(--comfy-input-bg); | |
| border-radius: 10px; | |
| border: 1px solid var(--border-color); | |
| padding: 3px 8px; | |
| color: var(--error-text); | |
| } | |
| .cn-preview { | |
| min-width: 300px; | |
| max-width: 500px; | |
| min-height: 120px; | |
| overflow: hidden; | |
| font-size: 12px; | |
| pointer-events: none; | |
| padding: 12px; | |
| color: var(--fg-color); | |
| } | |
| .cn-preview-header { | |
| display: flex; | |
| gap: 8px; | |
| align-items: center; | |
| border-bottom: 1px solid var(--comfy-input-bg); | |
| padding: 5px 10px; | |
| } | |
| .cn-preview-dot { | |
| width: 8px; | |
| height: 8px; | |
| border-radius: 50%; | |
| background-color: grey; | |
| position: relative; | |
| filter: drop-shadow(1px 2px 3px rgb(0 0 0 / 30%)); | |
| } | |
| .cn-preview-dot.cn-preview-optional::after { | |
| content: ""; | |
| position: absolute; | |
| pointer-events: none; | |
| top: 50%; | |
| left: 50%; | |
| transform: translate(-50%, -50%); | |
| background-color: var(--comfy-input-bg); | |
| border-radius: 50%; | |
| width: 3px; | |
| height: 3px; | |
| } | |
| .cn-preview-dot.cn-preview-grid { | |
| border-radius: 0; | |
| } | |
| .cn-preview-dot.cn-preview-grid::before { | |
| content: ''; | |
| position: absolute; | |
| border-left: 1px solid var(--comfy-input-bg); | |
| border-right: 1px solid var(--comfy-input-bg); | |
| width: 4px; | |
| height: 100%; | |
| left: 2px; | |
| top: 0; | |
| z-index: 1; | |
| } | |
| .cn-preview-dot.cn-preview-grid::after { | |
| content: ''; | |
| position: absolute; | |
| border-top: 1px solid var(--comfy-input-bg); | |
| border-bottom: 1px solid var(--comfy-input-bg); | |
| width: 100%; | |
| height: 4px; | |
| left: 0; | |
| top: 2px; | |
| z-index: 1; | |
| } | |
| .cn-preview-name { | |
| flex: auto; | |
| font-size: 14px; | |
| } | |
| .cn-preview-io { | |
| display: flex; | |
| justify-content: space-between; | |
| padding: 10px 10px; | |
| } | |
| .cn-preview-column > div { | |
| display: flex; | |
| gap: 10px; | |
| align-items: center; | |
| height: 18px; | |
| overflow: hidden; | |
| white-space: nowrap; | |
| text-overflow: ellipsis; | |
| } | |
| .cn-preview-input { | |
| justify-content: flex-start; | |
| } | |
| .cn-preview-output { | |
| justify-content: flex-end; | |
| } | |
| .cn-preview-list { | |
| display: flex; | |
| flex-direction: column; | |
| gap: 3px; | |
| padding: 0 10px 10px 10px; | |
| } | |
| .cn-preview-switch { | |
| position: relative; | |
| display: flex; | |
| justify-content: space-between; | |
| align-items: center; | |
| background: var(--bg-color); | |
| border: 2px solid var(--border-color); | |
| border-radius: 10px; | |
| text-wrap: nowrap; | |
| padding: 2px 20px; | |
| gap: 10px; | |
| } | |
| .cn-preview-switch::before, | |
| .cn-preview-switch::after { | |
| position: absolute; | |
| pointer-events: none; | |
| top: 50%; | |
| transform: translate(0, -50%); | |
| color: var(--fg-color); | |
| opacity: 0.8; | |
| } | |
| .cn-preview-switch::before { | |
| content: "◀"; | |
| left: 5px; | |
| } | |
| .cn-preview-switch::after { | |
| content: "▶"; | |
| right: 5px; | |
| } | |
| .cn-preview-value { | |
| color: var(--descrip-text); | |
| } | |
| .cn-preview-string { | |
| min-height: 30px; | |
| max-height: 300px; | |
| background: var(--bg-color); | |
| color: var(--descrip-text); | |
| border-radius: 3px; | |
| padding: 3px 5px; | |
| overflow-y: auto; | |
| overflow-x: hidden; | |
| } | |
| .cn-preview-description { | |
| margin: 0px 10px 10px 10px; | |
| padding: 6px; | |
| background: var(--border-color); | |
| color: var(--descrip-text); | |
| border-radius: 5px; | |
| font-style: italic; | |
| word-break: break-word; | |
| } | |
| .cn-tag-list { | |
| display: flex; | |
| flex-wrap: wrap; | |
| gap: 5px; | |
| align-items: center; | |
| margin-bottom: 5px; | |
| } | |
| .cn-tag-list > div { | |
| background-color: var(--border-color); | |
| border-radius: 5px; | |
| padding: 0 5px; | |
| } | |
| .cn-install-buttons { | |
| display: flex; | |
| flex-direction: column; | |
| gap: 3px; | |
| padding: 3px; | |
| align-items: center; | |
| justify-content: center; | |
| height: 100%; | |
| } | |
| .cn-install-buttons button { | |
| padding: 4px 8px; | |
| } | |
| .cn-selected-buttons { | |
| display: flex; | |
| gap: 5px; | |
| align-items: center; | |
| padding-right: 20px; | |
| } | |
| .cn-manager .cn-btn-enable { | |
| background-color: #333399; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-disable { | |
| background-color: #442277; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-update { | |
| background-color: #1155AA; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-try-update { | |
| background-color: Gray; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-try-fix { | |
| background-color: #6495ED; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-import-failed { | |
| background-color: #AA1111; | |
| font-size: 10px; | |
| font-weight: bold; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-install { | |
| background-color: black; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-try-install { | |
| background-color: Gray; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-uninstall { | |
| background-color: #993333; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-reinstall { | |
| background-color: #993333; | |
| color: white; | |
| } | |
| .cn-manager .cn-btn-switch { | |
| background-color: #448833; | |
| color: white; | |
| } | |
| @keyframes cn-btn-loading-bg { | |
| 0% { | |
| left: 0; | |
| } | |
| 100% { | |
| left: -105px; | |
| } | |
| } | |
| .cn-manager button.cn-btn-loading { | |
| position: relative; | |
| overflow: hidden; | |
| border-color: rgb(0 119 207 / 80%); | |
| background-color: var(--comfy-input-bg); | |
| } | |
| .cn-manager button.cn-btn-loading::after { | |
| position: absolute; | |
| top: 0; | |
| left: 0; | |
| content: ""; | |
| width: 500px; | |
| height: 100%; | |
| background-image: repeating-linear-gradient( | |
| -45deg, | |
| rgb(0 119 207 / 30%), | |
| rgb(0 119 207 / 30%) 10px, | |
| transparent 10px, | |
| transparent 15px | |
| ); | |
| animation: cn-btn-loading-bg 2s linear infinite; | |
| } | |
| .cn-manager-light .cn-pack-name a { | |
| color: blue; | |
| } | |
| .cn-manager-light .cm-warn-note { | |
| background-color: #ccc ; | |
| } | |
| .cn-manager-light .cn-btn-install { | |
| background-color: #333; | |
| } |