Instructions to use saik0s/comfy_backup with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use saik0s/comfy_backup with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="saik0s/comfy_backup", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-q2_k.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use saik0s/comfy_backup with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./llama-cli -hf saik0s/comfy_backup:Q4_K_S
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama-cli -hf saik0s/comfy_backup:Q4_K_S
Use Docker
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- LM Studio
- Jan
- Ollama
How to use saik0s/comfy_backup with Ollama:
ollama run hf.co/saik0s/comfy_backup:Q4_K_S
- Unsloth Studio
How to use saik0s/comfy_backup with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for saik0s/comfy_backup to start chatting
- Pi
How to use saik0s/comfy_backup with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "saik0s/comfy_backup:Q4_K_S" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use saik0s/comfy_backup with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default saik0s/comfy_backup:Q4_K_S
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use saik0s/comfy_backup with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "saik0s/comfy_backup:Q4_K_S" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use saik0s/comfy_backup with Docker Model Runner:
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- Lemonade
How to use saik0s/comfy_backup with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull saik0s/comfy_backup:Q4_K_S
Run and chat with the model
lemonade run user.comfy_backup-Q4_K_S
List all available models
lemonade list
| from abc import ABC, abstractmethod | |
| from typing import TYPE_CHECKING | |
| from comfy_api.internal import ComfyAPIBase | |
| from comfy_api.internal.singleton import ProxiedSingleton | |
| from comfy_api.internal.async_to_sync import create_sync_class | |
| from ._input import ImageInput, AudioInput, MaskInput, LatentInput, VideoInput | |
| from ._input_impl import VideoFromFile, VideoFromComponents | |
| from ._util import VideoCodec, VideoContainer, VideoComponents, MESH, VOXEL, SPLAT, File3D | |
| from . import _io_public as io | |
| from . import _ui_public as ui | |
| from comfy_execution.utils import get_executing_context | |
| from comfy_execution.progress import get_progress_state, PreviewImageTuple | |
| from PIL import Image | |
| from comfy.cli_args import args | |
| import numpy as np | |
| class ComfyAPI_latest(ComfyAPIBase): | |
| VERSION = "latest" | |
| STABLE = False | |
| def __init__(self): | |
| super().__init__() | |
| self.node_replacement = self.NodeReplacement() | |
| self.execution = self.Execution() | |
| self.caching = self.Caching() | |
| class NodeReplacement(ProxiedSingleton): | |
| async def register(self, node_replace: io.NodeReplace) -> None: | |
| """Register a node replacement mapping.""" | |
| from server import PromptServer | |
| PromptServer.instance.node_replace_manager.register(node_replace) | |
| class Execution(ProxiedSingleton): | |
| async def set_progress( | |
| self, | |
| value: float, | |
| max_value: float, | |
| node_id: str | None = None, | |
| preview_image: Image.Image | ImageInput | None = None, | |
| ignore_size_limit: bool = False, | |
| ) -> None: | |
| """ | |
| Update the progress bar displayed in the ComfyUI interface. | |
| This function allows custom nodes and API calls to report their progress | |
| back to the user interface, providing visual feedback during long operations. | |
| Migration from previous API: comfy.utils.PROGRESS_BAR_HOOK | |
| """ | |
| executing_context = get_executing_context() | |
| if node_id is None and executing_context is not None: | |
| node_id = executing_context.node_id | |
| if node_id is None: | |
| raise ValueError("node_id must be provided if not in executing context") | |
| # Convert preview_image to PreviewImageTuple if needed | |
| to_display: PreviewImageTuple | Image.Image | ImageInput | None = preview_image | |
| if to_display is not None: | |
| # First convert to PIL Image if needed | |
| if isinstance(to_display, ImageInput): | |
| # Convert ImageInput (torch.Tensor) to PIL Image | |
| # Handle tensor shape [B, H, W, C] -> get first image if batch | |
| tensor = to_display | |
| if len(tensor.shape) == 4: | |
| tensor = tensor[0] | |
| # Convert to numpy array and scale to 0-255 | |
| image_np = (tensor.cpu().numpy() * 255).astype(np.uint8) | |
| to_display = Image.fromarray(image_np) | |
| if isinstance(to_display, Image.Image): | |
| # Detect image format from PIL Image | |
| image_format = to_display.format if to_display.format else "JPEG" | |
| # Use None for preview_size if ignore_size_limit is True | |
| preview_size = None if ignore_size_limit else args.preview_size | |
| to_display = (image_format, to_display, preview_size) | |
| get_progress_state().update_progress( | |
| node_id=node_id, | |
| value=value, | |
| max_value=max_value, | |
| image=to_display, | |
| ) | |
| class Caching(ProxiedSingleton): | |
| """ | |
| External cache provider API for sharing cached node outputs | |
| across ComfyUI instances. | |
| Example:: | |
| from comfy_api.latest import Caching | |
| class MyCacheProvider(Caching.CacheProvider): | |
| async def on_lookup(self, context): | |
| ... # check external storage | |
| async def on_store(self, context, value): | |
| ... # store to external storage | |
| Caching.register_provider(MyCacheProvider()) | |
| """ | |
| from ._caching import CacheProvider, CacheContext, CacheValue | |
| async def register_provider(self, provider: "ComfyAPI_latest.Caching.CacheProvider") -> None: | |
| """Register an external cache provider. Providers are called in registration order.""" | |
| from comfy_execution.cache_provider import register_cache_provider | |
| register_cache_provider(provider) | |
| async def unregister_provider(self, provider: "ComfyAPI_latest.Caching.CacheProvider") -> None: | |
| """Unregister a previously registered cache provider.""" | |
| from comfy_execution.cache_provider import unregister_cache_provider | |
| unregister_cache_provider(provider) | |
| class ComfyExtension(ABC): | |
| async def on_load(self) -> None: | |
| """ | |
| Called when an extension is loaded. | |
| This should be used to initialize any global resources needed by the extension. | |
| """ | |
| async def get_node_list(self) -> list[type[io.ComfyNode]]: | |
| """ | |
| Returns a list of nodes that this extension provides. | |
| """ | |
| class Input: | |
| Image = ImageInput | |
| Audio = AudioInput | |
| Mask = MaskInput | |
| Latent = LatentInput | |
| Video = VideoInput | |
| class InputImpl: | |
| VideoFromFile = VideoFromFile | |
| VideoFromComponents = VideoFromComponents | |
| class Types: | |
| VideoCodec = VideoCodec | |
| VideoContainer = VideoContainer | |
| VideoComponents = VideoComponents | |
| MESH = MESH | |
| VOXEL = VOXEL | |
| SPLAT = SPLAT | |
| File3D = File3D | |
| Caching = ComfyAPI_latest.Caching | |
| ComfyAPI = ComfyAPI_latest | |
| # Create a synchronous version of the API | |
| if TYPE_CHECKING: | |
| import comfy_api.latest.generated.ComfyAPISyncStub # type: ignore | |
| ComfyAPISync: type[comfy_api.latest.generated.ComfyAPISyncStub.ComfyAPISyncStub] | |
| ComfyAPISync = create_sync_class(ComfyAPI_latest) | |
| # create new aliases for io and ui | |
| IO = io | |
| UI = ui | |
| __all__ = [ | |
| "ComfyAPI", | |
| "ComfyAPISync", | |
| "Input", | |
| "InputImpl", | |
| "Types", | |
| "Caching", | |
| "ComfyExtension", | |
| "io", | |
| "IO", | |
| "ui", | |
| "UI", | |
| ] | |