Instructions to use saik0s/comfy_backup with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use saik0s/comfy_backup with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="saik0s/comfy_backup", filename="ComfyUI/models/text_encoders/gemma-3-12b-it-q2_k.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use saik0s/comfy_backup with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: llama cli -hf saik0s/comfy_backup:Q4_K_S
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./llama-cli -hf saik0s/comfy_backup:Q4_K_S
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf saik0s/comfy_backup:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama-cli -hf saik0s/comfy_backup:Q4_K_S
Use Docker
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- LM Studio
- Jan
- Ollama
How to use saik0s/comfy_backup with Ollama:
ollama run hf.co/saik0s/comfy_backup:Q4_K_S
- Unsloth Studio
How to use saik0s/comfy_backup with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for saik0s/comfy_backup to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for saik0s/comfy_backup to start chatting
- Pi
How to use saik0s/comfy_backup with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "saik0s/comfy_backup:Q4_K_S" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use saik0s/comfy_backup with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default saik0s/comfy_backup:Q4_K_S
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use saik0s/comfy_backup with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf saik0s/comfy_backup:Q4_K_S
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "saik0s/comfy_backup:Q4_K_S" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use saik0s/comfy_backup with Docker Model Runner:
docker model run hf.co/saik0s/comfy_backup:Q4_K_S
- Lemonade
How to use saik0s/comfy_backup with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull saik0s/comfy_backup:Q4_K_S
Run and chat with the model
lemonade run user.comfy_backup-Q4_K_S
List all available models
lemonade list
| # A generic, single database configuration. | |
| [alembic] | |
| # path to migration scripts | |
| # Use forward slashes (/) also on windows to provide an os agnostic path | |
| script_location = alembic_db | |
| # template used to generate migration file names; The default value is %%(rev)s_%%(slug)s | |
| # Uncomment the line below if you want the files to be prepended with date and time | |
| # see https://alembic.sqlalchemy.org/en/latest/tutorial.html#editing-the-ini-file | |
| # for all available tokens | |
| # file_template = %%(year)d_%%(month).2d_%%(day).2d_%%(hour).2d%%(minute).2d-%%(rev)s_%%(slug)s | |
| # sys.path path, will be prepended to sys.path if present. | |
| # defaults to the current working directory. | |
| prepend_sys_path = . | |
| # timezone to use when rendering the date within the migration file | |
| # as well as the filename. | |
| # If specified, requires the python>=3.9 or backports.zoneinfo library and tzdata library. | |
| # Any required deps can installed by adding `alembic[tz]` to the pip requirements | |
| # string value is passed to ZoneInfo() | |
| # leave blank for localtime | |
| # timezone = | |
| # max length of characters to apply to the "slug" field | |
| # truncate_slug_length = 40 | |
| # set to 'true' to run the environment during | |
| # the 'revision' command, regardless of autogenerate | |
| # revision_environment = false | |
| # set to 'true' to allow .pyc and .pyo files without | |
| # a source .py file to be detected as revisions in the | |
| # versions/ directory | |
| # sourceless = false | |
| # version location specification; This defaults | |
| # to alembic_db/versions. When using multiple version | |
| # directories, initial revisions must be specified with --version-path. | |
| # The path separator used here should be the separator specified by "version_path_separator" below. | |
| # version_locations = %(here)s/bar:%(here)s/bat:alembic_db/versions | |
| # version path separator; As mentioned above, this is the character used to split | |
| # version_locations. The default within new alembic.ini files is "os", which uses os.pathsep. | |
| # If this key is omitted entirely, it falls back to the legacy behavior of splitting on spaces and/or commas. | |
| # Valid values for version_path_separator are: | |
| # | |
| # version_path_separator = : | |
| # version_path_separator = ; | |
| # version_path_separator = space | |
| # version_path_separator = newline | |
| # | |
| # Use os.pathsep. Default configuration used for new projects. | |
| version_path_separator = os | |
| # set to 'true' to search source files recursively | |
| # in each "version_locations" directory | |
| # new in Alembic version 1.10 | |
| # recursive_version_locations = false | |
| # the output encoding used when revision files | |
| # are written from script.py.mako | |
| # output_encoding = utf-8 | |
| sqlalchemy.url = sqlite:///user/comfyui.db | |
| [post_write_hooks] | |
| # post_write_hooks defines scripts or Python functions that are run | |
| # on newly generated revision scripts. See the documentation for further | |
| # detail and examples | |
| # format using "black" - use the console_scripts runner, against the "black" entrypoint | |
| # hooks = black | |
| # black.type = console_scripts | |
| # black.entrypoint = black | |
| # black.options = -l 79 REVISION_SCRIPT_FILENAME | |
| # lint with attempts to fix using "ruff" - use the exec runner, execute a binary | |
| # hooks = ruff | |
| # ruff.type = exec | |
| # ruff.executable = %(here)s/.venv/bin/ruff | |
| # ruff.options = check --fix REVISION_SCRIPT_FILENAME | |