Instructions to use msrcam/Comfyui_Backup with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use msrcam/Comfyui_Backup with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="msrcam/Comfyui_Backup",
	filename="Qwen2.5-VL-7B-Instruct-abliterated/Qwen2.5-VL-7B-Instruct-abliterated-F16Out-Q4_K_M.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use msrcam/Comfyui_Backup with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf msrcam/Comfyui_Backup:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf msrcam/Comfyui_Backup:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf msrcam/Comfyui_Backup:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf msrcam/Comfyui_Backup:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf msrcam/Comfyui_Backup:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf msrcam/Comfyui_Backup:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf msrcam/Comfyui_Backup:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf msrcam/Comfyui_Backup:Q4_K_M

Use Docker

docker model run hf.co/msrcam/Comfyui_Backup:Q4_K_M

LM Studio
Jan
Ollama
How to use msrcam/Comfyui_Backup with Ollama:
```
ollama run hf.co/msrcam/Comfyui_Backup:Q4_K_M
```

Unsloth Studio new

How to use msrcam/Comfyui_Backup with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for msrcam/Comfyui_Backup to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for msrcam/Comfyui_Backup to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for msrcam/Comfyui_Backup to start chatting

Pi new

How to use msrcam/Comfyui_Backup with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf msrcam/Comfyui_Backup:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "msrcam/Comfyui_Backup:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use msrcam/Comfyui_Backup with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf msrcam/Comfyui_Backup:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default msrcam/Comfyui_Backup:Q4_K_M

Run Hermes

hermes

Docker Model Runner
How to use msrcam/Comfyui_Backup with Docker Model Runner:
```
docker model run hf.co/msrcam/Comfyui_Backup:Q4_K_M
```

Lemonade

How to use msrcam/Comfyui_Backup with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull msrcam/Comfyui_Backup:Q4_K_M

Run and chat with the model

lemonade run user.Comfyui_Backup-Q4_K_M

List all available models

lemonade list

msrcam commited on Jan 10

Commit

a449f8d

verified ·

1 Parent(s): b6753a3

Upload 29 files

Browse files

Files changed (29) hide show

wan2.2_loras/wan22-cumshot-54epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-f4c3cr34m-100epoc-i2v-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-f4c3spl4sh-100epoc-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-f4c3spl4sh-154epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-fullnelson-i2v-108epoc-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-fullnelson-i2v-368epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-g4bri3l4-14epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-gu4d4lup3-23epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-h4il3y-24epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-irin4-14epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-is4b3ll4-15epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-j1m3n4-14epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-jellyhips-28epoc-low-512-k3nk.safetensors +3 -0
wan2.2_loras/wan22-jellyhips-9epoc-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-jellyhips-i2v-13epoc-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-jellyhips-i2v-23epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-jud1th-16epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-k3lly-66epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-l4ur3n-14epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-l4ur4-16epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-luci4n4-40epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-luis4-36epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-m3i-70epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-m4crom4sti4-10epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-m4crom4sti4-12epoc-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-m4crom4sti4-i2v-20epoc-high-k3nk.safetensors +3 -0
wan2.2_loras/wan22-m4ri4-36epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-m4rtin4-13epoc-low-k3nk.safetensors +3 -0
wan2.2_loras/wan22-mik43l4-40epoc-low-k3nk.safetensors +3 -0

wan2.2_loras/wan22-cumshot-54epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b0623f46971d37cc83e5ae4078635b98f5a29a1d674e56ec78ae853e9b67562
+size 306807976

wan2.2_loras/wan22-f4c3cr34m-100epoc-i2v-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:21813aa37f4def66161227523b9822e7e2497af4074a04f1902eef6e45c37d98
+size 150806528

wan2.2_loras/wan22-f4c3spl4sh-100epoc-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a68ee10bb0f3162bf947a892591dfc65a111d7e85c3f73ff6db24887b79a0b05
+size 319116504

wan2.2_loras/wan22-f4c3spl4sh-154epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:683d6a84430b7f1c7aa1d24a7b74981fe4bdb233a06006f0f0f613e61ccd483e
+size 306807976

wan2.2_loras/wan22-fullnelson-i2v-108epoc-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b77ff82f6326b386e9a970e89b908b14984c287c1ad7a35a14c832ceb1ee454d
+size 306807976

wan2.2_loras/wan22-fullnelson-i2v-368epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:23f784ca116471974030510a305b1f3fd2e048243c0efdaa4694b232792ed393
+size 306807976

wan2.2_loras/wan22-g4bri3l4-14epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:da450c0684dde73b940c3dc6026cfe9a5b669878bc486bb4b202c4c0cc5da973
+size 306807976

wan2.2_loras/wan22-gu4d4lup3-23epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c51efcb7914fb741a1fb01d6b50f2772e2dfd8d520d3bfdbea181d0e8475b0b1
+size 306807976

wan2.2_loras/wan22-h4il3y-24epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6955f975bab5a62d9c259e231606d9b909319ac9fb95f7cc91a33a3229504aba
+size 306807976

wan2.2_loras/wan22-irin4-14epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1f8a0d556f961c6f5c38747957f7b0301beee29cf7ac7ecc80d9ca826a33d1c2
+size 306807976

wan2.2_loras/wan22-is4b3ll4-15epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ddcbf9a7442f3ad68012b40c35ded1dd1566a962a4ce442745e06c134b07825b
+size 306807976

wan2.2_loras/wan22-j1m3n4-14epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:58b2d87e91e19c3200dd67c50e03742afbafa1c835e10435fae93afa2a55931e
+size 306807976

wan2.2_loras/wan22-jellyhips-28epoc-low-512-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7330f451d4306f0b90d215b941d0eae5a2d3468ea8c955def4c8c6b469676f1e
+size 306807976

wan2.2_loras/wan22-jellyhips-9epoc-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4296a77de87f9c4d3c85b0ab2ed11aee6bc2cdb620d9eb3c597e708e7ec9175c
+size 306807976

wan2.2_loras/wan22-jellyhips-i2v-13epoc-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:862c99c360b21a0f9df11daedf92ed27f61283da8535bf77c58eddc0207fb9c7
+size 306807976

wan2.2_loras/wan22-jellyhips-i2v-23epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:adda1d03c94c4606b2a0fa22006aeb92fa01acf054f55acb85ce3db621159a32
+size 306807976

wan2.2_loras/wan22-jud1th-16epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4586af6f62703cce810784b211969bc97c71fd9ccab7c54454fe5623e963d9bb
+size 306807976

wan2.2_loras/wan22-k3lly-66epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dc6c591a71c8044c9342ef9c5da1d88b5b34ae507ead6c967524516935e4c623
+size 306807976

wan2.2_loras/wan22-l4ur3n-14epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3391dc61edf1df5bc6b4ec88cf439a6167d1a5905e7ce923b1cd638ebeef06bd
+size 306807976

wan2.2_loras/wan22-l4ur4-16epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aed6525b1cce9095ff20138e3e51124b74d8d94c1255ee12b548d19a710faa92
+size 306807976

wan2.2_loras/wan22-luci4n4-40epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:305ce72085c23d964cb93eb4ff92a69fd669ae8e2a1713644690a09f388aee06
+size 306807976

wan2.2_loras/wan22-luis4-36epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:16af838c7300a42ca19468ea2007e182b73480bd10ad5adfaccb6c8d77097f12
+size 306807976

wan2.2_loras/wan22-m3i-70epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8a5874b8a7625c3a41a9bacae3e84bdf3bc6bf3e171366d953d2539068aa1c6
+size 306807976

wan2.2_loras/wan22-m4crom4sti4-10epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa5c6b550839fffe43aa216d13a2e9ad7e362bf10733532c598bd1e5daeb9a3a
+size 306807976

wan2.2_loras/wan22-m4crom4sti4-12epoc-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ee63d26eab46795dd99e9b0792e21151fd6223c986c8c75dc9cf2779aa871de
+size 153453160

wan2.2_loras/wan22-m4crom4sti4-i2v-20epoc-high-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:851c928737235b4a4a2c5993c893c79ee46a3131aa9b16eb56de1dcc576c3ad9
+size 306807976

wan2.2_loras/wan22-m4ri4-36epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a2c49fbb8049f6b447d22bfdedd26ba64602ce02553df7265fc0b9bde6597c10
+size 306807976

wan2.2_loras/wan22-m4rtin4-13epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3a7a7629238d5ac8c8d1ee75a364035fdf5c8a5f0e6a9f7fa85ec170208a5f90
+size 306807976

wan2.2_loras/wan22-mik43l4-40epoc-low-k3nk.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:47436c131080dbb71a4bcc39f2d7543a01e2fac7e94b7aa00086a39c393445ed
+size 306807976