README.md

metadata

tags:
  - gguf-connector
widget:
  - text: a cat in a hat
    output:
      url: https://raw.githubusercontent.com/calcuis/gguf-pack/master/w8g.png
  - text: a raccoon in a hat
    output:
      url: https://raw.githubusercontent.com/calcuis/gguf-pack/master/w8f.png
  - text: a dog walking in a cyber city with joy
    output:
      url: https://raw.githubusercontent.com/calcuis/gguf-pack/master/w8e.png

self-hosted api

• run it with gguf-connector; activate the backend in console/terminal by

ggc w8

• choose your model file

  GGUF available. Select which one to use:

  1. sd3.5-2b-lite-iq4_nl.gguf [1.74GB]
  2. sd3.5-2b-lite-mxfp4_moe.gguf [2.86GB]

  Enter your choice (1 to 2): _

• able to adjust step and scale

• flexible frontend choice (see below)

decentralized frontend

• option 1: navigate to https://test.gguf.org

• option 2: localhost; keep the backend running and open a new terminal session then execute

ggc b

Prompt

a cat in a hat

Prompt

a raccoon in a hat

Prompt

a raccoon in a hat

Prompt

a dog walking in a cyber city with joy

Prompt

a dog walking in a cyber city with joy

Prompt

a dog walking in a cyber city with joy