| --- |
| tags: |
| - gguf-connector |
| widget: |
| - text: a raccoon in a hat |
| output: |
| url: https://raw.githubusercontent.com/calcuis/gguf-pack/master/w8f.png |
| - text: a dog walking in a cyber city with joy |
| output: |
| url: https://raw.githubusercontent.com/calcuis/gguf-pack/master/w8e.png |
| - text: a cat in a hat |
| output: |
| url: https://raw.githubusercontent.com/calcuis/gguf-pack/master/w8g.png |
| --- |
| ## self-hosted api |
| - run it with `gguf-connector`; activate the backend in console/terminal by |
| ``` |
| ggc w8 |
| ``` |
| - choose your model file |
| > |
| >GGUF available. Select which one to use: |
| > |
| >1. sd3.5-2b-lite-iq4_nl.gguf [[1.74GB](https://huggingface.co/calcuis/sd3.5-lite-gguf/blob/main/sd3.5-2b-lite-iq4_nl.gguf)] |
| >2. sd3.5-2b-lite-mxfp4_moe.gguf [[2.86GB](https://huggingface.co/calcuis/sd3.5-lite-gguf/blob/main/sd3.5-2b-lite-mxfp4_moe.gguf)] |
| > |
| >Enter your choice (1 to 2): _ |
| > |
|  |
|
|
| - able to adjust step and guidance level |
|
|
|  |
|
|
| ## decentralized frontend |
| - option 1: navigate to https://test.gguf.org |
|  |
| - option 2: localhost; open a new console/terminal then execute |
| ``` |
| ggc b |
| ``` |
|  |
|
|
| <Gallery /> |
