Instructions to use calcuis/gguf-node with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use calcuis/gguf-node with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("calcuis/gguf-node", dtype=torch.bfloat16, device_map="cuda") prompt = "anime style anime girl with massive fennec ears and one big fluffy tail, she has blonde long hair blue eyes wearing a maid outfit with a long black gold leaf pattern dress, walking slowly to the front with sweetie smile, holding a fancy black forest cake with candles on top in the kitchen of an old dark Victorian mansion lit by candlelight with a bright window to the foggy forest" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -42,7 +42,7 @@ locate **gguf** from Add Node > extension dropdown menu (between 3d and api; sec
|
|
| 42 |
- drag vae decoder(s) to vae folder (`./ComfyUI/models/vae`)
|
| 43 |
|
| 44 |
## **run it straight (no installation needed way; recommended)**
|
| 45 |
-
- get the comfy pack with the new gguf-node ([
|
| 46 |
- run the .bat file in the main directory
|
| 47 |
|
| 48 |
## **or, for existing user (alternative method)**
|
|
@@ -82,4 +82,4 @@ locate **gguf** from Add Node > extension dropdown menu (between 3d and api; sec
|
|
| 82 |
- llama.cpp from [ggerganov](https://github.com/ggerganov/llama.cpp)
|
| 83 |
- llama-cpp-python from [abetlen](https://github.com/abetlen/llama-cpp-python)
|
| 84 |
- gguf-connector [ggc](https://pypi.org/project/gguf-connector)
|
| 85 |
-
- gguf-node [
|
|
|
|
| 42 |
- drag vae decoder(s) to vae folder (`./ComfyUI/models/vae`)
|
| 43 |
|
| 44 |
## **run it straight (no installation needed way; recommended)**
|
| 45 |
+
- get the comfy pack with the new gguf-node ([pack](https://github.com/calcuis/gguf/releases))
|
| 46 |
- run the .bat file in the main directory
|
| 47 |
|
| 48 |
## **or, for existing user (alternative method)**
|
|
|
|
| 82 |
- llama.cpp from [ggerganov](https://github.com/ggerganov/llama.cpp)
|
| 83 |
- llama-cpp-python from [abetlen](https://github.com/abetlen/llama-cpp-python)
|
| 84 |
- gguf-connector [ggc](https://pypi.org/project/gguf-connector)
|
| 85 |
+
- gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases))
|