Update README.md
Browse files
README.md
CHANGED
|
@@ -113,4 +113,28 @@ ggc e8
|
|
| 113 |
```
|
| 114 |
ggc a
|
| 115 |
```
|
| 116 |
-

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 113 |
```
|
| 114 |
ggc a
|
| 115 |
```
|
| 116 |
+

|
| 117 |
+
|
| 118 |
+
## self-hosted api (plus)
|
| 119 |
+
- run it with `gguf-connector`; activate the backend in console/terminal by
|
| 120 |
+
```
|
| 121 |
+
ggc e9
|
| 122 |
+
```
|
| 123 |
+
- choose your model file
|
| 124 |
+
>
|
| 125 |
+
>Safetensors available. Select which one to use:
|
| 126 |
+
>
|
| 127 |
+
>1. sketch-s9-20b-fp4.safetensors (act as transformer; for blackwell card [11.9GB](https://huggingface.co/calcuis/sketch/blob/main/sketch-s9-20b-fp4.safetensors))
|
| 128 |
+
>2. sketch-s9-20b-int4.safetensors (act as transformer; for non-blackwell card [11.5GB](https://huggingface.co/calcuis/sketch/blob/main/sketch-s9-20b-int4.safetensors))
|
| 129 |
+
>
|
| 130 |
+
>Enter your choice (1 to 2): _
|
| 131 |
+
>
|
| 132 |
+
|
| 133 |
+
## decentralized frontend - opt `Edit` from pulldown menu (stage 1: exclusive for 🐷 holder trial recently)
|
| 134 |
+
- option 1: navigate to https://gguf.org
|
| 135 |
+
|
| 136 |
+

|
| 137 |
+
|
| 138 |
+
- option 2: localhost; keep the backend running and open a new terminal session then execute `ggc a`
|
| 139 |
+
|
| 140 |
+

|