calcuis commited on
Commit
79196eb
·
verified ·
1 Parent(s): 1cc3990

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -1
README.md CHANGED
@@ -113,4 +113,28 @@ ggc e8
113
  ```
114
  ggc a
115
  ```
116
- ![screenshot](https://raw.githubusercontent.com/calcuis/gguf-pack/master/e8d.png)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
113
  ```
114
  ggc a
115
  ```
116
+ ![screenshot](https://raw.githubusercontent.com/calcuis/gguf-pack/master/e8d.png)
117
+
118
+ ## self-hosted api (plus)
119
+ - run it with `gguf-connector`; activate the backend in console/terminal by
120
+ ```
121
+ ggc e9
122
+ ```
123
+ - choose your model file
124
+ >
125
+ >Safetensors available. Select which one to use:
126
+ >
127
+ >1. sketch-s9-20b-fp4.safetensors (act as transformer; for blackwell card [11.9GB](https://huggingface.co/calcuis/sketch/blob/main/sketch-s9-20b-fp4.safetensors))
128
+ >2. sketch-s9-20b-int4.safetensors (act as transformer; for non-blackwell card [11.5GB](https://huggingface.co/calcuis/sketch/blob/main/sketch-s9-20b-int4.safetensors))
129
+ >
130
+ >Enter your choice (1 to 2): _
131
+ >
132
+
133
+ ## decentralized frontend - opt `Edit` from pulldown menu (stage 1: exclusive for 🐷 holder trial recently)
134
+ - option 1: navigate to https://gguf.org
135
+
136
+ ![screenshot](https://raw.githubusercontent.com/calcuis/gguf-pack/master/e9a.png)
137
+
138
+ - option 2: localhost; keep the backend running and open a new terminal session then execute `ggc a`
139
+
140
+ ![screenshot](https://raw.githubusercontent.com/calcuis/gguf-pack/master/e9b.png)