Update README.md
Browse files
README.md
CHANGED
|
@@ -162,6 +162,17 @@ curl [http://127.0.0.1:8088/v1/chat/completions](http://127.0.0.1:8088/v1/chat/c
|
|
| 162 |
|
| 163 |
-----
|
| 164 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 165 |
## Model License
|
| 166 |
|
| 167 |
This model is released under the **ModelGo Zero License 2.0 (MG0-2.0)**.
|
|
|
|
| 162 |
|
| 163 |
-----
|
| 164 |
|
| 165 |
+
## Run Locally with Ollama
|
| 166 |
+
|
| 167 |
+
You can easily run **XtraGPT** locally using [Ollama](https://ollama.com/). We have provided GGUF format models compatible with 4-bit quantization and full precision.
|
| 168 |
+
|
| 169 |
+
```bash
|
| 170 |
+
ollama run hf.co/Xtra-Computing/XtraGPT-GGUF:{X}B-q4
|
| 171 |
+
ollama run hf.co/Xtra-Computing/XtraGPT-GGUF:{X}Bf16
|
| 172 |
+
```
|
| 173 |
+
|
| 174 |
+
-----
|
| 175 |
+
|
| 176 |
## Model License
|
| 177 |
|
| 178 |
This model is released under the **ModelGo Zero License 2.0 (MG0-2.0)**.
|