Spaces:
Runtime error
Runtime error
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ sdk: docker
|
|
| 7 |
pinned: false
|
| 8 |
license: mit
|
| 9 |
app_port: 7860
|
| 10 |
-
short_description:
|
| 11 |
---
|
| 12 |
|
| 13 |
# Ghudsavar ππ»
|
|
@@ -16,7 +16,9 @@ Github [iAkashPaul/Ghudsavar](https://github.com/iakashpaul/Ghudsavar)
|
|
| 16 |
|
| 17 |
> Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes, made available as a docker image. One click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).
|
| 18 |
|
| 19 |
-
Try it here [Ghudsavar](https://iakashpaul-ghudsavar.hf.space) default HF Space Embed messes up the themeing.
|
|
|
|
|
|
|
| 20 |
|
| 21 |
## Customize yours
|
| 22 |
|
|
|
|
| 7 |
pinned: false
|
| 8 |
license: mit
|
| 9 |
app_port: 7860
|
| 10 |
+
short_description: Phi-3-Mini on llama.cpp's server example
|
| 11 |
---
|
| 12 |
|
| 13 |
# Ghudsavar ππ»
|
|
|
|
| 16 |
|
| 17 |
> Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes, made available as a docker image. One click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).
|
| 18 |
|
| 19 |
+
Try it here [Ghudsavar](https://iakashpaul-ghudsavar.hf.space) (default HF Space Embed messes up the themeing).
|
| 20 |
+
|
| 21 |
+
```Phi3-mini``` @Q4 runs at ~5tok/s
|
| 22 |
|
| 23 |
## Customize yours
|
| 24 |
|