Instructions to use kcvmk/sona-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use kcvmk/sona-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf kcvmk/sona-models:Q8_0 # Run inference directly in the terminal: llama cli -hf kcvmk/sona-models:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf kcvmk/sona-models:Q8_0 # Run inference directly in the terminal: llama cli -hf kcvmk/sona-models:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf kcvmk/sona-models:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf kcvmk/sona-models:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf kcvmk/sona-models:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf kcvmk/sona-models:Q8_0
Use Docker
docker model run hf.co/kcvmk/sona-models:Q8_0
- LM Studio
- Jan
- Ollama
How to use kcvmk/sona-models with Ollama:
ollama run hf.co/kcvmk/sona-models:Q8_0
- Unsloth Desktop
- Docker Model Runner
How to use kcvmk/sona-models with Docker Model Runner:
docker model run hf.co/kcvmk/sona-models:Q8_0
- Lemonade
How to use kcvmk/sona-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull kcvmk/sona-models:Q8_0
Run and chat with the model
lemonade run user.sona-models-Q8_0
List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub
Browse files
tts/espeak-ng-data.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4135ccf82e1f40613491c0874d4945ae9e9c7840933d8e25a6f9e003d9ebf533
|
| 3 |
+
size 7252012
|
tts/kitten-nano-en-v0_1-fp16.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eee6fbec2231ddf8ecce8c9cf0a03fd37e19cef08a19118090a73b21c2a9bf56
|
| 3 |
+
size 26888500
|
tts/kokoro-en-v0_19.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:912804855a04745fa77a30be545b3f9a5d15c4d66db00b88cbcd4921df605ac7
|
| 3 |
+
size 319625534
|
tts/kokoro-multi-lang-v1_1.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a3f4c73d043860e3fd2e5b06f36795eb81de0fc8e8de6df703245edddd87dbad
|
| 3 |
+
size 364816464
|
tts/matcha-icefall-en_US-ljspeech.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:52c0dcc2af6508eca7def4428d73408848f76cb4dc67ab9300211de66a49dc3e
|
| 3 |
+
size 76723676
|
tts/vits-piper-en_US-amy-low.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c70f5284a09a7fd4ed203b39b2ff51cac1432b422b852eb647b481dade3cf639
|
| 3 |
+
size 67095344
|
tts/vits-piper-en_US-lessac-medium.tar.bz2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e3febfacf0abf4270172d2958bcec246032b7e88efc2720840cc80c93de334e
|
| 3 |
+
size 67230653
|