Instructions to use addyo07/vox-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use addyo07/vox-models with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="addyo07/vox-models", filename="llm/gemma4/Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use addyo07/vox-models with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: llama-cli -hf addyo07/vox-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: llama-cli -hf addyo07/vox-models:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf addyo07/vox-models:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf addyo07/vox-models:Q4_K_M
Use Docker
docker model run hf.co/addyo07/vox-models:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use addyo07/vox-models with Ollama:
ollama run hf.co/addyo07/vox-models:Q4_K_M
- Unsloth Studio new
How to use addyo07/vox-models with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for addyo07/vox-models to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for addyo07/vox-models to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for addyo07/vox-models to start chatting
- Pi new
How to use addyo07/vox-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf addyo07/vox-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "addyo07/vox-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use addyo07/vox-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf addyo07/vox-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default addyo07/vox-models:Q4_K_M
Run Hermes
hermes
- Docker Model Runner
How to use addyo07/vox-models with Docker Model Runner:
docker model run hf.co/addyo07/vox-models:Q4_K_M
- Lemonade
How to use addyo07/vox-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull addyo07/vox-models:Q4_K_M
Run and chat with the model
lemonade run user.vox-models-Q4_K_M
List all available models
lemonade list
addy-hypr4 commited on
Commit ·
445a73d
1
Parent(s): d3dc482
added required key to files , to make files optional
Browse files- manifest.json +38 -19
manifest.json
CHANGED
|
@@ -6,117 +6,136 @@
|
|
| 6 |
"id": "ten_vad",
|
| 7 |
"path": "vad/ten_vad.onnx",
|
| 8 |
"size": 332211,
|
| 9 |
-
"sha256": "718cb7eef47e3cf5ddbe7e967a7503f46b8b469c0706872f494dfa921b486206"
|
|
|
|
| 10 |
},
|
| 11 |
{
|
| 12 |
"id": "stt_conv_frontend",
|
| 13 |
"path": "stt/qwen3-asr/conv_frontend.onnx",
|
| 14 |
"size": 44148281,
|
| 15 |
-
"sha256": "d22dc4423e0940e49884e903d2ea2f7e5567c14fc1aed97e4e26d6b8f208ef9e"
|
|
|
|
| 16 |
},
|
| 17 |
{
|
| 18 |
"id": "stt_encoder",
|
| 19 |
"path": "stt/qwen3-asr/encoder.int8.onnx",
|
| 20 |
"size": 182491662,
|
| 21 |
-
"sha256": "60748d3e6744a57c9c91e1b17424a6c2990567e8adceb0783940c03ed98fa9d9"
|
|
|
|
| 22 |
},
|
| 23 |
{
|
| 24 |
"id": "stt_decoder",
|
| 25 |
"path": "stt/qwen3-asr/decoder.int8.onnx",
|
| 26 |
"size": 755914231,
|
| 27 |
-
"sha256": "4f6885be5959ae26af3089d38ee7972c5fafbeeb1cf8d5e76eab6d8b61ca5771"
|
|
|
|
| 28 |
},
|
| 29 |
{
|
| 30 |
"id": "stt_vocab",
|
| 31 |
"path": "stt/qwen3-asr/tokenizer/vocab.json",
|
| 32 |
"size": 2776833,
|
| 33 |
-
"sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910"
|
|
|
|
| 34 |
},
|
| 35 |
{
|
| 36 |
"id": "stt_merges",
|
| 37 |
"path": "stt/qwen3-asr/tokenizer/merges.txt",
|
| 38 |
"size": 1671853,
|
| 39 |
-
"sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5"
|
|
|
|
| 40 |
},
|
| 41 |
{
|
| 42 |
"id": "stt_config",
|
| 43 |
"path": "stt/qwen3-asr/tokenizer/tokenizer_config.json",
|
| 44 |
"size": 12487,
|
| 45 |
-
"sha256": "4942d005604266809309cabc9f4e9cb89ce855d59b14681fdc0e1cc62ea26c4c"
|
|
|
|
| 46 |
},
|
| 47 |
{
|
| 48 |
"id": "llm_gemma_4_q4_k_m",
|
| 49 |
"path": "llm/gemma4/google_gemma-4-E2B-it-Q4_K_M.gguf",
|
| 50 |
"size": 3462678272,
|
| 51 |
-
"sha256": "b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705"
|
|
|
|
| 52 |
},
|
| 53 |
{
|
| 54 |
"id": "tts_kokoro_onnx",
|
| 55 |
"path": "tts/kokoro/model.onnx",
|
| 56 |
"size": 345555491,
|
| 57 |
-
"sha256": "10ff414106a038ce7e9e0126c6461e4dc8a86efaa89dc91d2009d69fe635e339"
|
|
|
|
| 58 |
},
|
| 59 |
{
|
| 60 |
"id": "tts_kokoro_voices",
|
| 61 |
"path": "tts/kokoro/voices.bin",
|
| 62 |
"size": 5755904,
|
| 63 |
-
"sha256": "a372c67b056ef0b695c375d39b99630d23fb07ad4c8d87aa32a19a62fca523ad"
|
|
|
|
| 64 |
},
|
| 65 |
{
|
| 66 |
"id": "tts_kokoro_tokens",
|
| 67 |
"path": "tts/kokoro/tokens.txt",
|
| 68 |
"size": 1078,
|
| 69 |
-
"sha256": "4f31c71282d14af4e926cd12462078fe9d20d00c589e63fe2750a8f56d6d7f7b"
|
|
|
|
| 70 |
},
|
| 71 |
{
|
| 72 |
"id": "tts_kokoro_espeak_ng_data",
|
| 73 |
"path": "tts/kokoro/espeak-ng-data.tar.gz",
|
| 74 |
"size": 8990857,
|
| 75 |
"sha256": "7ddfb7247e98108baeab2a3f9c79c29247e58ae7d60d837b32e28999f555bf8d",
|
| 76 |
-
"archive": "tar.gz"
|
|
|
|
| 77 |
},
|
| 78 |
{
|
| 79 |
"id": "tts_hi_pratham_onnx",
|
| 80 |
"path": "tts/piper_hi/hi_IN-pratham-medium.onnx",
|
| 81 |
"size": 63516050,
|
| 82 |
-
"sha256": "169964b0871667f6793416d4b35e97357a68ba1ad01df8580c28048989ee7693"
|
|
|
|
| 83 |
},
|
| 84 |
{
|
| 85 |
"id": "tts_hi_pratham_config",
|
| 86 |
"path": "tts/piper_hi/hi_IN-pratham-medium.onnx.json",
|
| 87 |
"size": 4970,
|
| 88 |
-
"sha256": "b68edd2cd7950dd436314013b7cd12e9699e5a3f6fe5af5af94294cf6aa7b9fd"
|
|
|
|
| 89 |
},
|
| 90 |
{
|
| 91 |
"id": "tts_hi_priyamvada_onnx",
|
| 92 |
"path": "tts/piper_hi/hi_IN-priyamvada-medium.onnx",
|
| 93 |
"size": 63145178,
|
| 94 |
-
"sha256": "8871f3e07adb6ca490f8dbcd3956a8647c53c35b5d0a1c2a8d097b3bf721a31b"
|
|
|
|
| 95 |
},
|
| 96 |
{
|
| 97 |
"id": "tts_hi_priyamvada_config",
|
| 98 |
"path": "tts/piper_hi/hi_IN-priyamvada-medium.onnx.json",
|
| 99 |
"size": 4973,
|
| 100 |
-
"sha256": "5efc0ccf7529f3528996d46e0fac1f969f681d44a8e55bfa6236ff8841b5d52d"
|
|
|
|
| 101 |
},
|
| 102 |
{
|
| 103 |
"id": "tts_hi_rohan_onnx",
|
| 104 |
"path": "tts/piper_hi/hi_IN-rohan-medium.onnx",
|
| 105 |
"size": 62950044,
|
| 106 |
-
"sha256": "b65dc80fb34d9dcd1cf684cb297966a34983bbc93bb1696fe207f32b0b33a091"
|
|
|
|
| 107 |
},
|
| 108 |
{
|
| 109 |
"id": "tts_hi_rohan_config",
|
| 110 |
"path": "tts/piper_hi/hi_IN-rohan-medium.onnx.json",
|
| 111 |
"size": 5041,
|
| 112 |
-
"sha256": "07b9ae19bd0bac7fbbc99f7ee69c91245eb5470e926632c31fc0c50ba653c817"
|
|
|
|
| 113 |
},
|
| 114 |
{
|
| 115 |
"id": "tts_piper_hi_espeak_ng_data",
|
| 116 |
"path": "tts/piper_hi/espeak-ng-data.tar.gz",
|
| 117 |
"size": 8990869,
|
| 118 |
"sha256": "5d26294483bff947820b8ebf55fde437622c7c542eb104649e29626ab1763524",
|
| 119 |
-
"archive": "tar.gz"
|
|
|
|
| 120 |
}
|
| 121 |
]
|
| 122 |
}
|
|
|
|
| 6 |
"id": "ten_vad",
|
| 7 |
"path": "vad/ten_vad.onnx",
|
| 8 |
"size": 332211,
|
| 9 |
+
"sha256": "718cb7eef47e3cf5ddbe7e967a7503f46b8b469c0706872f494dfa921b486206",
|
| 10 |
+
"required": true
|
| 11 |
},
|
| 12 |
{
|
| 13 |
"id": "stt_conv_frontend",
|
| 14 |
"path": "stt/qwen3-asr/conv_frontend.onnx",
|
| 15 |
"size": 44148281,
|
| 16 |
+
"sha256": "d22dc4423e0940e49884e903d2ea2f7e5567c14fc1aed97e4e26d6b8f208ef9e",
|
| 17 |
+
"required": true
|
| 18 |
},
|
| 19 |
{
|
| 20 |
"id": "stt_encoder",
|
| 21 |
"path": "stt/qwen3-asr/encoder.int8.onnx",
|
| 22 |
"size": 182491662,
|
| 23 |
+
"sha256": "60748d3e6744a57c9c91e1b17424a6c2990567e8adceb0783940c03ed98fa9d9",
|
| 24 |
+
"required": true
|
| 25 |
},
|
| 26 |
{
|
| 27 |
"id": "stt_decoder",
|
| 28 |
"path": "stt/qwen3-asr/decoder.int8.onnx",
|
| 29 |
"size": 755914231,
|
| 30 |
+
"sha256": "4f6885be5959ae26af3089d38ee7972c5fafbeeb1cf8d5e76eab6d8b61ca5771",
|
| 31 |
+
"required": true
|
| 32 |
},
|
| 33 |
{
|
| 34 |
"id": "stt_vocab",
|
| 35 |
"path": "stt/qwen3-asr/tokenizer/vocab.json",
|
| 36 |
"size": 2776833,
|
| 37 |
+
"sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910",
|
| 38 |
+
"required": true
|
| 39 |
},
|
| 40 |
{
|
| 41 |
"id": "stt_merges",
|
| 42 |
"path": "stt/qwen3-asr/tokenizer/merges.txt",
|
| 43 |
"size": 1671853,
|
| 44 |
+
"sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5",
|
| 45 |
+
"required": true
|
| 46 |
},
|
| 47 |
{
|
| 48 |
"id": "stt_config",
|
| 49 |
"path": "stt/qwen3-asr/tokenizer/tokenizer_config.json",
|
| 50 |
"size": 12487,
|
| 51 |
+
"sha256": "4942d005604266809309cabc9f4e9cb89ce855d59b14681fdc0e1cc62ea26c4c",
|
| 52 |
+
"required": true
|
| 53 |
},
|
| 54 |
{
|
| 55 |
"id": "llm_gemma_4_q4_k_m",
|
| 56 |
"path": "llm/gemma4/google_gemma-4-E2B-it-Q4_K_M.gguf",
|
| 57 |
"size": 3462678272,
|
| 58 |
+
"sha256": "b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705",
|
| 59 |
+
"required": false
|
| 60 |
},
|
| 61 |
{
|
| 62 |
"id": "tts_kokoro_onnx",
|
| 63 |
"path": "tts/kokoro/model.onnx",
|
| 64 |
"size": 345555491,
|
| 65 |
+
"sha256": "10ff414106a038ce7e9e0126c6461e4dc8a86efaa89dc91d2009d69fe635e339",
|
| 66 |
+
"required": false
|
| 67 |
},
|
| 68 |
{
|
| 69 |
"id": "tts_kokoro_voices",
|
| 70 |
"path": "tts/kokoro/voices.bin",
|
| 71 |
"size": 5755904,
|
| 72 |
+
"sha256": "a372c67b056ef0b695c375d39b99630d23fb07ad4c8d87aa32a19a62fca523ad",
|
| 73 |
+
"required": false
|
| 74 |
},
|
| 75 |
{
|
| 76 |
"id": "tts_kokoro_tokens",
|
| 77 |
"path": "tts/kokoro/tokens.txt",
|
| 78 |
"size": 1078,
|
| 79 |
+
"sha256": "4f31c71282d14af4e926cd12462078fe9d20d00c589e63fe2750a8f56d6d7f7b",
|
| 80 |
+
"required": false
|
| 81 |
},
|
| 82 |
{
|
| 83 |
"id": "tts_kokoro_espeak_ng_data",
|
| 84 |
"path": "tts/kokoro/espeak-ng-data.tar.gz",
|
| 85 |
"size": 8990857,
|
| 86 |
"sha256": "7ddfb7247e98108baeab2a3f9c79c29247e58ae7d60d837b32e28999f555bf8d",
|
| 87 |
+
"archive": "tar.gz",
|
| 88 |
+
"required": false
|
| 89 |
},
|
| 90 |
{
|
| 91 |
"id": "tts_hi_pratham_onnx",
|
| 92 |
"path": "tts/piper_hi/hi_IN-pratham-medium.onnx",
|
| 93 |
"size": 63516050,
|
| 94 |
+
"sha256": "169964b0871667f6793416d4b35e97357a68ba1ad01df8580c28048989ee7693",
|
| 95 |
+
"required": false
|
| 96 |
},
|
| 97 |
{
|
| 98 |
"id": "tts_hi_pratham_config",
|
| 99 |
"path": "tts/piper_hi/hi_IN-pratham-medium.onnx.json",
|
| 100 |
"size": 4970,
|
| 101 |
+
"sha256": "b68edd2cd7950dd436314013b7cd12e9699e5a3f6fe5af5af94294cf6aa7b9fd",
|
| 102 |
+
"required": false
|
| 103 |
},
|
| 104 |
{
|
| 105 |
"id": "tts_hi_priyamvada_onnx",
|
| 106 |
"path": "tts/piper_hi/hi_IN-priyamvada-medium.onnx",
|
| 107 |
"size": 63145178,
|
| 108 |
+
"sha256": "8871f3e07adb6ca490f8dbcd3956a8647c53c35b5d0a1c2a8d097b3bf721a31b",
|
| 109 |
+
"required": false
|
| 110 |
},
|
| 111 |
{
|
| 112 |
"id": "tts_hi_priyamvada_config",
|
| 113 |
"path": "tts/piper_hi/hi_IN-priyamvada-medium.onnx.json",
|
| 114 |
"size": 4973,
|
| 115 |
+
"sha256": "5efc0ccf7529f3528996d46e0fac1f969f681d44a8e55bfa6236ff8841b5d52d",
|
| 116 |
+
"required": false
|
| 117 |
},
|
| 118 |
{
|
| 119 |
"id": "tts_hi_rohan_onnx",
|
| 120 |
"path": "tts/piper_hi/hi_IN-rohan-medium.onnx",
|
| 121 |
"size": 62950044,
|
| 122 |
+
"sha256": "b65dc80fb34d9dcd1cf684cb297966a34983bbc93bb1696fe207f32b0b33a091",
|
| 123 |
+
"required": false
|
| 124 |
},
|
| 125 |
{
|
| 126 |
"id": "tts_hi_rohan_config",
|
| 127 |
"path": "tts/piper_hi/hi_IN-rohan-medium.onnx.json",
|
| 128 |
"size": 5041,
|
| 129 |
+
"sha256": "07b9ae19bd0bac7fbbc99f7ee69c91245eb5470e926632c31fc0c50ba653c817",
|
| 130 |
+
"required": false
|
| 131 |
},
|
| 132 |
{
|
| 133 |
"id": "tts_piper_hi_espeak_ng_data",
|
| 134 |
"path": "tts/piper_hi/espeak-ng-data.tar.gz",
|
| 135 |
"size": 8990869,
|
| 136 |
"sha256": "5d26294483bff947820b8ebf55fde437622c7c542eb104649e29626ab1763524",
|
| 137 |
+
"archive": "tar.gz",
|
| 138 |
+
"required": false
|
| 139 |
}
|
| 140 |
]
|
| 141 |
}
|