Instructions to use addyo07/vox-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use addyo07/vox-models with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="addyo07/vox-models", filename="llm/gemma4/Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use addyo07/vox-models with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: llama-cli -hf addyo07/vox-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: llama-cli -hf addyo07/vox-models:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf addyo07/vox-models:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf addyo07/vox-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf addyo07/vox-models:Q4_K_M
Use Docker
docker model run hf.co/addyo07/vox-models:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use addyo07/vox-models with Ollama:
ollama run hf.co/addyo07/vox-models:Q4_K_M
- Unsloth Studio new
How to use addyo07/vox-models with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for addyo07/vox-models to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for addyo07/vox-models to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for addyo07/vox-models to start chatting
- Pi new
How to use addyo07/vox-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf addyo07/vox-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "addyo07/vox-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use addyo07/vox-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf addyo07/vox-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default addyo07/vox-models:Q4_K_M
Run Hermes
hermes
- Docker Model Runner
How to use addyo07/vox-models with Docker Model Runner:
docker model run hf.co/addyo07/vox-models:Q4_K_M
- Lemonade
How to use addyo07/vox-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull addyo07/vox-models:Q4_K_M
Run and chat with the model
lemonade run user.vox-models-Q4_K_M
List all available models
lemonade list
addy-hypr4 commited on
Commit ·
8f99f92
1
Parent(s): 445a73d
added new translit model , new llms added and updated manifest
Browse files- .gitattributes +1 -0
- llm/gemma4/Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf +3 -0
- llm/llama/Llama-3.2-1B-Instruct-Q6_K.gguf +3 -0
- manifest.json +43 -1
- translit/decoder.onnx +3 -0
- translit/encoder.onnx +3 -0
- translit/input_vocab.json +75 -0
- translit/target_vocab.json +33 -0
.gitattributes
CHANGED
|
@@ -46,3 +46,4 @@ stt/qwen3-asr/*.onnx filter=lfs diff=lfs merge=lfs -text
|
|
| 46 |
tts/kokoro/model.onnx filter=lfs diff=lfs merge=lfs -text
|
| 47 |
tts/kokoro/*.bin filter=lfs diff=lfs merge=lfs -text
|
| 48 |
tts/kokoro/*.tar.gz filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 46 |
tts/kokoro/model.onnx filter=lfs diff=lfs merge=lfs -text
|
| 47 |
tts/kokoro/*.bin filter=lfs diff=lfs merge=lfs -text
|
| 48 |
tts/kokoro/*.tar.gz filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
*.gguf filter=lfs diff=lfs merge=lfs -text
|
llm/gemma4/Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c9213a33b16d513482790bb7092243f783a450e35f7deca584a41e0470afdb97
|
| 3 |
+
size 3009448896
|
llm/llama/Llama-3.2-1B-Instruct-Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0f4c510daf16e0d1b3bc94931fd9296c28936bebdda2593687d4eb70c5b70628
|
| 3 |
+
size 1021800576
|
manifest.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
"version": "1.0.0",
|
| 3 |
-
"total_size_bytes":
|
| 4 |
"models": [
|
| 5 |
{
|
| 6 |
"id": "ten_vad",
|
|
@@ -9,6 +9,34 @@
|
|
| 9 |
"sha256": "718cb7eef47e3cf5ddbe7e967a7503f46b8b469c0706872f494dfa921b486206",
|
| 10 |
"required": true
|
| 11 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
{
|
| 13 |
"id": "stt_conv_frontend",
|
| 14 |
"path": "stt/qwen3-asr/conv_frontend.onnx",
|
|
@@ -58,6 +86,20 @@
|
|
| 58 |
"sha256": "b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705",
|
| 59 |
"required": false
|
| 60 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 61 |
{
|
| 62 |
"id": "tts_kokoro_onnx",
|
| 63 |
"path": "tts/kokoro/model.onnx",
|
|
|
|
| 1 |
{
|
| 2 |
"version": "1.0.0",
|
| 3 |
+
"total_size_bytes": 9056399547,
|
| 4 |
"models": [
|
| 5 |
{
|
| 6 |
"id": "ten_vad",
|
|
|
|
| 9 |
"sha256": "718cb7eef47e3cf5ddbe7e967a7503f46b8b469c0706872f494dfa921b486206",
|
| 10 |
"required": true
|
| 11 |
},
|
| 12 |
+
{
|
| 13 |
+
"id": "translit_encoder",
|
| 14 |
+
"path": "translit/encoder.onnx",
|
| 15 |
+
"size": 9511984,
|
| 16 |
+
"sha256": "b439795a8387059c76e471f5d7ef536439cae1958442d7db52f46676b99e7ddc",
|
| 17 |
+
"required": true
|
| 18 |
+
},
|
| 19 |
+
{
|
| 20 |
+
"id": "translit_decoder",
|
| 21 |
+
"path": "translit/decoder.onnx",
|
| 22 |
+
"size": 6690514,
|
| 23 |
+
"sha256": "23b32436e3aaf395c1fe677bdb7d5b52322362941310de51a77ca19140846caa",
|
| 24 |
+
"required": true
|
| 25 |
+
},
|
| 26 |
+
{
|
| 27 |
+
"id": "translit_input_vocab",
|
| 28 |
+
"path": "translit/input_vocab.json",
|
| 29 |
+
"size": 946,
|
| 30 |
+
"sha256": "f530055fe3d5c5fffe590bafa49a18c59cfa36502406a319a92948d56d447c2f",
|
| 31 |
+
"required": true
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"id": "translit_target_vocab",
|
| 35 |
+
"path": "translit/target_vocab.json",
|
| 36 |
+
"size": 346,
|
| 37 |
+
"sha256": "81a34f107f4e7f95fb9d0866e6ab4ad85de6f1e4a58935d611e921889744fa5d",
|
| 38 |
+
"required": true
|
| 39 |
+
},
|
| 40 |
{
|
| 41 |
"id": "stt_conv_frontend",
|
| 42 |
"path": "stt/qwen3-asr/conv_frontend.onnx",
|
|
|
|
| 86 |
"sha256": "b5310340b3a23d31655d7119d100d5df1b2d8ee17b3ca8b0a23ad7e9eb5fa705",
|
| 87 |
"required": false
|
| 88 |
},
|
| 89 |
+
{
|
| 90 |
+
"id": "llm_llama_3_2_1b_instruct_q6_k",
|
| 91 |
+
"path": "llm/llama/Llama-3.2-1B-Instruct-Q6_K.gguf",
|
| 92 |
+
"size": 1021800576,
|
| 93 |
+
"sha256": "0f4c510daf16e0d1b3bc94931fd9296c28936bebdda2593687d4eb70c5b70628",
|
| 94 |
+
"required": false
|
| 95 |
+
},
|
| 96 |
+
{
|
| 97 |
+
"id": "llm_gemma_4_e2b_uncensored_aggressive_q2_k_p",
|
| 98 |
+
"path": "llm/gemma4/Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf",
|
| 99 |
+
"size": 3009448896,
|
| 100 |
+
"sha256": "c9213a33b16d513482790bb7092243f783a450e35f7deca584a41e0470afdb97",
|
| 101 |
+
"required": false
|
| 102 |
+
},
|
| 103 |
{
|
| 104 |
"id": "tts_kokoro_onnx",
|
| 105 |
"path": "tts/kokoro/model.onnx",
|
translit/decoder.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23b32436e3aaf395c1fe677bdb7d5b52322362941310de51a77ca19140846caa
|
| 3 |
+
size 6690514
|
translit/encoder.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b439795a8387059c76e471f5d7ef536439cae1958442d7db52f46676b99e7ddc
|
| 3 |
+
size 9511984
|
translit/input_vocab.json
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"<pad>": 0,
|
| 3 |
+
"<unk>": 1,
|
| 4 |
+
"<s>": 2,
|
| 5 |
+
"</s>": 3,
|
| 6 |
+
"व": 4,
|
| 7 |
+
"क": 5,
|
| 8 |
+
"्": 6,
|
| 9 |
+
"त": 7,
|
| 10 |
+
"ा": 8,
|
| 11 |
+
"ल": 9,
|
| 12 |
+
"च": 10,
|
| 13 |
+
"ो": 11,
|
| 14 |
+
"ं": 12,
|
| 15 |
+
"स": 13,
|
| 16 |
+
"भ": 14,
|
| 17 |
+
"र": 15,
|
| 18 |
+
"द": 16,
|
| 19 |
+
"ि": 17,
|
| 20 |
+
"ु": 18,
|
| 21 |
+
"य": 19,
|
| 22 |
+
"ू": 20,
|
| 23 |
+
"ज": 21,
|
| 24 |
+
"े": 22,
|
| 25 |
+
"ी": 23,
|
| 26 |
+
"ग": 24,
|
| 27 |
+
"न": 25,
|
| 28 |
+
"प": 26,
|
| 29 |
+
"ह": 27,
|
| 30 |
+
"म": 28,
|
| 31 |
+
"ष": 29,
|
| 32 |
+
"ट": 30,
|
| 33 |
+
"श": 31,
|
| 34 |
+
"ण": 32,
|
| 35 |
+
"फ": 33,
|
| 36 |
+
"ऐ": 34,
|
| 37 |
+
"़": 35,
|
| 38 |
+
"ब": 36,
|
| 39 |
+
"इ": 37,
|
| 40 |
+
"ख": 38,
|
| 41 |
+
"आ": 39,
|
| 42 |
+
"ए": 40,
|
| 43 |
+
"ड": 41,
|
| 44 |
+
"थ": 42,
|
| 45 |
+
"ै": 43,
|
| 46 |
+
"घ": 44,
|
| 47 |
+
"ँ": 45,
|
| 48 |
+
"अ": 46,
|
| 49 |
+
"छ": 47,
|
| 50 |
+
"ौ": 48,
|
| 51 |
+
"ॉ": 49,
|
| 52 |
+
"ध": 50,
|
| 53 |
+
"ई": 51,
|
| 54 |
+
"ओ": 52,
|
| 55 |
+
"झ": 53,
|
| 56 |
+
"ठ": 54,
|
| 57 |
+
"उ": 55,
|
| 58 |
+
"ृ": 56,
|
| 59 |
+
"ऊ": 57,
|
| 60 |
+
"ढ": 58,
|
| 61 |
+
"ञ": 59,
|
| 62 |
+
"औ": 60,
|
| 63 |
+
"ः": 61,
|
| 64 |
+
"ळ": 62,
|
| 65 |
+
"ऑ": 63,
|
| 66 |
+
"ङ": 64,
|
| 67 |
+
"ऋ": 65,
|
| 68 |
+
"ॅ": 66,
|
| 69 |
+
"ॠ": 67,
|
| 70 |
+
"ऍ": 68,
|
| 71 |
+
"ॐ": 69,
|
| 72 |
+
"ऽ": 70,
|
| 73 |
+
"॥": 71,
|
| 74 |
+
"ॊ": 72
|
| 75 |
+
}
|
translit/target_vocab.json
ADDED
|
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"<pad>": 0,
|
| 3 |
+
"<unk>": 1,
|
| 4 |
+
"<s>": 2,
|
| 5 |
+
"</s>": 3,
|
| 6 |
+
"v": 4,
|
| 7 |
+
"a": 5,
|
| 8 |
+
"k": 6,
|
| 9 |
+
"t": 7,
|
| 10 |
+
"l": 8,
|
| 11 |
+
"c": 9,
|
| 12 |
+
"h": 10,
|
| 13 |
+
"o": 11,
|
| 14 |
+
"n": 12,
|
| 15 |
+
"s": 13,
|
| 16 |
+
"m": 14,
|
| 17 |
+
"b": 15,
|
| 18 |
+
"r": 16,
|
| 19 |
+
"d": 17,
|
| 20 |
+
"i": 18,
|
| 21 |
+
"u": 19,
|
| 22 |
+
"y": 20,
|
| 23 |
+
"j": 21,
|
| 24 |
+
"e": 22,
|
| 25 |
+
"z": 23,
|
| 26 |
+
"g": 24,
|
| 27 |
+
"p": 25,
|
| 28 |
+
"f": 26,
|
| 29 |
+
"x": 27,
|
| 30 |
+
"w": 28,
|
| 31 |
+
"q": 29,
|
| 32 |
+
" ": 30
|
| 33 |
+
}
|