Instructions to use aaronpham/speakilo-cpu-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use aaronpham/speakilo-cpu-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf aaronpham/speakilo-cpu-models:Q4_0 # Run inference directly in the terminal: llama cli -hf aaronpham/speakilo-cpu-models:Q4_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf aaronpham/speakilo-cpu-models:Q4_0 # Run inference directly in the terminal: llama cli -hf aaronpham/speakilo-cpu-models:Q4_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf aaronpham/speakilo-cpu-models:Q4_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf aaronpham/speakilo-cpu-models:Q4_0
Use Docker
docker model run hf.co/aaronpham/speakilo-cpu-models:Q4_0
- Llama new
- LM Studio
- Jan
- Ollama
How to use aaronpham/speakilo-cpu-models with Ollama:
ollama run hf.co/aaronpham/speakilo-cpu-models:Q4_0
- Unsloth Desktop
- Docker Model Runner
How to use aaronpham/speakilo-cpu-models with Docker Model Runner:
docker model run hf.co/aaronpham/speakilo-cpu-models:Q4_0
- Lemonade
How to use aaronpham/speakilo-cpu-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull aaronpham/speakilo-cpu-models:Q4_0
Run and chat with the model
lemonade run user.speakilo-cpu-models-Q4_0
List all available models
lemonade list
- Atomic Chat
|
Download README.md from aaronpham/speakilo-cpu-models: direct link, hf CLI and curl.
- Browser
- Download file 2.39 kB
-
https://huggingface.co/aaronpham/speakilo-cpu-models/resolve/main/README.md
- Command line
-
hf download hf://aaronpham/speakilo-cpu-models/README.md
-
curl -L -o README.md https://huggingface.co/aaronpham/speakilo-cpu-models/resolve/main/README.md
2.39 kB
| library_name: onnxruntime | |
| tags: | |
| - speech | |
| - cpu | |
| - vad | |
| - language-identification | |
| - text-to-speech | |
| # Speakilo CPU speech assets | |
| Private deployment bundle for Speakilo's CPU VAD, LID, and TTS stages. | |
| This repository mirrors third-party artifacts; it does not claim authorship | |
| or grant rights beyond each upstream project's terms. | |
| ## Layout | |
| - `vad/silero/`: Silero VAD v6 ONNX asset used by the installed runtime. | |
| - `lid/voxlingua107-ecapa/`: SpeechBrain VoxLingua107 ECAPA checkpoint and configuration. | |
| - `tts/`: five Speakilo CPU voice bundles and their required frontend/runtime files. | |
| - `checksums.json`: SHA-256, byte size, source path, and upstream metadata. | |
| ## Upstream sources and terms | |
| - Silero VAD: `snakers4/silero-vad` (MIT upstream project). | |
| - VoxLingua107 ECAPA: `speechbrain/lang-id-voxlingua107-ecapa` | |
| at `0253049ae131d6a4be1c4f0d8b0ff483a0f8c8e9` (Apache-2.0 metadata). | |
| - Ppaso Korean: `akamotaco/ppaso-tts-v1` | |
| at `53d09664c4f636a5fb6f2ebe3ec22cd83ee249b9` (Apache-2.0; bundled notices apply). | |
| - Piper voices: `rhasspy/piper-voices`; preserve each included model card. | |
| Dataset terms differ: VI 25-hours is marked unknown, Lessac has research-use | |
| lineage, and VAIS1000 is CC-BY-4.0 but fine-tuned from Lessac. | |
| - AISHELL3 bundle: from the sherpa-onnx TTS release. The downloaded bundle has | |
| no verified model/data license. Keep this repository private unless rights | |
| are independently established. | |
| ## Runtime | |
| The Piper/AISHELL models use sherpa-onnx VITS on CPU. Ppaso uses its ONNX CPU | |
| adapter. VoxLingua LID uses SpeechBrain/PyTorch CPU. Silero runs as ONNX. | |
| The files are mirrored byte-for-byte from the local Speakilo installation. | |
| See `checksums.json` before deployment. | |
| ## ASR and MT additions | |
| - `asr/gipformer/`: Vietnamese GIPFormer 1.5 68M RNN-T INT8, | |
| `g-group-ai-lab/gipformer1.5-68M-rnnt@dd9227dcd8705c13f33bdbe59728d546ab94480f` | |
| (MIT metadata). | |
| - `asr/sensevoice-sherpa-int8/`: SenseVoiceSmall sherpa-onnx INT8, | |
| `csukuangfj/sherpa-onnx-sense-voice-zh-en-ja-ko-yue-2024-07-17@2365baeacb507f821a0c8120fcee3d484dba7a07`. | |
| Upstream Hugging Face metadata does not declare a license; keep private. | |
| - `mt/hy-mt2/Hy-MT2-1.8B-Q4_0-imat-q8emb-allq40.gguf`: user-supplied | |
| GGUF derived from `tencent/Hy-MT2-1.8B@9a341cd1b679d3efd23b46e847b01745a71ed792` | |
| (Apache-2.0 base-model metadata), intended for the llama.cpp Hexagon/HTP runtime. | |