Instructions to use xumo/reader-speech-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use xumo/reader-speech-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf xumo/reader-speech-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf xumo/reader-speech-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf xumo/reader-speech-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf xumo/reader-speech-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf xumo/reader-speech-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf xumo/reader-speech-models:Q4_K_M
Use Docker
docker model run hf.co/xumo/reader-speech-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use xumo/reader-speech-models with Ollama:
ollama run hf.co/xumo/reader-speech-models:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use xumo/reader-speech-models with Docker Model Runner:
docker model run hf.co/xumo/reader-speech-models:Q4_K_M
- Lemonade
How to use xumo/reader-speech-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull xumo/reader-speech-models:Q4_K_M
Run and chat with the model
lemonade run user.reader-speech-models-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download models.lock.json from xumo/reader-speech-models: direct link, hf CLI and curl.
- Browser
- Download file 10.8 kB
-
https://huggingface.co/xumo/reader-speech-models/resolve/main/models.lock.json
- Command line
-
hf download hf://xumo/reader-speech-models/models.lock.json
-
curl -L -o models.lock.json https://huggingface.co/xumo/reader-speech-models/resolve/main/models.lock.json
10.8 kB
| { | |
| "schemaVersion": 1, | |
| "release": "reader-models-2026-11-07", | |
| "upstreamRevision": "67107ac34f62882d8b53ea41ad68010ea635b9be", | |
| "artifacts": [ | |
| { | |
| "id": "asr-0.6b-f16", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "repository": "Qwen/Qwen3-ASR-0.6B", | |
| "revision": "5eb144179a02acc5e5ba31e748d22b0cf3e303b0", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "Qwen3-ASR-0.6B/Qwen3-ASR-0.6B-F16.gguf", | |
| "size": 1509344064, | |
| "sha256": "59cbfd307c21c15a494daef712c9333c19d8e4259f37db4217fd295d508faeb3", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "asr-1.7b-f16", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "repository": "Qwen/Qwen3-ASR-1.7B", | |
| "revision": "7278e1e70fe206f11671096ffdd38061171dd6e5", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "Qwen3-ASR-1.7B/Qwen3-ASR-1.7B-F16.gguf", | |
| "size": 4069675840, | |
| "sha256": "4257be1bee1f24c2b8e6c2ef7c1c9e0345e17ec805d0ea48e00fae26ef58a52c", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "asr-1.7b-q4-k-m", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "repository": "Qwen/Qwen3-ASR-1.7B", | |
| "revision": "7278e1e70fe206f11671096ffdd38061171dd6e5", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "Qwen3-ASR-1.7B/Qwen3-ASR-1.7B-Q4_K_M.gguf", | |
| "size": 1282435904, | |
| "sha256": "8225f44c74bee7bb9ee3f1d5abace9054b46354429e257496a2b7fff266f5b7a", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "asr-1.7b-q8-0", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "repository": "Qwen/Qwen3-ASR-1.7B", | |
| "revision": "7278e1e70fe206f11671096ffdd38061171dd6e5", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "Qwen3-ASR-1.7B/Qwen3-ASR-1.7B-Q8_0.gguf", | |
| "size": 2165035840, | |
| "sha256": "dd7dd905b8b29d1fe59ba769ef46f8915f8599592859b9463a7251b466b51454", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "aligner-q8-0", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "repository": "Qwen/Qwen3-ForcedAligner-0.6B", | |
| "revision": "c7cbfc2048c462b0d63a45797104fc9db3ad62b7", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "Qwen3-ForcedAligner-0.6B/Qwen3-ForcedAligner-0.6B-Q8_0.gguf", | |
| "size": 639585920, | |
| "sha256": "0a9b58e7a61eca2acf902794dbe8973860d42cccca49235530b2f2c5f290ed76", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "mmproj-asr-0.6b-reader-compat", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "compatibility": "reader-legacy-encoder", | |
| "converter": "scripts/convert-reader-asr-gguf.py", | |
| "repository": "Qwen/Qwen3-ASR-0.6B", | |
| "revision": "5eb144179a02acc5e5ba31e748d22b0cf3e303b0", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "projectors/mmproj-ASR-0.6B-reader-compat.gguf", | |
| "size": 378575776, | |
| "sha256": "fffb83e0ab2731a8c8ca1741726d417a01b274a6cebc9bb53b84e0f899a6a533", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "mmproj-asr-1.7b-reader-compat", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "compatibility": "reader-legacy-encoder", | |
| "converter": "scripts/convert-reader-asr-gguf.py", | |
| "repository": "Qwen/Qwen3-ASR-1.7B", | |
| "revision": "7278e1e70fe206f11671096ffdd38061171dd6e5", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "projectors/mmproj-ASR-1.7B-reader-compat.gguf", | |
| "size": 641774208, | |
| "sha256": "b0a1c67a7bd6e0231dfddc013f0e7e1e3c9a702b4885f39063981aec503ba7fd", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "mmproj-forcedaligner-reader-compat", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "compatibility": "reader-legacy-encoder", | |
| "converter": "scripts/convert-reader-aligner-projector.py", | |
| "repository": "Qwen/Qwen3-ForcedAligner-0.6B", | |
| "revision": "c7cbfc2048c462b0d63a45797104fc9db3ad62b7", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "91a534aad00af8a42d29c02526eb5ccb4257255d4bc7dbd9350cbcf1a5726acd" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "projectors/mmproj-ForcedAligner-reader-compat.gguf", | |
| "size": 649913056, | |
| "sha256": "b4f0af1d7daeb9910a9970b90057aa1f038a2319da0452a6da574f4b34106f99", | |
| "urls": [] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "qwen3-tts-0.6b-base-f16", | |
| "origin": { | |
| "state": "verified-conversion", | |
| "repository": "Qwen/Qwen3-TTS-12Hz-0.6B-Base", | |
| "revision": "5d83992436eae1d760afd27aff78a71d676296fc", | |
| "license": "Apache-2.0", | |
| "recipeSha256": "8a0c8ebd60f23d82f19938a19752983f378d4b4397fc0b0adc8c0379bfa38bcf" | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "qwen-tts/talker-f16.gguf", | |
| "size": 1210844480, | |
| "sha256": "bd53cb41d56329b4eacd95b4d888294e3d1484d31498c2d15a0e505fdfdd2733", | |
| "urls": [ | |
| "https://huggingface.co/xumo/reader-speech-models/resolve/76fee4e9d3b4c99b0710e1453df2a0c5820e5de6/qwen-tts/talker-f16.gguf" | |
| ] | |
| }, | |
| { | |
| "path": "qwen-tts/mmproj-f16.gguf", | |
| "size": 620839104, | |
| "sha256": "04fd9028d206a8e9356b54be6817a41bd1faa36f851745d4710ab6ee733041f5", | |
| "urls": [ | |
| "https://huggingface.co/xumo/reader-speech-models/resolve/76fee4e9d3b4c99b0710e1453df2a0c5820e5de6/qwen-tts/mmproj-f16.gguf" | |
| ] | |
| }, | |
| { | |
| "path": "qwen-tts/reader-model.json", | |
| "size": 2179, | |
| "sha256": "b048d81860d58c9aea644b95bfdb089e5b16e56da983544c5030011c521e45ee", | |
| "urls": [ | |
| "https://huggingface.co/xumo/reader-speech-models/resolve/76fee4e9d3b4c99b0710e1453df2a0c5820e5de6/qwen-tts/reader-model.json" | |
| ], | |
| "content": "{\n \"schemaVersion\": 1,\n \"repository\": \"Qwen/Qwen3-TTS-12Hz-0.6B-Base\",\n \"revision\": \"5d83992436eae1d760afd27aff78a71d676296fc\",\n \"files\": [\n {\n \"path\": \".gitattributes\",\n \"size\": 1519,\n \"sha256\": \"11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361\"\n },\n {\n \"path\": \"README.md\",\n \"size\": 3640,\n \"sha256\": \"181187b6057906bd960bc7f938d0b7a16652509776a0d52c4885b4ae5ccda0ea\"\n },\n {\n \"path\": \"config.json\",\n \"size\": 4494,\n \"sha256\": \"2e714c787c8edb98b05432685cddb634add2de4d4e645f653d68251ef72ba011\"\n },\n {\n \"path\": \"generation_config.json\",\n \"size\": 245,\n \"sha256\": \"f1b90b4513f3b34c62851049e2492d7b4c5940daf1276f89c82b8ef04127f3aa\"\n },\n {\n \"path\": \"merges.txt\",\n \"size\": 1671839,\n \"sha256\": \"599bab54075088774b1733fde865d5bd747cbcc7a547c5bc12610e874e26f5e3\"\n },\n {\n \"path\": \"model.safetensors\",\n \"size\": 1829344272,\n \"sha256\": \"180b3b10eb1c9f1b4db7806d5475bae3071c0243c299d49926bab1da3b6946f6\"\n },\n {\n \"path\": \"preprocessor_config.json\",\n \"size\": 127,\n \"sha256\": \"efdde1022ea9d76928bf7a9cd53139138f5ba2e466e837f08f6105ab1af1c119\"\n },\n {\n \"path\": \"speech_tokenizer/config.json\",\n \"size\": 2336,\n \"sha256\": \"ee65bb901c876664ab8707c487157aa1a6ee57c65969b28fb5ec9dc211e68167\"\n },\n {\n \"path\": \"speech_tokenizer/configuration.json\",\n \"size\": 76,\n \"sha256\": \"6bc26d64eb5024b4d1dab5a52371958b429256d6c9d59787f1f5294a54e0cebd\"\n },\n {\n \"path\": \"speech_tokenizer/model.safetensors\",\n \"size\": 682293092,\n \"sha256\": \"836b7b357f5ea43e889936a3709af68dfe3751881acefe4ecf0dbd30ba571258\"\n },\n {\n \"path\": \"speech_tokenizer/preprocessor_config.json\",\n \"size\": 234,\n \"sha256\": \"fcb3805e597e786d4067706e602f6688524640f8d3396790e2e09b5942fcbdfb\"\n },\n {\n \"path\": \"tokenizer_config.json\",\n \"size\": 7344,\n \"sha256\": \"dc3c31c3bdaedd5016382bb3cbe07323026775ad51f5a4fb564505992ae4a670\"\n },\n {\n \"path\": \"vocab.json\",\n \"size\": 2776833,\n \"sha256\": \"ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910\"\n }\n ]\n}\n" | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "synthetic-heart", | |
| "origin": { | |
| "state": "synthetic-reference", | |
| "kind": "synthetic", | |
| "model": "onnx-community/Kokoro-82M-v1.0-ONNX", | |
| "revision": "1939ad2a8e416c0acfeecc08a694d14ef25f2231", | |
| "voice": "af_heart", | |
| "userRecording": false | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "voices/heart.wav", | |
| "size": 266444, | |
| "sha256": "c69f19c5b9e2e46d3e0adc4d3851a169c2ddfe0e389e8e439059da0a19d3e02e", | |
| "urls": [ | |
| "https://huggingface.co/xumo/reader-speech-models/resolve/76fee4e9d3b4c99b0710e1453df2a0c5820e5de6/voices/heart.wav" | |
| ] | |
| } | |
| ] | |
| }, | |
| { | |
| "id": "synthetic-george", | |
| "origin": { | |
| "state": "synthetic-reference", | |
| "kind": "synthetic", | |
| "model": "onnx-community/Kokoro-82M-v1.0-ONNX", | |
| "revision": "1939ad2a8e416c0acfeecc08a694d14ef25f2231", | |
| "voice": "bm_george", | |
| "userRecording": false | |
| }, | |
| "publishable": true, | |
| "files": [ | |
| { | |
| "path": "voices/george.wav", | |
| "size": 356444, | |
| "sha256": "f0da705809cc48f21883bf5ef028cd848c543a3689db64a7a723e34b511507f0", | |
| "urls": [ | |
| "https://huggingface.co/xumo/reader-speech-models/resolve/76fee4e9d3b4c99b0710e1453df2a0c5820e5de6/voices/george.wav" | |
| ] | |
| } | |
| ] | |
| } | |
| ] | |
| } | |