Instructions to use xumo/reader-speech-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use xumo/reader-speech-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf xumo/reader-speech-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf xumo/reader-speech-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf xumo/reader-speech-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf xumo/reader-speech-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf xumo/reader-speech-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf xumo/reader-speech-models:Q4_K_M
Use Docker
docker model run hf.co/xumo/reader-speech-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use xumo/reader-speech-models with Ollama:
ollama run hf.co/xumo/reader-speech-models:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use xumo/reader-speech-models with Docker Model Runner:
docker model run hf.co/xumo/reader-speech-models:Q4_K_M
- Lemonade
How to use xumo/reader-speech-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull xumo/reader-speech-models:Q4_K_M
Run and chat with the model
lemonade run user.reader-speech-models-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download asr-conversion.lock.json from xumo/reader-speech-models: direct link, hf CLI and curl.
- Browser
- Download file 8.74 kB
-
https://huggingface.co/xumo/reader-speech-models/resolve/main/asr-conversion.lock.json
- Command line
-
hf download hf://xumo/reader-speech-models/asr-conversion.lock.json
-
curl -L -o asr-conversion.lock.json https://huggingface.co/xumo/reader-speech-models/resolve/main/asr-conversion.lock.json
8.74 kB
| { | |
| "schemaVersion": 1, | |
| "python": "3.12.3", | |
| "packages": { | |
| "huggingface_hub": "0.36.2", | |
| "Jinja2": "3.1.6", | |
| "numpy": "2.4.2", | |
| "packaging": "26.0", | |
| "PyYAML": "6.0.3", | |
| "regex": "2026.2.28", | |
| "requests": "2.32.5", | |
| "safetensors": "0.7.0", | |
| "sentencepiece": "0.2.1", | |
| "tokenizers": "0.22.2", | |
| "torch": "2.10.0", | |
| "tqdm": "4.67.3", | |
| "transformers": "4.57.6" | |
| }, | |
| "converterLockSha256": "5340b50a0f3aaa1687296e7b048706ff8cc300004c4252ea0df9933aa1802995", | |
| "quantizerRevision": "67107ac34f62882d8b53ea41ad68010ea635b9be", | |
| "models": [ | |
| { | |
| "repository": "Qwen/Qwen3-ASR-0.6B", | |
| "revision": "5eb144179a02acc5e5ba31e748d22b0cf3e303b0", | |
| "sourceFiles": [ | |
| { | |
| "path": ".gitattributes", | |
| "size": 1519, | |
| "sha256": "11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361" | |
| }, | |
| { | |
| "path": "README.md", | |
| "size": 57456, | |
| "sha256": "5058416891bc47a2051557765997e8c42f8eb78a0e33c3e775bd17d4b0ba4d50" | |
| }, | |
| { | |
| "path": "chat_template.json", | |
| "size": 1161, | |
| "sha256": "75a8cfca24f00de72d796fbfed6858fc9614ef3dabd8696684cc3bc03a9c58ff" | |
| }, | |
| { | |
| "path": "config.json", | |
| "size": 6193, | |
| "sha256": "76d3ae4601ce939830b2517f4a6cadb86cc51316c3900af6b020b051c21a478c" | |
| }, | |
| { | |
| "path": "generation_config.json", | |
| "size": 142, | |
| "sha256": "1da527824d81e07118facff437e03f2e24a23311e3bdeb2368973fe77e5f275c" | |
| }, | |
| { | |
| "path": "merges.txt", | |
| "size": 1671853, | |
| "sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5" | |
| }, | |
| { | |
| "path": "model.safetensors", | |
| "size": 1876091704, | |
| "sha256": "79d6cbd4c98c7bbffe9db2edac07f56cd6637d0d5944b27f6c2b8353840323ea" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "size": 330, | |
| "sha256": "45e120a4eda2c20c5d7f2ea9354e63536bf35e27aa573fb7cdf78017b378770d" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "size": 12487, | |
| "sha256": "4942d005604266809309cabc9f4e9cb89ce855d59b14681fdc0e1cc62ea26c4c" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "size": 2776833, | |
| "sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910" | |
| } | |
| ], | |
| "projector": { | |
| "sha256": "e25dc3f8eca8c21adaceab8e35cf158274728f3e8fe266a60869fbfd54956904", | |
| "acceptedInputSha256": "e25dc3f8eca8c21adaceab8e35cf158274728f3e8fe266a60869fbfd54956904", | |
| "exact": true | |
| } | |
| }, | |
| { | |
| "repository": "Qwen/Qwen3-ASR-1.7B", | |
| "revision": "7278e1e70fe206f11671096ffdd38061171dd6e5", | |
| "sourceFiles": [ | |
| { | |
| "path": ".gitattributes", | |
| "size": 1519, | |
| "sha256": "11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361" | |
| }, | |
| { | |
| "path": "README.md", | |
| "size": 57456, | |
| "sha256": "5058416891bc47a2051557765997e8c42f8eb78a0e33c3e775bd17d4b0ba4d50" | |
| }, | |
| { | |
| "path": "chat_template.json", | |
| "size": 1161, | |
| "sha256": "75a8cfca24f00de72d796fbfed6858fc9614ef3dabd8696684cc3bc03a9c58ff" | |
| }, | |
| { | |
| "path": "config.json", | |
| "size": 6194, | |
| "sha256": "2e74a751548b8ad7d7526d29365ad8144c345d8b412b1152d25dc6698452712f" | |
| }, | |
| { | |
| "path": "generation_config.json", | |
| "size": 142, | |
| "sha256": "1da527824d81e07118facff437e03f2e24a23311e3bdeb2368973fe77e5f275c" | |
| }, | |
| { | |
| "path": "merges.txt", | |
| "size": 1671853, | |
| "sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5" | |
| }, | |
| { | |
| "path": "model-00001-of-00002.safetensors", | |
| "size": 4220320824, | |
| "sha256": "a4cd1f1a04d90b757dc7f7dd26254e69a013b19e80efe590a83c6a3bde8608d6" | |
| }, | |
| { | |
| "path": "model-00002-of-00002.safetensors", | |
| "size": 478200688, | |
| "sha256": "6e0b9d9e09e2e0238e7ef3cc8a484ab387e91b90f1900bedf88bc92d7929ccfc" | |
| }, | |
| { | |
| "path": "model.safetensors.index.json", | |
| "size": 64821, | |
| "sha256": "f994739fe38e5210b9e3e8ce6c6307315e2ceac3cb630e7b7414d69dce520f60" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "size": 330, | |
| "sha256": "45e120a4eda2c20c5d7f2ea9354e63536bf35e27aa573fb7cdf78017b378770d" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "size": 12487, | |
| "sha256": "4942d005604266809309cabc9f4e9cb89ce855d59b14681fdc0e1cc62ea26c4c" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "size": 2776833, | |
| "sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910" | |
| } | |
| ], | |
| "projector": { | |
| "sha256": "6955893dafaecf60cb7cfc871b5c8647d75ebbe83e8d88f1e69940c763e4254b", | |
| "acceptedInputSha256": "6955893dafaecf60cb7cfc871b5c8647d75ebbe83e8d88f1e69940c763e4254b", | |
| "exact": true | |
| } | |
| }, | |
| { | |
| "repository": "Qwen/Qwen3-ForcedAligner-0.6B", | |
| "revision": "c7cbfc2048c462b0d63a45797104fc9db3ad62b7", | |
| "sourceFiles": [ | |
| { | |
| "path": ".gitattributes", | |
| "size": 1519, | |
| "sha256": "11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361" | |
| }, | |
| { | |
| "path": "README.md", | |
| "size": 57456, | |
| "sha256": "5058416891bc47a2051557765997e8c42f8eb78a0e33c3e775bd17d4b0ba4d50" | |
| }, | |
| { | |
| "path": "chat_template.json", | |
| "size": 1161, | |
| "sha256": "75a8cfca24f00de72d796fbfed6858fc9614ef3dabd8696684cc3bc03a9c58ff" | |
| }, | |
| { | |
| "path": "config.json", | |
| "size": 5982, | |
| "sha256": "d616c65d46c4b90bdc651b0a0963ea932732241140f337f9bb6b0335a9c8ef09" | |
| }, | |
| { | |
| "path": "generation_config.json", | |
| "size": 115, | |
| "sha256": "948d089b23bca1d214e768d59c4438365665f52ec6d33678f4062206b3fbbb8c" | |
| }, | |
| { | |
| "path": "merges.txt", | |
| "size": 1671853, | |
| "sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5" | |
| }, | |
| { | |
| "path": "model.safetensors", | |
| "size": 1835544544, | |
| "sha256": "47831d0e82f96b20e9034dba01a075ee06436654719f6a68289e49f1b65ce0e7" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "size": 330, | |
| "sha256": "45e120a4eda2c20c5d7f2ea9354e63536bf35e27aa573fb7cdf78017b378770d" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "size": 12666, | |
| "sha256": "3ab80063f8511deb9566e6ad438d17b7a6277fcffd52d92854112f19d36bd81c" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "size": 2776833, | |
| "sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910" | |
| } | |
| ], | |
| "projector": { | |
| "sha256": "3c4bd01b0293cc9d394cd649e7e9b1210e52684bee5409e237075475975223ee", | |
| "acceptedInputSha256": "3c4bd01b0293cc9d394cd649e7e9b1210e52684bee5409e237075475975223ee", | |
| "exact": true | |
| } | |
| } | |
| ], | |
| "outputs": { | |
| "asr-0.6b-f16": { | |
| "path": "Qwen3-ASR-0.6B/Qwen3-ASR-0.6B-F16.gguf", | |
| "sha256": "59cbfd307c21c15a494daef712c9333c19d8e4259f37db4217fd295d508faeb3" | |
| }, | |
| "asr-1.7b-f16": { | |
| "path": "Qwen3-ASR-1.7B/Qwen3-ASR-1.7B-F16.gguf", | |
| "sha256": "4257be1bee1f24c2b8e6c2ef7c1c9e0345e17ec805d0ea48e00fae26ef58a52c" | |
| }, | |
| "asr-1.7b-q4-k-m": { | |
| "path": "Qwen3-ASR-1.7B/Qwen3-ASR-1.7B-Q4_K_M.gguf", | |
| "sha256": "8225f44c74bee7bb9ee3f1d5abace9054b46354429e257496a2b7fff266f5b7a" | |
| }, | |
| "asr-1.7b-q8-0": { | |
| "path": "Qwen3-ASR-1.7B/Qwen3-ASR-1.7B-Q8_0.gguf", | |
| "sha256": "dd7dd905b8b29d1fe59ba769ef46f8915f8599592859b9463a7251b466b51454" | |
| }, | |
| "aligner-q8-0": { | |
| "path": "Qwen3-ForcedAligner-0.6B/Qwen3-ForcedAligner-0.6B-Q8_0.gguf", | |
| "sha256": "0a9b58e7a61eca2acf902794dbe8973860d42cccca49235530b2f2c5f290ed76" | |
| }, | |
| "mmproj-asr-0.6b-reader-compat": { | |
| "path": "projectors/mmproj-ASR-0.6B-reader-compat.gguf", | |
| "sha256": "fffb83e0ab2731a8c8ca1741726d417a01b274a6cebc9bb53b84e0f899a6a533" | |
| }, | |
| "mmproj-asr-1.7b-reader-compat": { | |
| "path": "projectors/mmproj-ASR-1.7B-reader-compat.gguf", | |
| "sha256": "b0a1c67a7bd6e0231dfddc013f0e7e1e3c9a702b4885f39063981aec503ba7fd" | |
| }, | |
| "mmproj-forcedaligner-reader-compat": { | |
| "path": "projectors/mmproj-ForcedAligner-reader-compat.gguf", | |
| "sha256": "b4f0af1d7daeb9910a9970b90057aa1f038a2319da0452a6da574f4b34106f99" | |
| } | |
| } | |
| } | |