Instructions to use leuconoe/litert-lm-unity-quantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use leuconoe/litert-lm-unity-quantized with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add pointer to whisper-acft-ko (Korean ACFT short-window models)
Browse files
README.md
CHANGED
|
@@ -73,6 +73,16 @@ reference transcripts (punctuation-normalized). Full matrix:
|
|
| 73 |
| `qwen2.5-0.5b-instruct/Qwen2.5-0.5B-Instruct_wi4b64_ekv1280.litertlm` | 265 MB | litert-community/Qwen2.5-0.5B-Instruct f32 | wi4b64 full scope | inference-validated Windows + Android (35.5 tok/s device CPU, +38 % vs official q8) |
|
| 74 |
| `qwen2.5-1.5b-instruct/Qwen2.5-1.5B-Instruct_wi4b64_ekv4096.litertlm` | 790 MB | litert-community/Qwen2.5-1.5B-Instruct f32 | wi4b64 full scope | inference-validated Windows CPU (59.7 prefill / 11.8 decode tok/s, Korean QA correct) |
|
| 75 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
## Known caveats (disclose in model cards)
|
| 77 |
|
| 78 |
- Whisper 30 s graphs; decoder is fixed-length re-run (no KV cache) matching the
|
|
|
|
| 73 |
| `qwen2.5-0.5b-instruct/Qwen2.5-0.5B-Instruct_wi4b64_ekv1280.litertlm` | 265 MB | litert-community/Qwen2.5-0.5B-Instruct f32 | wi4b64 full scope | inference-validated Windows + Android (35.5 tok/s device CPU, +38 % vs official q8) |
|
| 74 |
| `qwen2.5-1.5b-instruct/Qwen2.5-1.5B-Instruct_wi4b64_ekv4096.litertlm` | 790 MB | litert-community/Qwen2.5-1.5B-Instruct f32 | wi4b64 full scope | inference-validated Windows CPU (59.7 prefill / 11.8 decode tok/s, Korean QA correct) |
|
| 75 |
|
| 76 |
+
## Related: Korean ACFT short-window Whisper models
|
| 77 |
+
|
| 78 |
+
Korean audio-context fine-tuned (ACFT-KO) Whisper models — fixed 5 s/10 s/30 s
|
| 79 |
+
short-window TFLite graphs for on-device Korean voice commands (tiny / base /
|
| 80 |
+
medium / large-v3-turbo, dynamic-range int8) — live in a dedicated repo:
|
| 81 |
+
**[leuconoe/whisper-acft-ko](https://huggingface.co/leuconoe/whisper-acft-ko)**.
|
| 82 |
+
Method: [futo-org/whisper-acft](https://github.com/futo-org/whisper-acft);
|
| 83 |
+
training data zeroth-korean (OpenSLR SLR40, CC-BY-4.0) + google/fleurs en_us
|
| 84 |
+
(CC-BY-4.0).
|
| 85 |
+
|
| 86 |
## Known caveats (disclose in model cards)
|
| 87 |
|
| 88 |
- Whisper 30 s graphs; decoder is fixed-length re-run (no KV cache) matching the
|