| --- |
| license: other |
| license_name: per-file |
| license_link: https://huggingface.co/j2ipper/draft-vocab/blob/main/README.md#licenses |
| library_name: gguf |
| tags: |
| - speculative-decoding |
| - draft-vocabulary |
| - talus |
| --- |
| |
| # 64K draft vocabularies for Talus |
|
|
| Four draft-vocabulary files for speculative decoding with [Talus](https://github.com/nsbradley88/talus-public) (and |
| llama.cpp's `--spec-draft-vocab`). Each file is a set of 65,536 token ids of one model's tokenizer. A drafter with a |
| draft vocabulary computes its output layer for these ids only, which makes each draft step cheaper. The target model |
| still verifies every draft against its full vocabulary, so the output does not change: a draft vocabulary only |
| affects how many drafts are accepted. |
|
|
| | File | Tokenizer of | Used by Talus for | SHA-256 | |
| |---|---|---|---| |
| | `qwen-dv-65536.bin` | Qwen3.8-27B | the MTP and DFlash2 drafters | `a1a7c29a4262fa8658c91f2855c99d2feef443dd01f04a56aca6d8b484167457` | |
| | `glm-dv-65536.bin` | GLM-5.3-Flash | the NextN drafter | `55d63bbd101508ba4a4ec6ded0736c151dd538b52345420bd33260e45699c4df` | |
| | `mimo-dv-65536.bin` | MiMo-V2.6-Flash-MOPD | the DFlash drafter | `9eead88fb62cc1a95be16abcd33b90e61840f188df850be6f777731a018d34a3` | |
| | `laguna-dv-65536.bin` | Laguna-S-2.1 | (not used by Talus's prompt-lookup drafting; for DFlash drafters in other engines) | `cd718f7de9b92ed101f8b4c6bd3754e59ca2d5a59705fd6fc0b0b82e2498bceb` | |
|
|
| Every file is listed in `SHA256SUMS`. |
|
|
| ## Format |
|
|
| Little-endian int32 token ids, sorted ascending, 65,536 of them (256 KiB per file): llama.cpp's draft-vocabulary |
| format. Every special (non-normal) token of the tokenizer is always included. |
|
|
| ## Use it with Talus |
|
|
| Pass the file of the model you serve; the flags are Talus's shipped defaults, from |
| [docs/MODELS.md](https://github.com/nsbradley88/talus-public/blob/main/docs/MODELS.md): |
|
|
| ``` |
| # Qwen3.8-27B: ... --spec-draft-vocab /models/qwen-dv-65536.bin |
| # GLM-5.3-Flash: ... --draft-vocab /models/glm-dv-65536.bin |
| # MiMo-V2.6-Flash: ... --spec-draft-vocab /models/mimo-dv-65536.bin |
| ``` |
|
|
| ## How they were made |
|
|
| `recipe/make_vocab.py` reads the tokenizer from the model's GGUF and ranks the normal tokens by weighted frequency |
| over four tokenized corpora: model-written agentic text (weight 0.4), documentation and prose (0.25), source code |
| (0.2) and Python (0.15). It keeps the special tokens plus the top-ranked tokens up to 65,536 ids. The corpora were |
| split 80 / 20 to check coverage on held-out text. |
|
|
| The corpora are private and are not published. The files hold only a sorted set of token ids; they contain no text |
| and no frequencies. |
|
|
| ## Licenses |
|
|
| Each file is derived from a model's tokenizer and is released under that model's license: |
|
|
| - `qwen-dv-65536.bin`: Apache-2.0 ([Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B)). |
| - `glm-dv-65536.bin`: MIT ([zai-org/GLM-5.3-Flash](https://huggingface.co/zai-org/GLM-5.3-Flash), Copyright (c) |
| 2026 Z.AI Co., Ltd). |
| - `mimo-dv-65536.bin`: MIT ([XiaomiMiMo/MiMo-V2.6-Flash-MOPD](https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-MOPD), |
| Copyright (c) 2026 Xiaomi Corporation; the license is the MIT declaration on the model card). |
| - `laguna-dv-65536.bin`: OpenMDW-1.1 ([poolside/Laguna-S-2.1](https://huggingface.co/poolside/Laguna-S-2.1)); a copy |
| of the agreement is in `LICENSE-OpenMDW-1.1.md`. |
| - `recipe/make_vocab.py`: MIT, like Talus. |
|
|
| The license texts are in `licenses/`. |
|
|
