| --- |
| license: apache-2.0 |
| tags: |
| - test-fixture |
| --- |
| |
| # Speculative-decoding subfolder test fixture |
|
|
| A **tiny, randomly-initialised** Llama pair for exercising *subfolder* loading of |
| a speculative draft model. It exists so inference engines can test the code path |
| in CI without downloading a real checkpoint. |
|
|
| **These weights are random. The model produces gibberish. That is the point.** |
|
|
| ``` |
| . <- target model, 2 layers, ~4M params |
| └── DFlash/ <- draft model, 1 layer, ~4M params |
| ``` |
|
|
| Both share the same tokenizer and vocabulary, so the draft is a valid speculator |
| for the target. |
|
|
| ## Why a subfolder needs engine support |
|
|
| A Hugging Face repo id may contain **at most one `/`**, so `org/repo/DFlash` is |
| not a valid id and cannot be passed as a single string. A draft bundled inside |
| its target's repository therefore has to be addressed as a repo id *plus* a |
| separate sub-path, which most engines have no parameter for. |
|
|
| This matters in practice: shipping a draft inside its target repo keeps the pair |
| versioned together and downloadable in one fetch, rather than as two repos that |
| can drift apart. |
|
|
| ## Usage |
|
|
| ```python |
| from huggingface_hub import snapshot_download |
| snapshot_download("poolside/spec-decoding-subfolder-fixture") # target + draft |
| snapshot_download("poolside/spec-decoding-subfolder-fixture", |
| allow_patterns=["DFlash/*"]) # draft only |
| ``` |
|
|
| Engines adding support should accept the draft as |
| `(model="poolside/spec-decoding-subfolder-fixture", subfolder="DFlash")`. |
|
|
| ## Provenance |
|
|
| Built with `transformers` from `LlamaConfig` (hidden 64, intermediate 128, |
| 4 heads, tied embeddings), `torch.manual_seed(0)`. Tokenizer copied from |
| `hf-internal-testing/llama-tokenizer`. No trained parameters, no proprietary |
| data. |
|
|
