|
Download README.md from ggml-org-dev/tiny-clef-for-testing: direct link, hf CLI and curl.
- Browser
- Download file 1.61 kB
-
https://huggingface.co/ggml-org-dev/tiny-clef-for-testing/resolve/main/README.md
- Command line
-
hf download hf://ggml-org-dev/tiny-clef-for-testing/README.md
-
curl -L -o README.md https://huggingface.co/ggml-org-dev/tiny-clef-for-testing/resolve/main/README.md
1.61 kB
| license: apache-2.0 | |
| base_model: Cloudflare/clef | |
| tags: | |
| - testing | |
| # tiny-clef-for-testing | |
| > [!WARNING] | |
| > This is a **modified, damaged copy** of [Cloudflare/clef](https://huggingface.co/Cloudflare/clef), made only to test software. Its output is gibberish. Do not use it for anything else. | |
| It keeps the architecture, tokenizer, chat template and joint decision head layout of clef, so it runs the same code paths as the real model in llama.cpp (`clef` decision type: Qwen3.5 trunk with linear and full attention, joint schema head with routing and joint layers, packed questions, image input), but it is small enough for CI. | |
| GGUF version: [ggml-org-dev/tiny-clef-for-testing-GGUF](https://huggingface.co/ggml-org-dev/tiny-clef-for-testing-GGUF) | |
| ## Changes from the original model | |
| Sliced from the safetensors with [slice_clef.py](slice_clef.py), which follows the `slice-model` skill of llama.cpp: | |
| - Text model: 4 of 64 layers (0-3: 3 linear attention + 1 full attention), hidden size 5120 -> 32, FFN 17408 -> 128, heads 24 -> 2, KV heads 4 -> 1, linear attention key heads 16 -> 2, value heads 48 -> 6 (head dims kept) | |
| - Vision encoder: 2 of 27 blocks (0, 1), hidden size 1152 -> 144, heads 16 -> 2, FFN 4304 -> 288, output size 5120 -> 32 | |
| - Joint head (`joint_head.safetensors`, `joint_head_config.json`): all 2 routing and 4 joint layers kept, width 1024 -> 32, heads 16 -> 2, FFN 4096 -> 64, input hidden size 5120 -> 32 | |
| - The Python code of the original repo (`joint_schema_model.py`) is not included | |
| ## License | |
| Derived from clef by Cloudflare, under the [Apache License 2.0](LICENSE). | |