File size: 1,277 Bytes
bfe9b54
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0c573c1
 
bfe9b54
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
license: other
license_name: lfm1.0
license_link: LICENSE
base_model: LiquidAI/d1-2B
tags:
- testing
---

# tiny-d1-2B-for-testing

> [!WARNING]
> This is a **modified, damaged copy** of [LiquidAI/d1-2B](https://huggingface.co/LiquidAI/d1-2B), made only to test software. Its output is gibberish. Do not use it for anything else.

It keeps the architecture, tokenizer, chat template and calibration of d1-2B, so it runs the same code paths as the real model in llama.cpp (`lfm3-d1` decision type: non-causal attention, packed questions, image input), but it is small enough for CI.

GGUF version: [ggml-org-dev/tiny-d1-2B-for-testing-GGUF](https://huggingface.co/ggml-org-dev/tiny-d1-2B-for-testing-GGUF)

## Changes from the original model

Sliced from the safetensors with [slice_d1.py](slice_d1.py), which follows the `slice-model` skill of llama.cpp:

- Text model: 4 of 24 layers (0, 2, 3, 4), hidden size 2048 -> 64, heads 16 -> 2, KV heads 4 -> 1, FFN 7680 -> 256 (head_dim 128 kept)
- Vision encoder: 2 of 14 layers (0, 2), hidden size 1024 -> 128, heads 16 -> 2, KV heads 8 -> 1, FFN 2560 -> 256, projector 4096 -> 256
- The Python code of the original repo is not included

## License

Derived from d1-2B by Liquid AI, under the [LFM Open License v1.0](LICENSE).