# Chichu 1.5 Pro

**Chichu 1.5 Pro** is a ~16M parameter language model built from scratch.
Named after a cat named Chichu, created by Sebastian.

## Model Details
- **Architecture**: Custom GPT-2 style Transformer
- **Parameters**: ~16M
- **Embedding dim**: 256
- **Layers**: 4
- **Heads**: 4
- **FFN dim**: 1024
- **Max sequence length**: 384
- **Vocab size**: 50,259 (GPT-2 + 2 special tokens: <|im_start|>, <|im_end|>)

## Training
Trained on the r0b0tlab/qwen3.8-max-glm5.2-kimi-k3-distillation dataset
(890K high-quality SFT examples distilled from Qwen3.8-max, GLM-5.2, and Kimi-K3).

## Chat Format
ChatML with: `<|im_start|>user
...<|im_end|>` / `<|im_start|>assistant
...<|im_end|>`

## License
MIT