YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Chichu 1.5 Pro

Chichu 1.5 Pro is a ~16M parameter language model built from scratch. Named after a cat named Chichu, created by Sebastian.

Model Details

  • Architecture: Custom GPT-2 style Transformer
  • Parameters: ~16M
  • Embedding dim: 256
  • Layers: 4
  • Heads: 4
  • FFN dim: 1024
  • Max sequence length: 384
  • Vocab size: 50,259 (GPT-2 + 2 special tokens: <|im_start|>, <|im_end|>)

Training

Trained on the r0b0tlab/qwen3.8-max-glm5.2-kimi-k3-distillation dataset (890K high-quality SFT examples distilled from Qwen3.8-max, GLM-5.2, and Kimi-K3).

Chat Format

ChatML with: <|im_start|>user ...<|im_end|> / <|im_start|>assistant ...<|im_end|>

License

MIT

Downloads last month
835
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support