metadata
tags:
- chat-model-competition
- bittensor
- llama
- from-scratch
license: apache-2.0
test-llama-tiny
Chat model trained with the Chat Model Competition Bittensor subnet.
Architecture: LlamaForCausalLM (vLLM compatible)
Pipeline: Pretrain (100 steps) → SFT (50 steps) → RL/GRPO (20 steps)
| Property | Value |
|---|---|
| Parameters | 13.3M |
| Architecture | 2L / 4H / 2KV / 128D |
| Intermediate | 384 |
| Seq Length | 128 |