Compactbot
/

compactlm-5m

Text Generation

small-language-model

Model card Files Files and versions

compactlm-5m / README.md

Commit History

Add model card (honest: arch, data, measured val PPL 48.03, 0/15 degenerate)

a7cb36a
verified

Compactbot commited on 11 days ago

Add CompactLM-5M: from-scratch LLaMA-style 6.2M-param English LM on fineweb-edu

da4f145
verified

Compactbot commited on 11 days ago