README.md

---
title: LUNA-300M Program
emoji: 🌙
colorFrom: gray
colorTo: gray
sdk: static
pinned: true
license: other
short_description: LUNA-300M model, training data and program links
---

# LUNA-300M Program

Program hub for **LUNA-300M** — a ~303M-parameter English causal language model pretrained from scratch by **ASTERIZER** on the 4.5B-token [LUNA_PreTrain](https://huggingface.co/datasets/ASTERIZER/LUNA_PreTrain) corpus.

## Assets

- **Model:** [ASTERIZER/LUNA-300M](https://huggingface.co/ASTERIZER/LUNA-300M) (pretrained checkpoints, step 31,052)
- **Sibling:** [ASTERIZER/LUNA-100M](https://huggingface.co/ASTERIZER/LUNA-100M) (trained, RAG+MCP SFT)
- **Corpus:** [ASTERIZER/LUNA_PreTrain](https://huggingface.co/datasets/ASTERIZER/LUNA_PreTrain) (4.5B tokens, 270 litdata chunks)
- **Workspace:** [ASTERIZER/LUNA](https://huggingface.co/spaces/ASTERIZER/LUNA) (training code, `train_300m.py`)
- **Collection:** [LUNA-300M Program](https://huggingface.co/collections/ASTERIZER/luna-300m-program-6a91195ab75671026f83ac94)