Spaces:
Running
Running
File size: 1,052 Bytes
924b510 108e4aa 924b510 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | ---
title: LUNA-300M Program
emoji: 🌙
colorFrom: gray
colorTo: gray
sdk: static
pinned: true
license: other
short_description: LUNA-300M model, training data and program links
---
# LUNA-300M Program
Program hub for **LUNA-300M** — a ~303M-parameter English causal language model pretrained from scratch by **ASTERIZER** on the 4.5B-token [LUNA_PreTrain](https://huggingface.co/datasets/ASTERIZER/LUNA_PreTrain) corpus.
## Assets
- **Model:** [ASTERIZER/LUNA-300M](https://huggingface.co/ASTERIZER/LUNA-300M) (pretrained checkpoints, step 31,052)
- **Sibling:** [ASTERIZER/LUNA-100M](https://huggingface.co/ASTERIZER/LUNA-100M) (trained, RAG+MCP SFT)
- **Corpus:** [ASTERIZER/LUNA_PreTrain](https://huggingface.co/datasets/ASTERIZER/LUNA_PreTrain) (4.5B tokens, 270 litdata chunks)
- **Workspace:** [ASTERIZER/LUNA](https://huggingface.co/spaces/ASTERIZER/LUNA) (training code, `train_300m.py`)
- **Collection:** [LUNA-300M Program](https://huggingface.co/collections/ASTERIZER/luna-300m-program-6a91195ab75671026f83ac94)
|