HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 38.9k • 470
LLM Training from Scratch
Resources, datasets and base models for training small LLMs on consumer hardware. Focus on pre-training pipelines and data curation.
Resources, datasets and base models for training small LLMs on consumer hardware. Focus on pre-training pipelines and data curation.
