Nano LLMs - a codelion Collection

codelion 's Collections

Dhara Foundational Models

Sutra Pedagogical Datasets

Pre-training Dataset Samples

Pivotal Token Search

Internal Coherence Maximization

Nano LLMs

updated 1 day ago

Really small LLMs pre-trained on data efficient 1 B tokens