Spaces:
Configuration error
Configuration error
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,14 +5,15 @@ Controlled Knowledge Exposure** — a study of how filtering the
|
|
| 5 |
pretraining corpus to K–5 (kindergarten through grade 5) educational content
|
| 6 |
affects a language model's downstream capabilities.
|
| 7 |
|
| 8 |
-
This organisation hosts the paired **LittleLearner** (K–5-filtered) and
|
| 9 |
**Unfiltered** (baseline general corpus) checkpoints at three sizes, plus
|
| 10 |
matched post-trained variants. All checkpoints share the same architecture
|
| 11 |
and tokenizer, so a LittleLearner *X* B and Unfiltered *X* B differ only in
|
| 12 |
what data they saw during pretraining — the controlled comparison the paper
|
| 13 |
is built around.
|
| 14 |
|
| 15 |
-
📄 Paper: **[<
|
|
|
|
| 16 |
|
| 17 |
---
|
| 18 |
|
|
|
|
| 5 |
pretraining corpus to K–5 (kindergarten through grade 5) educational content
|
| 6 |
affects a language model's downstream capabilities.
|
| 7 |
|
| 8 |
+
This organisation hosts **LittleCurriculum**, the K–5-filtered pretraining dataset, as well as the paired **LittleLearner** (K–5-filtered) and
|
| 9 |
**Unfiltered** (baseline general corpus) checkpoints at three sizes, plus
|
| 10 |
matched post-trained variants. All checkpoints share the same architecture
|
| 11 |
and tokenizer, so a LittleLearner *X* B and Unfiltered *X* B differ only in
|
| 12 |
what data they saw during pretraining — the controlled comparison the paper
|
| 13 |
is built around.
|
| 14 |
|
| 15 |
+
📄 Paper: **[<LittleLearner: Language Models Under Pedagogically
|
| 16 |
+
Controlled Knowledge Exposure>](https://arxiv.org/abs/2608.13545)** · ✉️ Contact: **fanfei.li@tuebingen.mpg.de**
|
| 17 |
|
| 18 |
---
|
| 19 |
|