Update README.md
Browse files
README.md
CHANGED
|
@@ -8,10 +8,9 @@ tags:
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# littlelearner-5b-chatty
|
| 11 |
-
|
| 12 |
5B K-5-bounded chat model with general chat, model identity, and format steerability installed by a behavior SFT on the blend base (chatty v2).
|
| 13 |
|
| 14 |
-
Part of the **LittleLearner** scale-up study (*pedagogically-controlled knowledge exposure*): Qwen3 dense LMs trained on a corpus filtered to U.S. K-5 material (**bounded**) vs an unfiltered FineWeb-Edu corpus (**unbounded**), to measure what an interpretable knowledge boundary costs and grants.
|
| 15 |
|
| 16 |
## Model
|
| 17 |
- **Architecture:** Qwen3 dense (`Qwen3ForCausalLM`).
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# littlelearner-5b-chatty
|
|
|
|
| 11 |
5B K-5-bounded chat model with general chat, model identity, and format steerability installed by a behavior SFT on the blend base (chatty v2).
|
| 12 |
|
| 13 |
+
Part of the **LittleLearner** scale-up study (*pedagogically-controlled knowledge exposure*): Qwen3 dense LMs trained on a corpus filtered to U.S. K-5 material (**bounded**) vs an unfiltered FineWeb-Edu corpus (**unbounded**), to measure what an interpretable knowledge boundary costs and grants (arxiv.org/abs/2608.13545).
|
| 14 |
|
| 15 |
## Model
|
| 16 |
- **Architecture:** Qwen3 dense (`Qwen3ForCausalLM`).
|