Spaces:
Configuration error
Configuration error
Update README.md
Browse files
README.md
CHANGED
|
@@ -23,30 +23,6 @@ Two model families:
|
|
| 23 |
- **LittleLearner** β pretrained on the Kβ5-filtered corpus.
|
| 24 |
- **Unfiltered** β pretrained on the same corpus without the Kβ5 filter (baseline general corpus).
|
| 25 |
|
| 26 |
-
---
|
| 27 |
-
|
| 28 |
-
## Released checkpoints
|
| 29 |
-
|
| 30 |
-
### Base β pretraining only, no chat template
|
| 31 |
-
|
| 32 |
-
| Size | LittleLearner (K-5-filtered) | Unfiltered |
|
| 33 |
-
|---|---|---|
|
| 34 |
-
| 0.6 B | `littlelearner/<...>-0.6b-bounded` | `littlelearner/<...>-0.6b-unbounded` |
|
| 35 |
-
| 1.3 B | `littlelearner/<...>-1.3b-bounded` | `littlelearner/<...>-1.3b-unbounded` |
|
| 36 |
-
| 5 B | `littlelearner/<...>-5b-bounded` | `littlelearner/<...>-5b-unbounded` |
|
| 37 |
-
|
| 38 |
-
*Use these in **completion** mode β do not apply a chat template.*
|
| 39 |
-
|
| 40 |
-
### Post-trained β SFT + GRPO, chat template **required**
|
| 41 |
-
|
| 42 |
-
Encoded as **(pretrain β post-training)**:
|
| 43 |
-
|
| 44 |
-
| Pretrain β Post-training | Description | Repo |
|
| 45 |
-
|---|---|---|
|
| 46 |
-
| LittleLearner β K-5 | Matched-pipeline LL post-training | `littlelearner/littlelearner-5b-bounded-sft-chatty` |
|
| 47 |
-
| Unfiltered β Unfiltered | Matched-pipeline Unfiltered post-training | `littlelearner/littlelearner-5b-unbounded-sft-chatty` |
|
| 48 |
-
|
| 49 |
-
|
| 50 |
---
|
| 51 |
|
| 52 |
## Important inference notes
|
|
|
|
| 23 |
- **LittleLearner** β pretrained on the Kβ5-filtered corpus.
|
| 24 |
- **Unfiltered** β pretrained on the same corpus without the Kβ5 filter (baseline general corpus).
|
| 25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
---
|
| 27 |
|
| 28 |
## Important inference notes
|