Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,7 @@ We're just here to build ***weird*** models, share them with the community, and
|
|
| 29 |
|
| 30 |
- **Syn-2.6M**: A 2.6M-parameter Tiny Language Model (TLM) trained only on synthetic data (tiny-textbooks, tiny-stories-v2, longpage, and finephrase).
|
| 31 |
- **Er-Medium**: A 12.4M-parameter model trained on 34B tokens. It achieves state-of-the-art performance on many benchmarks.
|
| 32 |
-
|
| 33 |
### Future Releases
|
| 34 |
|
| 35 |
- **Orez** - Tiny (1.3M), Small (5M), Medium (12.4M), Large (30M): A family of Small Language Models ranging from 1.2M to 30M parameters. Each of them will be massively overtrained on a minium of 1000+ tokens per parameter.
|
|
|
|
| 29 |
|
| 30 |
- **Syn-2.6M**: A 2.6M-parameter Tiny Language Model (TLM) trained only on synthetic data (tiny-textbooks, tiny-stories-v2, longpage, and finephrase).
|
| 31 |
- **Er-Medium**: A 12.4M-parameter model trained on 34B tokens. It achieves state-of-the-art performance on many benchmarks.
|
| 32 |
+
|
| 33 |
### Future Releases
|
| 34 |
|
| 35 |
- **Orez** - Tiny (1.3M), Small (5M), Medium (12.4M), Large (30M): A family of Small Language Models ranging from 1.2M to 30M parameters. Each of them will be massively overtrained on a minium of 1000+ tokens per parameter.
|