feat: Zen MoDE architecture (Zen 5 only)
Browse files
README.md
CHANGED
|
@@ -14,11 +14,11 @@ library_name: transformers
|
|
| 14 |
|
| 15 |
# Zen 5 Coder
|
| 16 |
|
| 17 |
-
> **Parameters**: TBA | **Context**: 256K | **Status**: In training — expected 2025-07-01
|
| 18 |
|
| 19 |
Zen 5 Coder — next-gen code specialist. In training. Expected Q3 2025.
|
| 20 |
|
| 21 |
-
Zen
|
| 22 |
|
| 23 |
[Subscribe for updates → zenlm.org](https://zenlm.org)
|
| 24 |
|
|
|
|
| 14 |
|
| 15 |
# Zen 5 Coder
|
| 16 |
|
| 17 |
+
> **Parameters**: TBA | **Architecture**: Zen MoDE | **Context**: 256K | **Status**: In training — expected 2025-07-01
|
| 18 |
|
| 19 |
Zen 5 Coder — next-gen code specialist. In training. Expected Q3 2025.
|
| 20 |
|
| 21 |
+
**Zen MoDE** (Mixture of Distilled Experts) — next-generation sparse routing architecture with 1M+ context, enhanced chain-of-thought, and multi-modal reasoning. First introduced with Zen 5.
|
| 22 |
|
| 23 |
[Subscribe for updates → zenlm.org](https://zenlm.org)
|
| 24 |
|