zeekay commited on
Commit
7824651
·
verified ·
1 Parent(s): 24da5bb

feat: Zen MoDE architecture (Zen 5 only)

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -14,11 +14,11 @@ library_name: transformers
14
 
15
  # Zen 5 Coder
16
 
17
- > **Parameters**: TBA | **Context**: 256K | **Status**: In training — expected 2025-07-01
18
 
19
  Zen 5 Coder — next-gen code specialist. In training. Expected Q3 2025.
20
 
21
- Zen 5 builds on Zen MoDE with improved sparse routing, 1M+ context, and enhanced reasoning through extended chain-of-thought training.
22
 
23
  [Subscribe for updates → zenlm.org](https://zenlm.org)
24
 
 
14
 
15
  # Zen 5 Coder
16
 
17
+ > **Parameters**: TBA | **Architecture**: Zen MoDE | **Context**: 256K | **Status**: In training — expected 2025-07-01
18
 
19
  Zen 5 Coder — next-gen code specialist. In training. Expected Q3 2025.
20
 
21
+ **Zen MoDE** (Mixture of Distilled Experts) next-generation sparse routing architecture with 1M+ context, enhanced chain-of-thought, and multi-modal reasoning. First introduced with Zen 5.
22
 
23
  [Subscribe for updates → zenlm.org](https://zenlm.org)
24