zeekay commited on
Commit
0aab147
·
verified ·
1 Parent(s): aaa922a

fix: Zen 1 arch naming, remove abliterated tag

Browse files
Files changed (1) hide show
  1. README.md +9 -11
README.md CHANGED
@@ -8,7 +8,6 @@ tags:
8
  - zenlm
9
  - hanzo-ai
10
  - zen-1
11
-
12
  pipeline_tag: text-generation
13
  library_name: transformers
14
  ---
@@ -16,20 +15,19 @@ library_name: transformers
16
  # Zen 1 7B
17
 
18
  > **Originally released**: 2023-12-01
19
- > **Parameters**: 7B | **Architecture**: Dense transformer (Zen MoDE v1) | **Context**: 4K
20
- > **License**: Apache 2.0
21
 
22
- First generation of the Zen LM family (Q4 2023). Established the Zen MoDE (Mixture of Distilled Experts) training methodology that all subsequent generations build upon.
23
 
24
  ## Research Lineage
25
 
26
- | Generation | Release | Key Advancement |
27
- |------------|---------|-----------------|
28
- | Zen 1 | Q4 2023 | Foundation, Zen MoDE v1, 4K context |
29
- | Zen 2 | Q2 2024 | 128K context window |
30
- | Zen 3 | Q3–Q4 2024 | MoE + multimodal families |
31
- | Zen 4 | Q1 2025 | Abliterated weights, 256K–1M ctx |
32
- | Zen 5 | 2025+ | Next-generation frontier |
33
 
34
 
35
  ---
 
8
  - zenlm
9
  - hanzo-ai
10
  - zen-1
 
11
  pipeline_tag: text-generation
12
  library_name: transformers
13
  ---
 
15
  # Zen 1 7B
16
 
17
  > **Originally released**: 2023-12-01
18
+ > **Parameters**: 7B | **Architecture**: Zen 1 Architecture | **Context**: 4K | **License**: Apache 2.0
 
19
 
20
+ First generation of the Zen LM family (Q4 2023). Dense transformer architecture trained on multilingual data: code, science, mathematics, and general knowledge.
21
 
22
  ## Research Lineage
23
 
24
+ | Generation | Release | Architecture | Key Advancement |
25
+ |------------|---------|--------------|-----------------|
26
+ | Zen 1 | Q4 2023 | Zen 1 Architecture | Foundation, dense transformer, 4K context |
27
+ | Zen 2 | Q2 2024 | Zen 2 Architecture | 128K context window |
28
+ | Zen 3 | Q3–Q4 2024 | Zen 3 Architecture | Sparse MoE routing, multimodal |
29
+ | Zen 4 | Q1 2025 | Zen 4 Architecture | 256K–1M context, extended families |
30
+ | Zen 5 | 2025+ | Zen MoDE | Next-generation frontier |
31
 
32
 
33
  ---