zeekay commited on
Commit
06fd2c9
·
verified ·
1 Parent(s): e8c5c8b

fix: Zen 2 arch naming, remove abliterated tag

Browse files
Files changed (1) hide show
  1. README.md +8 -10
README.md CHANGED
@@ -8,7 +8,6 @@ tags:
8
  - zenlm
9
  - hanzo-ai
10
  - zen-2
11
-
12
  pipeline_tag: text-generation
13
  library_name: transformers
14
  ---
@@ -16,20 +15,19 @@ library_name: transformers
16
  # Zen 2 7B
17
 
18
  > **Originally released**: 2024-06-01
19
- > **Parameters**: 7B | **Architecture**: Dense transformer (Zen MoDE v2) | **Context**: 128K
20
- > **License**: Apache 2.0
21
 
22
  Second generation of the Zen LM family (Q2 2024). Key breakthrough: **128K context window** via improved positional encoding and sliding window attention.
23
 
24
  ## Research Lineage
25
 
26
- | Generation | Release | Key Advancement |
27
- |------------|---------|-----------------|
28
- | Zen 1 | Q4 2023 | Foundation, Zen MoDE v1, 4K context |
29
- | Zen 2 | Q2 2024 | 128K context window |
30
- | Zen 3 | Q3–Q4 2024 | MoE + multimodal families |
31
- | Zen 4 | Q1 2025 | Abliterated weights, 256K–1M ctx |
32
- | Zen 5 | 2025+ | Next-generation frontier |
33
 
34
 
35
  ---
 
8
  - zenlm
9
  - hanzo-ai
10
  - zen-2
 
11
  pipeline_tag: text-generation
12
  library_name: transformers
13
  ---
 
15
  # Zen 2 7B
16
 
17
  > **Originally released**: 2024-06-01
18
+ > **Parameters**: 7B | **Architecture**: Zen 2 Architecture | **Context**: 128K | **License**: Apache 2.0
 
19
 
20
  Second generation of the Zen LM family (Q2 2024). Key breakthrough: **128K context window** via improved positional encoding and sliding window attention.
21
 
22
  ## Research Lineage
23
 
24
+ | Generation | Release | Architecture | Key Advancement |
25
+ |------------|---------|--------------|-----------------|
26
+ | Zen 1 | Q4 2023 | Zen 1 Architecture | Foundation, dense transformer, 4K context |
27
+ | Zen 2 | Q2 2024 | Zen 2 Architecture | 128K context window |
28
+ | Zen 3 | Q3–Q4 2024 | Zen 3 Architecture | Sparse MoE routing, multimodal |
29
+ | Zen 4 | Q1 2025 | Zen 4 Architecture | 256K–1M context, extended families |
30
+ | Zen 5 | 2025+ | Zen MoDE | Next-generation frontier |
31
 
32
 
33
  ---