zeekay commited on
Commit
42454a5
·
verified ·
1 Parent(s): 3e872da

fix: Zen 2 arch naming, remove abliterated tag

Browse files
Files changed (1) hide show
  1. README.md +8 -10
README.md CHANGED
@@ -8,7 +8,6 @@ tags:
8
  - zenlm
9
  - hanzo-ai
10
  - zen-2
11
-
12
  pipeline_tag: text-generation
13
  library_name: transformers
14
  ---
@@ -16,8 +15,7 @@ library_name: transformers
16
  # Zen 2 7B — Code Specialist
17
 
18
  > **Originally released**: 2024-07-15
19
- > **Parameters**: 7B | **Architecture**: Dense transformer (Zen MoDE v2) | **Context**: 128K
20
- > **License**: Apache 2.0
21
 
22
  Second generation of the Zen LM family (Q2 2024). Key breakthrough: **128K context window** via improved positional encoding and sliding window attention.
23
 
@@ -25,13 +23,13 @@ Specialized on code generation: Python, JavaScript, TypeScript, Go, Rust, SQL.
25
 
26
  ## Research Lineage
27
 
28
- | Generation | Release | Key Advancement |
29
- |------------|---------|-----------------|
30
- | Zen 1 | Q4 2023 | Foundation, Zen MoDE v1, 4K context |
31
- | Zen 2 | Q2 2024 | 128K context window |
32
- | Zen 3 | Q3–Q4 2024 | MoE + multimodal families |
33
- | Zen 4 | Q1 2025 | Abliterated weights, 256K–1M ctx |
34
- | Zen 5 | 2025+ | Next-generation frontier |
35
 
36
 
37
  ---
 
8
  - zenlm
9
  - hanzo-ai
10
  - zen-2
 
11
  pipeline_tag: text-generation
12
  library_name: transformers
13
  ---
 
15
  # Zen 2 7B — Code Specialist
16
 
17
  > **Originally released**: 2024-07-15
18
+ > **Parameters**: 7B | **Architecture**: Zen 2 Architecture | **Context**: 128K | **License**: Apache 2.0
 
19
 
20
  Second generation of the Zen LM family (Q2 2024). Key breakthrough: **128K context window** via improved positional encoding and sliding window attention.
21
 
 
23
 
24
  ## Research Lineage
25
 
26
+ | Generation | Release | Architecture | Key Advancement |
27
+ |------------|---------|--------------|-----------------|
28
+ | Zen 1 | Q4 2023 | Zen 1 Architecture | Foundation, dense transformer, 4K context |
29
+ | Zen 2 | Q2 2024 | Zen 2 Architecture | 128K context window |
30
+ | Zen 3 | Q3–Q4 2024 | Zen 3 Architecture | Sparse MoE routing, multimodal |
31
+ | Zen 4 | Q1 2025 | Zen 4 Architecture | 256K–1M context, extended families |
32
+ | Zen 5 | 2025+ | Zen MoDE | Next-generation frontier |
33
 
34
 
35
  ---