fix: Zen 2 arch naming, remove abliterated tag
Browse files
README.md
CHANGED
|
@@ -8,7 +8,6 @@ tags:
|
|
| 8 |
- zenlm
|
| 9 |
- hanzo-ai
|
| 10 |
- zen-2
|
| 11 |
-
|
| 12 |
pipeline_tag: text-generation
|
| 13 |
library_name: transformers
|
| 14 |
---
|
|
@@ -16,8 +15,7 @@ library_name: transformers
|
|
| 16 |
# Zen 2 7B — Code Specialist
|
| 17 |
|
| 18 |
> **Originally released**: 2024-07-15
|
| 19 |
-
> **Parameters**: 7B | **Architecture**:
|
| 20 |
-
> **License**: Apache 2.0
|
| 21 |
|
| 22 |
Second generation of the Zen LM family (Q2 2024). Key breakthrough: **128K context window** via improved positional encoding and sliding window attention.
|
| 23 |
|
|
@@ -25,13 +23,13 @@ Specialized on code generation: Python, JavaScript, TypeScript, Go, Rust, SQL.
|
|
| 25 |
|
| 26 |
## Research Lineage
|
| 27 |
|
| 28 |
-
| Generation | Release | Key Advancement |
|
| 29 |
-
|------------|---------|-----------------|
|
| 30 |
-
| Zen 1 | Q4 2023 | Foundation,
|
| 31 |
-
| Zen 2 | Q2 2024 | 128K context window |
|
| 32 |
-
| Zen 3 | Q3–Q4 2024 | MoE
|
| 33 |
-
| Zen 4 | Q1 2025 |
|
| 34 |
-
| Zen 5 | 2025+ | Next-generation frontier |
|
| 35 |
|
| 36 |
|
| 37 |
---
|
|
|
|
| 8 |
- zenlm
|
| 9 |
- hanzo-ai
|
| 10 |
- zen-2
|
|
|
|
| 11 |
pipeline_tag: text-generation
|
| 12 |
library_name: transformers
|
| 13 |
---
|
|
|
|
| 15 |
# Zen 2 7B — Code Specialist
|
| 16 |
|
| 17 |
> **Originally released**: 2024-07-15
|
| 18 |
+
> **Parameters**: 7B | **Architecture**: Zen 2 Architecture | **Context**: 128K | **License**: Apache 2.0
|
|
|
|
| 19 |
|
| 20 |
Second generation of the Zen LM family (Q2 2024). Key breakthrough: **128K context window** via improved positional encoding and sliding window attention.
|
| 21 |
|
|
|
|
| 23 |
|
| 24 |
## Research Lineage
|
| 25 |
|
| 26 |
+
| Generation | Release | Architecture | Key Advancement |
|
| 27 |
+
|------------|---------|--------------|-----------------|
|
| 28 |
+
| Zen 1 | Q4 2023 | Zen 1 Architecture | Foundation, dense transformer, 4K context |
|
| 29 |
+
| Zen 2 | Q2 2024 | Zen 2 Architecture | 128K context window |
|
| 30 |
+
| Zen 3 | Q3–Q4 2024 | Zen 3 Architecture | Sparse MoE routing, multimodal |
|
| 31 |
+
| Zen 4 | Q1 2025 | Zen 4 Architecture | 256K–1M context, extended families |
|
| 32 |
+
| Zen 5 | 2025+ | Zen MoDE | Next-generation frontier |
|
| 33 |
|
| 34 |
|
| 35 |
---
|