fix: Zen 3 arch naming, remove abliterated tag
Browse files
README.md
CHANGED
|
@@ -8,7 +8,6 @@ tags:
|
|
| 8 |
- zenlm
|
| 9 |
- hanzo-ai
|
| 10 |
- zen-3
|
| 11 |
-
|
| 12 |
pipeline_tag: text-generation
|
| 13 |
library_name: transformers
|
| 14 |
base_model: zenlm/zen-pro
|
|
@@ -16,21 +15,19 @@ base_model: zenlm/zen-pro
|
|
| 16 |
|
| 17 |
# Zen 3 Math
|
| 18 |
|
| 19 |
-
> **Parameters**: 32B | **Context**: 32K | **License**: Apache 2.0 | **Released**: 2024-11-15
|
| 20 |
|
| 21 |
Zen 3 generation label. Weights at [zenlm/zen-pro](https://huggingface.co/zenlm/zen-pro).
|
| 22 |
|
| 23 |
-
The Zen 3 family (Q3–Q4 2024) introduced
|
| 24 |
|
| 25 |
```python
|
| 26 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 27 |
-
# Weights are at the canonical repo:
|
| 28 |
model = AutoModelForCausalLM.from_pretrained("zenlm/zen-pro", torch_dtype="auto")
|
| 29 |
tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-pro")
|
| 30 |
```
|
| 31 |
|
| 32 |
```bash
|
| 33 |
-
# Or via Ollama:
|
| 34 |
ollama run hf.co/zenlm/zen-pro
|
| 35 |
```
|
| 36 |
|
|
|
|
| 8 |
- zenlm
|
| 9 |
- hanzo-ai
|
| 10 |
- zen-3
|
|
|
|
| 11 |
pipeline_tag: text-generation
|
| 12 |
library_name: transformers
|
| 13 |
base_model: zenlm/zen-pro
|
|
|
|
| 15 |
|
| 16 |
# Zen 3 Math
|
| 17 |
|
| 18 |
+
> **Parameters**: 32B | **Architecture**: Zen 3 Architecture | **Context**: 32K | **License**: Apache 2.0 | **Released**: 2024-11-15
|
| 19 |
|
| 20 |
Zen 3 generation label. Weights at [zenlm/zen-pro](https://huggingface.co/zenlm/zen-pro).
|
| 21 |
|
| 22 |
+
The Zen 3 family (Q3–Q4 2024) introduced sparse MoE routing and expanded to vision, audio, and multimodal reasoning.
|
| 23 |
|
| 24 |
```python
|
| 25 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
| 26 |
model = AutoModelForCausalLM.from_pretrained("zenlm/zen-pro", torch_dtype="auto")
|
| 27 |
tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-pro")
|
| 28 |
```
|
| 29 |
|
| 30 |
```bash
|
|
|
|
| 31 |
ollama run hf.co/zenlm/zen-pro
|
| 32 |
```
|
| 33 |
|