File size: 836 Bytes
e311916 434cf62 e311916 434cf62 e311916 434cf62 3bc0f0e e311916 434cf62 e311916 434cf62 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 | ---
license: apache-2.0
language:
- en
tags:
- text-generation
- mlx
- quantized
- zen
- zenlm
library_name: mlx
base_model: zenlm/zen4-mini
---
# Zen4 Mini (MLX)
MLX quantization of Zen4 Mini for efficient inference on Apple Silicon.
## Model Details
| Property | Value |
|----------|-------|
| **Parameters** | Zen4 Mini |
| **Format** | MLX 4-bit quantized |
| **Architecture** | Zen4 |
| **License** | Apache 2.0 |
| **Authors** | Zen LM Authors |
## Usage
```python
from mlx_lm import load, generate
model, tokenizer = load("zenlm/zen4-mini-MLX")
response = generate(model, tokenizer, prompt="Hello, how can I help you?", max_tokens=512)
print(response)
```
## About
Zen4 Mini is a compact, efficient language model from the Zen4 family, optimized for Apple Silicon via MLX quantization.
**Developed by**: Zen LM Authors
|