Instructions to use sovasoft/zora-v1.12-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use sovasoft/zora-v1.12-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir zora-v1.12-mlx sovasoft/zora-v1.12-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,104 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
- sr
|
| 5 |
+
- hr
|
| 6 |
+
- bs
|
| 7 |
+
- mk
|
| 8 |
+
- sl
|
| 9 |
+
- sq
|
| 10 |
+
- bg
|
| 11 |
+
- el
|
| 12 |
+
- tr
|
| 13 |
+
- ro
|
| 14 |
+
- hu
|
| 15 |
+
license: apache-2.0
|
| 16 |
+
base_model: Qwen/Qwen3-8B
|
| 17 |
+
library_name: mlx
|
| 18 |
+
tags:
|
| 19 |
+
- mlx
|
| 20 |
+
- apple-silicon
|
| 21 |
+
- balkan
|
| 22 |
+
- southeast-europe
|
| 23 |
+
- multilingual
|
| 24 |
+
- honest-ai
|
| 25 |
+
- sovasoft
|
| 26 |
+
---
|
| 27 |
+
|
| 28 |
+
🌐 **EN** · [🇷🇸 SR](README_sr.md) · [🇭🇷 HR](README_hr.md) · [🇧🇦 BS](README_bs.md) · [🇲🇰 MK](README_mk.md) · [🇸🇮 SL](README_sl.md) · [🇦🇱 SQ](README_sq.md) · [🇲🇪 CNR](README_cnr.md) · [🇧🇬 BG](README_bg.md) · [🇬🇷 EL](README_el.md) · [🇹🇷 TR](README_tr.md) · [🇷🇴 RO](README_ro.md) · [🇭🇺 HU](README_hu.md)
|
| 29 |
+
|
| 30 |
+
# Zora v1.12 (MLX) — Open, honest LLM for the Balkans
|
| 31 |
+
|
| 32 |
+
zora = "dawn". The one that unites them all. — by Sovasoft (ai.in.rs)
|
| 33 |
+
|
| 34 |
+
This is the **MLX** version of Zora v1.12, optimized for Apple Silicon Macs (M1/M2/M3/M4).
|
| 35 |
+
|
| 36 |
+
## What is Zora
|
| 37 |
+
|
| 38 |
+
Zora is an open 8B language model (built on Qwen3-8B) for 12 Balkan languages: Serbian, Croatian, Bosnian, Macedonian, Slovenian, Albanian, Montenegrin, Bulgarian, Greek, Turkish, Romanian, Hungarian.
|
| 39 |
+
|
| 40 |
+
## What is MLX
|
| 41 |
+
|
| 42 |
+
MLX is Apple's machine learning framework for Apple Silicon. This version runs natively on your Mac's GPU with:
|
| 43 |
+
- **Faster inference** than PyTorch/Transformers
|
| 44 |
+
- **Lower memory usage** through MLX optimization
|
| 45 |
+
- **Native Apple Silicon support** (M1, M2, M3, M4)
|
| 46 |
+
|
| 47 |
+
## Install
|
| 48 |
+
|
| 49 |
+
```bash
|
| 50 |
+
pip install mlx mlx-lm
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
## Usage
|
| 54 |
+
|
| 55 |
+
### Python
|
| 56 |
+
|
| 57 |
+
```python
|
| 58 |
+
from mlx_lm import load, generate
|
| 59 |
+
|
| 60 |
+
model, tokenizer = load("sovasoft/zora-v1.12-mlx")
|
| 61 |
+
|
| 62 |
+
messages = [{"role": "user", "content": "Ko si ti?"}]
|
| 63 |
+
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)
|
| 64 |
+
response = generate(model, tokenizer, prompt=prompt, max_tokens=512)
|
| 65 |
+
print(response)
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
### Command Line
|
| 69 |
+
|
| 70 |
+
```bash
|
| 71 |
+
mlx_lm.generate --model sovasoft/zora-v1.12-mlx --prompt "Ko si ti?"
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
### Server
|
| 75 |
+
|
| 76 |
+
```bash
|
| 77 |
+
mlx_lm.server --model sovasoft/zora-v1.12-mlx --host 0.0.0.0 --port 8080
|
| 78 |
+
```
|
| 79 |
+
|
| 80 |
+
## Benchmark
|
| 81 |
+
|
| 82 |
+
BalkanBench: 85/156 (v1.12, 16-bit). See the [main model card](https://huggingface.co/sovasoft/zora-v1.12) for full details.
|
| 83 |
+
|
| 84 |
+
## Quantize (optional)
|
| 85 |
+
|
| 86 |
+
For lower memory usage:
|
| 87 |
+
|
| 88 |
+
```bash
|
| 89 |
+
mlx_lm.convert --hf-path sovasoft/zora-v1.12 --mlx-path zora-v1.12-mlx-q4 --q-bits 4
|
| 90 |
+
```
|
| 91 |
+
|
| 92 |
+
## License
|
| 93 |
+
|
| 94 |
+
Apache-2.0
|
| 95 |
+
|
| 96 |
+
## Acknowledgements
|
| 97 |
+
|
| 98 |
+
Thanks to the Qwen team at Alibaba for Qwen3 (Apache-2.0), and to the MLX team at Apple for the MLX framework.
|
| 99 |
+
|
| 100 |
+
---
|
| 101 |
+
|
| 102 |
+
зора — the dawn belongs to everyone.
|
| 103 |
+
|
| 104 |
+
Sovasoft · ai.in.rs · one to unite them all
|