23Olivilo commited on
Commit
beddd63
·
verified ·
1 Parent(s): ed0739f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +104 -0
README.md ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - sr
5
+ - hr
6
+ - bs
7
+ - mk
8
+ - sl
9
+ - sq
10
+ - bg
11
+ - el
12
+ - tr
13
+ - ro
14
+ - hu
15
+ license: apache-2.0
16
+ base_model: Qwen/Qwen3-8B
17
+ library_name: mlx
18
+ tags:
19
+ - mlx
20
+ - apple-silicon
21
+ - balkan
22
+ - southeast-europe
23
+ - multilingual
24
+ - honest-ai
25
+ - sovasoft
26
+ ---
27
+
28
+ 🌐 **EN** · [🇷🇸 SR](README_sr.md) · [🇭🇷 HR](README_hr.md) · [🇧🇦 BS](README_bs.md) · [🇲🇰 MK](README_mk.md) · [🇸🇮 SL](README_sl.md) · [🇦🇱 SQ](README_sq.md) · [🇲🇪 CNR](README_cnr.md) · [🇧🇬 BG](README_bg.md) · [🇬🇷 EL](README_el.md) · [🇹🇷 TR](README_tr.md) · [🇷🇴 RO](README_ro.md) · [🇭🇺 HU](README_hu.md)
29
+
30
+ # Zora v1.12 (MLX) — Open, honest LLM for the Balkans
31
+
32
+ zora = "dawn". The one that unites them all. — by Sovasoft (ai.in.rs)
33
+
34
+ This is the **MLX** version of Zora v1.12, optimized for Apple Silicon Macs (M1/M2/M3/M4).
35
+
36
+ ## What is Zora
37
+
38
+ Zora is an open 8B language model (built on Qwen3-8B) for 12 Balkan languages: Serbian, Croatian, Bosnian, Macedonian, Slovenian, Albanian, Montenegrin, Bulgarian, Greek, Turkish, Romanian, Hungarian.
39
+
40
+ ## What is MLX
41
+
42
+ MLX is Apple's machine learning framework for Apple Silicon. This version runs natively on your Mac's GPU with:
43
+ - **Faster inference** than PyTorch/Transformers
44
+ - **Lower memory usage** through MLX optimization
45
+ - **Native Apple Silicon support** (M1, M2, M3, M4)
46
+
47
+ ## Install
48
+
49
+ ```bash
50
+ pip install mlx mlx-lm
51
+ ```
52
+
53
+ ## Usage
54
+
55
+ ### Python
56
+
57
+ ```python
58
+ from mlx_lm import load, generate
59
+
60
+ model, tokenizer = load("sovasoft/zora-v1.12-mlx")
61
+
62
+ messages = [{"role": "user", "content": "Ko si ti?"}]
63
+ prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)
64
+ response = generate(model, tokenizer, prompt=prompt, max_tokens=512)
65
+ print(response)
66
+ ```
67
+
68
+ ### Command Line
69
+
70
+ ```bash
71
+ mlx_lm.generate --model sovasoft/zora-v1.12-mlx --prompt "Ko si ti?"
72
+ ```
73
+
74
+ ### Server
75
+
76
+ ```bash
77
+ mlx_lm.server --model sovasoft/zora-v1.12-mlx --host 0.0.0.0 --port 8080
78
+ ```
79
+
80
+ ## Benchmark
81
+
82
+ BalkanBench: 85/156 (v1.12, 16-bit). See the [main model card](https://huggingface.co/sovasoft/zora-v1.12) for full details.
83
+
84
+ ## Quantize (optional)
85
+
86
+ For lower memory usage:
87
+
88
+ ```bash
89
+ mlx_lm.convert --hf-path sovasoft/zora-v1.12 --mlx-path zora-v1.12-mlx-q4 --q-bits 4
90
+ ```
91
+
92
+ ## License
93
+
94
+ Apache-2.0
95
+
96
+ ## Acknowledgements
97
+
98
+ Thanks to the Qwen team at Alibaba for Qwen3 (Apache-2.0), and to the MLX team at Apple for the MLX framework.
99
+
100
+ ---
101
+
102
+ зора — the dawn belongs to everyone.
103
+
104
+ Sovasoft · ai.in.rs · one to unite them all