feature Qwen3.8-27B and K2.7-Code; add measured-and-corrected section; surface our most-downloaded model
Browse files
README.md
CHANGED
|
@@ -13,7 +13,8 @@ colorTo: purple
|
|
| 13 |
<a href="https://cis.bati.ai"><img src="https://img.shields.io/badge/Enterprise-Bati%20CIS-violet?style=for-the-badge"></a>
|
| 14 |
</p>
|
| 15 |
|
| 16 |
-
> **
|
|
|
|
| 17 |
> **Gemma 4 E4B β 57 tokens/sec** on a 16GB Mac mini M4.
|
| 18 |
> **No API costs. No rate limits. No cloud.**
|
| 19 |
|
|
@@ -27,8 +28,11 @@ We quantize popular open-weight models for **every Mac** β direct from officia
|
|
| 27 |
# 16GB Mac mini M4 β entry, 57 t/s
|
| 28 |
ollama pull batiai/gemma4-e4b:q4
|
| 29 |
|
|
|
|
|
|
|
|
|
|
| 30 |
# 512GB M3 Ultra β 1T MoE frontier
|
| 31 |
-
ollama pull batiai/kimi-k2.
|
| 32 |
```
|
| 33 |
|
| 34 |
---
|
|
@@ -43,6 +47,8 @@ Every speed measured on actual hardware. Full reports in each model card. We con
|
|
| 43 |
| MacBook Air 16GB | `batiai/qwen3.5-9b:q4` | 5.2 GB | 12.5 t/s | Tool calling, JSON |
|
| 44 |
| Mac mini M4 Pro 24GB | `batiai/gemma4-26b:iq4` | 15 GB | **85 t/s** | MoE, larger context |
|
| 45 |
| MacBook Pro 32GB | `batiai/nemotron3-nano:iq4` | 17 GB | β | NVIDIA NemotronH MoE, hybrid Mamba+Attention |
|
|
|
|
|
|
|
| 46 |
| MacBook Pro 48GB | `batiai/qwen3.6-35b:iq4` | 22 GB | ~30 t/s | Tools + thinking, MoE |
|
| 47 |
| MacBook Pro 128GB | `batiai/nemotron3-super:iq4` | 62 GB | β | NemotronH 120B-A12B, agentic |
|
| 48 |
| MacBook Pro 96GB | `batiai/qwen3.6-35b:q6` | 29 GB | ~27 t/s | Top quality chat |
|
|
@@ -83,8 +89,10 @@ Quantized from the **publisher's official FP8/BF16 weights** β never re-quanti
|
|
| 83 |
</td>
|
| 84 |
<td width="50%" valign="top">
|
| 85 |
|
| 86 |
-
### Verified on Real Macs
|
| 87 |
-
Tested on **Mac mini M4 16GB** + **MacBook Pro M4 Max 128GB**. Korean validation, tool-call JSON,
|
|
|
|
|
|
|
| 88 |
|
| 89 |
</td>
|
| 90 |
</tr>
|
|
|
|
| 13 |
<a href="https://cis.bati.ai"><img src="https://img.shields.io/badge/Enterprise-Bati%20CIS-violet?style=for-the-badge"></a>
|
| 14 |
</p>
|
| 15 |
|
| 16 |
+
> **Qwen3.8-27B β quantized 2 days after the weights dropped**, six sizes, vision, Korean-verified.
|
| 17 |
+
> **Kimi K2.7-Code β 1T MoE**, +21.8% coding over K2.6 β running locally on M3 Ultra.
|
| 18 |
> **Gemma 4 E4B β 57 tokens/sec** on a 16GB Mac mini M4.
|
| 19 |
> **No API costs. No rate limits. No cloud.**
|
| 20 |
|
|
|
|
| 28 |
# 16GB Mac mini M4 β entry, 57 t/s
|
| 29 |
ollama pull batiai/gemma4-e4b:q4
|
| 30 |
|
| 31 |
+
# 32GB+ Mac β newest 27B, vision + 262K context
|
| 32 |
+
ollama pull batiai/qwen3.8-27b:iq4
|
| 33 |
+
|
| 34 |
# 512GB M3 Ultra β 1T MoE frontier
|
| 35 |
+
ollama pull batiai/kimi-k2.7-code:iq4
|
| 36 |
```
|
| 37 |
|
| 38 |
---
|
|
|
|
| 47 |
| MacBook Air 16GB | `batiai/qwen3.5-9b:q4` | 5.2 GB | 12.5 t/s | Tool calling, JSON |
|
| 48 |
| Mac mini M4 Pro 24GB | `batiai/gemma4-26b:iq4` | 15 GB | **85 t/s** | MoE, larger context |
|
| 49 |
| MacBook Pro 32GB | `batiai/nemotron3-nano:iq4` | 17 GB | β | NVIDIA NemotronH MoE, hybrid Mamba+Attention |
|
| 50 |
+
| **MacBook Pro 32GB+** | [`batiai/qwen3.8-27b:iq4`](https://huggingface.co/batiai/Qwen3.8-27B-GGUF) | 15 GB | **15.5 t/s** | **Newest 27B** β vision, 262K context, thinking |
|
| 51 |
+
| MacBook Pro 24GB+ | [`batiai/qwen3.6-27b:iq4`](https://huggingface.co/batiai/Qwen3.6-27B-GGUF) | 15 GB | β | Our most-downloaded model (150K+) |
|
| 52 |
| MacBook Pro 48GB | `batiai/qwen3.6-35b:iq4` | 22 GB | ~30 t/s | Tools + thinking, MoE |
|
| 53 |
| MacBook Pro 128GB | `batiai/nemotron3-super:iq4` | 62 GB | β | NemotronH 120B-A12B, agentic |
|
| 54 |
| MacBook Pro 96GB | `batiai/qwen3.6-35b:q6` | 29 GB | ~27 t/s | Top quality chat |
|
|
|
|
| 89 |
</td>
|
| 90 |
<td width="50%" valign="top">
|
| 91 |
|
| 92 |
+
### Verified on Real Macs β and corrected in public
|
| 93 |
+
Tested on **Mac mini M4 16GB** + **MacBook Pro M4 Max 128GB**. Korean validation, tool-call JSON, throughput β measured, reproducible, documented in each card.
|
| 94 |
+
|
| 95 |
+
When measurement contradicts us, we change the card. On Qwen3.8-27B we advertised 16 GB targets, measured it, found the model doesn't fit, and said so. We also found **`Q3_K_M` is smaller *and* slower than `IQ4_XS` on Apple Silicon** β reproducing across four model families β and moved our recommendation. Both are written up in the card, including what we got wrong.
|
| 96 |
|
| 97 |
</td>
|
| 98 |
</tr>
|