hero775 commited on
Commit
d73e1b3
Β·
verified Β·
1 Parent(s): b75415b

feature Qwen3.8-27B and K2.7-Code; add measured-and-corrected section; surface our most-downloaded model

Browse files
Files changed (1) hide show
  1. README.md +12 -4
README.md CHANGED
@@ -13,7 +13,8 @@ colorTo: purple
13
  <a href="https://cis.bati.ai"><img src="https://img.shields.io/badge/Enterprise-Bati%20CIS-violet?style=for-the-badge"></a>
14
  </p>
15
 
16
- > **Kimi K2.6 β€” 1T MoE, SWE-Bench Pro 58.6** (beats GPT-5.4 xhigh, Claude Opus 4.6) β€” running locally on M3 Ultra.
 
17
  > **Gemma 4 E4B β€” 57 tokens/sec** on a 16GB Mac mini M4.
18
  > **No API costs. No rate limits. No cloud.**
19
 
@@ -27,8 +28,11 @@ We quantize popular open-weight models for **every Mac** β€” direct from officia
27
  # 16GB Mac mini M4 β€” entry, 57 t/s
28
  ollama pull batiai/gemma4-e4b:q4
29
 
 
 
 
30
  # 512GB M3 Ultra β€” 1T MoE frontier
31
- ollama pull batiai/kimi-k2.6:iq4
32
  ```
33
 
34
  ---
@@ -43,6 +47,8 @@ Every speed measured on actual hardware. Full reports in each model card. We con
43
  | MacBook Air 16GB | `batiai/qwen3.5-9b:q4` | 5.2 GB | 12.5 t/s | Tool calling, JSON |
44
  | Mac mini M4 Pro 24GB | `batiai/gemma4-26b:iq4` | 15 GB | **85 t/s** | MoE, larger context |
45
  | MacBook Pro 32GB | `batiai/nemotron3-nano:iq4` | 17 GB | β€” | NVIDIA NemotronH MoE, hybrid Mamba+Attention |
 
 
46
  | MacBook Pro 48GB | `batiai/qwen3.6-35b:iq4` | 22 GB | ~30 t/s | Tools + thinking, MoE |
47
  | MacBook Pro 128GB | `batiai/nemotron3-super:iq4` | 62 GB | β€” | NemotronH 120B-A12B, agentic |
48
  | MacBook Pro 96GB | `batiai/qwen3.6-35b:q6` | 29 GB | ~27 t/s | Top quality chat |
@@ -83,8 +89,10 @@ Quantized from the **publisher's official FP8/BF16 weights** β€” never re-quanti
83
  </td>
84
  <td width="50%" valign="top">
85
 
86
- ### Verified on Real Macs
87
- Tested on **Mac mini M4 16GB** + **MacBook Pro M4 Max 128GB**. Korean validation, tool-call JSON, 200-token throughput β€” measured, reproducible, documented in each model card.
 
 
88
 
89
  </td>
90
  </tr>
 
13
  <a href="https://cis.bati.ai"><img src="https://img.shields.io/badge/Enterprise-Bati%20CIS-violet?style=for-the-badge"></a>
14
  </p>
15
 
16
+ > **Qwen3.8-27B β€” quantized 2 days after the weights dropped**, six sizes, vision, Korean-verified.
17
+ > **Kimi K2.7-Code β€” 1T MoE**, +21.8% coding over K2.6 β€” running locally on M3 Ultra.
18
  > **Gemma 4 E4B β€” 57 tokens/sec** on a 16GB Mac mini M4.
19
  > **No API costs. No rate limits. No cloud.**
20
 
 
28
  # 16GB Mac mini M4 β€” entry, 57 t/s
29
  ollama pull batiai/gemma4-e4b:q4
30
 
31
+ # 32GB+ Mac β€” newest 27B, vision + 262K context
32
+ ollama pull batiai/qwen3.8-27b:iq4
33
+
34
  # 512GB M3 Ultra β€” 1T MoE frontier
35
+ ollama pull batiai/kimi-k2.7-code:iq4
36
  ```
37
 
38
  ---
 
47
  | MacBook Air 16GB | `batiai/qwen3.5-9b:q4` | 5.2 GB | 12.5 t/s | Tool calling, JSON |
48
  | Mac mini M4 Pro 24GB | `batiai/gemma4-26b:iq4` | 15 GB | **85 t/s** | MoE, larger context |
49
  | MacBook Pro 32GB | `batiai/nemotron3-nano:iq4` | 17 GB | β€” | NVIDIA NemotronH MoE, hybrid Mamba+Attention |
50
+ | **MacBook Pro 32GB+** | [`batiai/qwen3.8-27b:iq4`](https://huggingface.co/batiai/Qwen3.8-27B-GGUF) | 15 GB | **15.5 t/s** | **Newest 27B** β€” vision, 262K context, thinking |
51
+ | MacBook Pro 24GB+ | [`batiai/qwen3.6-27b:iq4`](https://huggingface.co/batiai/Qwen3.6-27B-GGUF) | 15 GB | β€” | Our most-downloaded model (150K+) |
52
  | MacBook Pro 48GB | `batiai/qwen3.6-35b:iq4` | 22 GB | ~30 t/s | Tools + thinking, MoE |
53
  | MacBook Pro 128GB | `batiai/nemotron3-super:iq4` | 62 GB | β€” | NemotronH 120B-A12B, agentic |
54
  | MacBook Pro 96GB | `batiai/qwen3.6-35b:q6` | 29 GB | ~27 t/s | Top quality chat |
 
89
  </td>
90
  <td width="50%" valign="top">
91
 
92
+ ### Verified on Real Macs β€” and corrected in public
93
+ Tested on **Mac mini M4 16GB** + **MacBook Pro M4 Max 128GB**. Korean validation, tool-call JSON, throughput β€” measured, reproducible, documented in each card.
94
+
95
+ When measurement contradicts us, we change the card. On Qwen3.8-27B we advertised 16 GB targets, measured it, found the model doesn't fit, and said so. We also found **`Q3_K_M` is smaller *and* slower than `IQ4_XS` on Apple Silicon** β€” reproducing across four model families β€” and moved our recommendation. Both are written up in the card, including what we got wrong.
96
 
97
  </td>
98
  </tr>