Spaces:
No application file
No application file
Update README.md
Browse files
README.md
CHANGED
|
@@ -18,9 +18,9 @@ High-quality, Apple-Silicon–optimized **MLX** builds, tools, and evals — foc
|
|
| 18 |
## 🚀 Featured models
|
| 19 |
| Repo | Bits/GS | Footprint | Notes |
|
| 20 |
|---|---:|---:|---|
|
| 21 |
-
| **
|
| 22 |
-
| **
|
| 23 |
-
| **
|
| 24 |
| **Reference (8-bit)** | Q8 / 32 | — | See upstream: `lmstudio-community/gpt-oss-20b-MLX-8bit` |
|
| 25 |
|
| 26 |
**Format:** MLX (not GGUF). For Linux/Windows or non-MLX stacks, use a GGUF build with llama.cpp.
|
|
|
|
| 18 |
## 🚀 Featured models
|
| 19 |
| Repo | Bits/GS | Footprint | Notes |
|
| 20 |
|---|---:|---:|---|
|
| 21 |
+
| **halley-ai/gpt-oss-20b-MLX-4bit-gs32** | Q4 / 32 | ~13.1 GB | Trades accuracy for footprint; use when RAM is constrained or throughput is the priority. |
|
| 22 |
+
| **halley-ai/gpt-oss-20b-MLX-5bit-gs32** | Q5 / 32 | ~15.8 GB | Small drop vs 6-bit/gs32 and 8-bit/gs64 (~3–6% PPL); “fits-16GB” VRAM when GPU buffer limits matter. |
|
| 23 |
+
| **halley-ai/gpt-oss-20b-MLX-6bit-gs32** | Q6 / 32 | ~18.4 GB | Best of the group; edges out 8-bit/gs64 slightly at a smaller footprint |
|
| 24 |
| **Reference (8-bit)** | Q8 / 32 | — | See upstream: `lmstudio-community/gpt-oss-20b-MLX-8bit` |
|
| 25 |
|
| 26 |
**Format:** MLX (not GGUF). For Linux/Windows or non-MLX stacks, use a GGUF build with llama.cpp.
|