Spaces:

halley-ai
/

README

No application file

sebastavar commited on Aug 18, 2025

Commit

c63e383

verified ·

1 Parent(s): 33aec5d

Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -21,6 +21,6 @@ High-quality, Apple-Silicon–optimized **MLX** builds, tools, and evals — foc
 | **HalleyAI/gpt-oss-20b-MLX-4bit-gs32** | Q4 / 32 | ~13.1 GB | Trades accuracy for footprint; use when RAM is constrained or throughput is the priority. |
 | **HalleyAI/gpt-oss-20b-MLX-5bit-gs32** | Q5 / 32 | ~15.8 GB | Small drop vs 6-bit/gs32 and 8-bit/gs64 (~3–6% PPL); “fits-16GB” VRAM when GPU buffer limits matter. |
 | **HalleyAI/gpt-oss-20b-MLX-6bit-gs32** | Q6 / 32 | ~18.4 GB | Best of the group; edges out 8-bit/gs64 slightly at a smaller footprint |
-| **Reference (8-bit)** | Q8 / 32 | — | Use upstream: `lmstudio-community/gpt-oss-20b-MLX-8bit` |
 **Format:** MLX (not GGUF). For Linux/Windows or non-MLX stacks, use a GGUF build with llama.cpp.

 | **HalleyAI/gpt-oss-20b-MLX-4bit-gs32** | Q4 / 32 | ~13.1 GB | Trades accuracy for footprint; use when RAM is constrained or throughput is the priority. |
 | **HalleyAI/gpt-oss-20b-MLX-5bit-gs32** | Q5 / 32 | ~15.8 GB | Small drop vs 6-bit/gs32 and 8-bit/gs64 (~3–6% PPL); “fits-16GB” VRAM when GPU buffer limits matter. |
 | **HalleyAI/gpt-oss-20b-MLX-6bit-gs32** | Q6 / 32 | ~18.4 GB | Best of the group; edges out 8-bit/gs64 slightly at a smaller footprint |
+| **Reference (8-bit)** | Q8 / 32 | — | See upstream: `lmstudio-community/gpt-oss-20b-MLX-8bit` |
 **Format:** MLX (not GGUF). For Linux/Windows or non-MLX stacks, use a GGUF build with llama.cpp.