Add verified Maple oQ4e model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
language: en
|
| 4 |
+
library_name: mlx
|
| 5 |
+
pipeline_tag: text-generation
|
| 6 |
+
base_model: deepgrove/maple-preview
|
| 7 |
+
base_model_relation: quantized
|
| 8 |
+
tags:
|
| 9 |
+
- mlx
|
| 10 |
+
- causal-lm
|
| 11 |
+
- mixture-of-experts
|
| 12 |
+
- reasoning
|
| 13 |
+
- custom-code
|
| 14 |
+
- quantized
|
| 15 |
+
- oq4e
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
+
# Maple Preview — oQ4e MLX quantization
|
| 19 |
+
|
| 20 |
+
This repository contains an enhanced mixed-precision oQ4e MLX quantization of [`deepgrove/maple-preview`](https://huggingface.co/deepgrove/maple-preview), converted from the BF16 safetensors with oMLX.
|
| 21 |
+
|
| 22 |
+
## This MLX quant upload
|
| 23 |
+
|
| 24 |
+
- Approximately 11.8 GB for the complete local model directory (11,786,973,625 bytes).
|
| 25 |
+
- Uses the same 1,024-sample, 512-token enhanced iMatrix calibration as the oQ8e conversion.
|
| 26 |
+
- 18,432 ordinary tensors are 4-bit, with sensitivity-selected 5-, 6-, and 8-bit upgrades; no quantized tensor is below 4-bit.
|
| 27 |
+
- The 24 MoE router matrices and all normalization weights remain BF16.
|
| 28 |
+
- `lm_head` and `model.word_embeddings` are 8-bit.
|
| 29 |
+
- Maple's fused Q/K/V projections use shape-compatible per-layer formats and have been runtime-tested through oMLX.
|
| 30 |
+
- Requires custom-code loading (`trust_remote_code=True`). In oMLX, enable **Trust Remote Code** for this model.
|
| 31 |
+
|
| 32 |
+
This is an MLX conversion for local inference on Apple Silicon. Please follow the base model's MIT license and usage terms.
|
| 33 |
+
|
| 34 |
+
---
|
| 35 |
+
|
| 36 |
+
## Base model description
|
| 37 |
+
|
| 38 |
+
# Maple-Preview
|
| 39 |
+
|
| 40 |
+
**DeepGrove · 2026**
|
| 41 |
+
|
| 42 |
+
Today we introduce Maple-Preview, an open-source 20B-A1B ternary-weight reasoning LLM. Maple-Preview has SOTA reasoning for its weight class and is even competitive with larger models. It solves IMO-level problems and runs at 200+ tokens/sec on a Mac mini M4, 5–16× faster than efficient models like Gemma 4, Qwen3.5, and gpt-oss.
|
| 43 |
+
|
| 44 |
+
- 20B-A1B Model
|
| 45 |
+
- 218 tok/s M4 Mac mini
|
| 46 |
+
- 5.31 GB Checkpoint
|
| 47 |
+
- 131,072 Token context
|
| 48 |
+
|
| 49 |
+
|
| 50 |
+
|
| 51 |
+
> [!NOTE]
|
| 52 |
+
> The included Transformers implementation depends on Triton and FlashAttention
|
| 53 |
+
> and is intended for a compatible CUDA environment. The reported Apple Silicon
|
| 54 |
+
> result uses a separate on-device runtime.
|
| 55 |
+
|
| 56 |
+
## Architecture
|
| 57 |
+
|
| 58 |
+
Maple-Preview is a 20B-A1B reasoning model designed from the start for efficient on-device inference. It utilizes a 24-layer, 256-expert (8 active) configuration with 3:1 SWA-512:GA attention.
|
| 59 |
+
|
| 60 |
+
## Evaluation
|
| 61 |
+
|
| 62 |
+
On benchmarks, Maple-Preview sets a new point on the Pareto frontier for both memory-to-performance and speed-to-performance, demonstrating its strong reasoning capabilities. However, we note that this preview is focused primarily on raw reasoning and, as such, may underperform on agentic benchmarks. We intend to continue improving general performance through extended training before Maple's full release.
|
| 63 |
+
|
| 64 |
+
|
| 65 |
+
|
| 66 |
+
Capability comparison using the dense output head across LCBv6, AIME 2026, HMMT 2026, and GPQA-D.
|
| 67 |
+
|
| 68 |
+
## Limitations
|
| 69 |
+
|
| 70 |
+
This preview received minimal post-training for agentic tasks and only
|
| 71 |
+
small-scale general reinforcement learning.
|
| 72 |
+
|
| 73 |
+
## License
|
| 74 |
+
|
| 75 |
+
Maple-Preview is released under the [MIT License](LICENSE).
|