Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ tags:
|
|
| 14 |
|
| 15 |
Standalone **MTP (multi-token-prediction) draft module** for speculative decoding of **GLM-5.2**, quantized to compressed-tensors **INT4** (4-bit, group-size 32, asymmetric, pack-quantized) to match an AWQ-INT4 serving target.
|
| 16 |
|
| 17 |
-
This is the **unpruned (256-expert)** variant, intended to pair with the full **[cyankiwi/GLM-5.2-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.2-AWQ-INT4)** target. For the 15%-
|
| 18 |
|
| 19 |
## Why this exists
|
| 20 |
|
|
|
|
| 14 |
|
| 15 |
Standalone **MTP (multi-token-prediction) draft module** for speculative decoding of **GLM-5.2**, quantized to compressed-tensors **INT4** (4-bit, group-size 32, asymmetric, pack-quantized) to match an AWQ-INT4 serving target.
|
| 16 |
|
| 17 |
+
This is the **unpruned (256-expert)** variant, intended to pair with the full **[cyankiwi/GLM-5.2-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.2-AWQ-INT4)** target. For the 15%-pruned target, use the sibling **[CosmicRaisins/GLM-5.2-MTP-INT4-aligned](https://huggingface.co/CosmicRaisins/GLM-5.2-MTP-INT4-aligned)** (218 experts).
|
| 18 |
|
| 19 |
## Why this exists
|
| 20 |
|