CosmicRaisins commited on
Commit
085ce05
·
verified ·
1 Parent(s): b264d60

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ tags:
14
 
15
  Standalone **MTP (multi-token-prediction) draft module** for speculative decoding of **GLM-5.2**, quantized to compressed-tensors **INT4** (4-bit, group-size 32, asymmetric, pack-quantized) to match an AWQ-INT4 serving target.
16
 
17
- This is the **unpruned (256-expert)** variant, intended to pair with the full **[cyankiwi/GLM-5.2-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.2-AWQ-INT4)** target. For the 15%-REAP-pruned target, use the sibling **[CosmicRaisins/GLM-5.2-MTP-INT4-aligned](https://huggingface.co/CosmicRaisins/GLM-5.2-MTP-INT4-aligned)** (218 experts).
18
 
19
  ## Why this exists
20
 
 
14
 
15
  Standalone **MTP (multi-token-prediction) draft module** for speculative decoding of **GLM-5.2**, quantized to compressed-tensors **INT4** (4-bit, group-size 32, asymmetric, pack-quantized) to match an AWQ-INT4 serving target.
16
 
17
+ This is the **unpruned (256-expert)** variant, intended to pair with the full **[cyankiwi/GLM-5.2-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.2-AWQ-INT4)** target. For the 15%-pruned target, use the sibling **[CosmicRaisins/GLM-5.2-MTP-INT4-aligned](https://huggingface.co/CosmicRaisins/GLM-5.2-MTP-INT4-aligned)** (218 experts).
18
 
19
  ## Why this exists
20