File size: 656 Bytes
62ef8a0 8c9e563 62ef8a0 8c9e563 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | ---
base_model: zai-org/GLM-5.3-Flash
library_name: compressed-tensors
tags:
- moe
- expert-pruning
- compressed-tensors
---
# GLM-5.3-Flash - 50% Expert Pruned
50% of the MoE experts pruned by router-weight magnitude using [compressed-tensors](https://github.com/vllm-project/compressed-tensors).
- **Base model:** [zai-org/GLM-5.3-Flash](https://huggingface.co/zai-org/GLM-5.3-Flash)
- **Sparsity:** 50% of routed experts removed per layer
- **Layers pruned:** all 43 MoE layers (body layers 3-44)
- **MTP layer:** retained exactly as-is
- **Shared experts:** untouched
- **Vision tower:** untouched (dense ViT MLP, no MoE experts)
## Reproduction
|