metadata
library_name: transformers
tags:
- dflash
- speculative-decoding
- sglang
- glm-5.2
GLM-5.2 FP8 DFLASH v2
Overview
This is a DFLASH speculative draft model for GLM-5.2 FP8 serving. The checkpoint uses DFLASH block size 12 and is intended to be loaded as the draft model in SGLang speculative decoding.
This model is fine-tuned on top of SubconsciousDev/glm-5.2-fp8-dflash-v1
using SubconsciousDev/Subconscious-Dflash-Training-Dataset-mix-glm52-25k.
SGLang Usage
Add these arguments to the SGLang launch command:
--speculative-algorithm DFLASH \
--speculative-draft-model-path SubconsciousDev/glm-5.2-fp8-dflash-v2 \
--speculative-num-draft-tokens 12 \
--speculative-draft-kv-cache-dtype bfloat16