Model card: note 2026-06-19 MTP/index fix (re-pull index.json for working speculative decoding)

README.md

@@ -34,6 +34,9 @@ Two things make it useful:
 
 **Tested with SGLang only** ([v0.5.13.post1](https://github.com/sgl-project/sglang)). The 4-bit layout and speculative-decoding path are SGLang-specific and untried on vLLM or other engines.
 
+> [!IMPORTANT]
+> **Update (2026-06-19): speculative-decoding (MTP) fix.** Revisions of this repo before this date shipped a `model.safetensors.index.json` that did **not** reference the MTP / next-token-prediction layer shard (`model-00041-of-00041.safetensors`). The shard was present in the repo but **unindexed**, so SGLang's EAGLE speculative decoding loaded an uninitialized draft head and accepted almost nothing (~0.1% acceptance — **no speedup**). Outputs were always correct regardless, because the target model verifies every drafted token. This is now fixed: the index references the full MTP layer (layer 78 — 256 experts + `eh_proj`/`enorm`/`hnorm`/`shared_head`), and speculative decoding reaches **~80%+ draft acceptance**. **If you downloaded the repo before 2026-06-19, re-pull `model.safetensors.index.json`** — it is the only file that changed; the weights were already present.
+
 ## Benchmarks
 
 Measured on 8×H200 with SGLang at GLM-5.2's recommended sampling (temperature 1.0, top_p 0.95) with reasoning enabled. The reference column shows the published GLM-5.2 results.