freakyskittle's picture
Upload README.md
e8eb96a verified
|
Raw
History Blame Contribute Delete
939 Bytes
metadata
license: other
tags:
  - gguf
  - dflash
  - speculative-decoding
  - kimi
  - kimi-k2.7-code
  - oxidize
base_model: moonshotai/Kimi-K2.7-Code

Kimi-K2.7-Code-DFlash

DFlash draft GGUFs for speculative decoding with Kimi K2.7 Code in Oxidize.

This is a full DFlash initialization, not a baseinit draft. The draft folds real Kimi K2.7 MLA attention weights into DFlash Q/K/V/O projections and uses real shared-expert MLP weights from source layers [1, 12, 24, 35, 47, 58].

Files

  • Kimi-K2.7-Code-DFlash-full-F32.gguf: F32 draft GGUF
  • Kimi-K2.7-Code-DFlash-full-Q4_0.gguf: Q4_0 quantized draft GGUF

Intended use

Use these files as DFlash draft models alongside a compatible Kimi K2.7 Code target model in Oxidize speculative decoding workflows.

Notes

  • Architecture: dflash-draft
  • Hidden size: 7168
  • Draft layers: 6
  • Attention heads: 64
  • KV heads: 64
  • Intermediate size: 2048
  • Target layer IDs: [1, 12, 24, 35, 47, 58]