Commit History
Restore non-Base INT4 weights with DSpark MTP 392501d verified
Select SparkInfer MHC explicitly 0d2e525 verified
Rebuild from DeepSeek-V4-Flash-0731 (native DSpark, no graft) 991706c verified
Keep benchmark tables concise ace78a6
doctorpangloss commited on
Document and select the INT4 INT8 kernel paths 8488a86
doctorpangloss commited on
Name the tested consumer GPUs ec8d405
doctorpangloss commited on
Document RTX 3090 and GB10 kernel paths d81cdb4
doctorpangloss commited on
Restore pre-Base INT4 target with DSpark graft 597471b verified
Drop pp_transport: the transport it toggles was removed in 280d6f4cc4 9a6dd86 verified
vllm block: name the int8 prefill kernel that actually runs 5f83add verified
Add concurrent serving needle benchmark (PP=10, C=1..128) 130c972 verified
vllm block: restore pp_transport.cache_metadata=false (dropped in the appmana->vllm re-key; required by the validated 1M config) 9fc51ee verified
Audit every claim against primary sources: absmax7 scales (not MSE), UE8M0 tile scales, Base ships one standard MTP stage d856898 verified
Correct provenance: derived from DeepSeek-V4-Flash-Base (FP8 block-quantized experts), not Flash MXFP4; DSpark stages grafted f1f0b6a verified
Rewrite model card: correct kernel table (native prefill), real serving benchmarks, serving instructions 0c93b41 verified
Rename appmana config block to vllm (matches forks-vllm-ampere kernel-config rename) 31a22be verified
Update serving benchmarks (PP=12, async scheduling, 1M context); vllm config key a583123 verified
Harmonize appmana kernel symbols to role names (flash_mla 2.0.0, breaking) ff0fd2b verified
config: restore appmana kernel block (native FlashMLA int8 decode/prefill + IMMA indexer) b8d2e18 verified
Rebuild from DeepSeek-V4-Flash-Base (higher-precision fp8-block experts) with DSpark 3-stage speculative-decoding MTP grafted (mtp.0 replaced, mtp.1/mtp.2 added). Real end-to-end generation verified. 9b3907e verified
config: add unified appmana kernel block (additive; legacy flag retained) 57d8af1 verified
Document sm86 sparse MLA serving path 6cedfe6
doctorpangloss commited on
Document DeepSeek V4 serving benchmark comparison b1cc206
doctorpangloss commited on
Replace checkpoint with MSE-scale INT4 weights 2f42b13
doctorpangloss commited on