YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

DeepSeek-V3-0324-NextN

NextN layer exported from deepseek-ai/DeepSeek-V3-0324 model with script. Used for speculative decoding in SGLang.

Usage

python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-0324 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-V3-0324-NextN --speculative-num-steps 2 --speculative-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8

Downloads last month: 733

Safetensors

Model size

12B params

Tensor type

F32

BF16

F8_E4M3

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support