DeepseaOne commited on
Commit
1902122
·
verified ·
1 Parent(s): 5d507be

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ NVFP4 (4-bit) quant of [CohereLabs/North-Mini-Code-1.0](https://huggingface.co/C
17
 
18
  **Benchmarks (DGX Spark / GB10, vLLM):**
19
  - HumanEval pass@1: **90.2%** — matches the FP8 build (90.2%), within one problem of bf16 (90.9%).
20
- - Decode: **~57 tok/s** single-request (reasoning off) — **≈1.72×** the FP8 build, at ~17 GB vs ~28 GB.
21
 
22
  Serve with vLLM (needs `Cohere2MoeForCausalLM` support + `cohere_melody`):
23
 
 
17
 
18
  **Benchmarks (DGX Spark / GB10, vLLM):**
19
  - HumanEval pass@1: **90.2%** — matches the FP8 build (90.2%), within one problem of bf16 (90.9%).
20
+ - Decode: **~58 tok/s** single-request, reasoning off (spark-arena nightly image) — **≈1.67×** the FP8 build, at ~17 GB vs ~28 GB.
21
 
22
  Serve with vLLM (needs `Cohere2MoeForCausalLM` support + `cohere_melody`):
23