XanuNetworks
/

North-Mini-Code-1.0-NVFP4

Text Generation

compressed-tensors

Mixture of Experts

8-bit precision

Model card Files Files and versions

DeepseaOne commited on Jun 16

Commit

41e8416

·

verified ·

1 Parent(s): e044518

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ NVFP4 (4-bit) quant of [CohereLabs/North-Mini-Code-1.0](https://huggingface.co/C
 Serve with vLLM (needs `Cohere2MoeForCausalLM` support + `cohere_melody`):
 ```bash
-vllm serve <you>/North-Mini-Code-1.0-NVFP4 \
   --max-model-len 262144 \
   --enable-auto-tool-choice \
   --tool-call-parser cohere_command4 \

 Serve with vLLM (needs `Cohere2MoeForCausalLM` support + `cohere_melody`):
 ```bash
+vllm serve DeepseaOne/North-Mini-Code-1.0-NVFP4 \
   --max-model-len 262144 \
   --enable-auto-tool-choice \
   --tool-call-parser cohere_command4 \