XanuNetworks
/

North-Mini-Code-1.0-NVFP4

Text Generation

compressed-tensors

Mixture of Experts

8-bit precision

Model card Files Files and versions

DeepseaOne commited on Jun 16

Commit

5d507be

·

verified ·

1 Parent(s): 11eb3dd

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ NVFP4 (4-bit) quant of [CohereLabs/North-Mini-Code-1.0](https://huggingface.co/C
 Serve with vLLM (needs `Cohere2MoeForCausalLM` support + `cohere_melody`):
 ```bash
-vllm serve DeepseaOne/North-Mini-Code-1.0-NVFP4 \
   --max-model-len 262144 \
   --enable-auto-tool-choice \
   --tool-call-parser cohere_command4 \

 Serve with vLLM (needs `Cohere2MoeForCausalLM` support + `cohere_melody`):
 ```bash
+vllm serve XanuNetworks/North-Mini-Code-1.0-NVFP4 \
   --max-model-len 262144 \
   --enable-auto-tool-choice \
   --tool-call-parser cohere_command4 \