Update README.md
Browse files
README.md
CHANGED
|
@@ -37,7 +37,7 @@ pipeline_tag: text2text-generation
|
|
| 37 |
|
| 38 |
Quantized to FP8-Dynamic with [LLMCompressor](https://github.com/vllm-project/llm-compressor)
|
| 39 |
|
| 40 |
-
`vllm serve nm-testing/Devstral-Small-2505-FP8-
|
| 41 |
|
| 42 |
|
| 43 |
# Devstral-Small-2505
|
|
|
|
| 37 |
|
| 38 |
Quantized to FP8-Dynamic with [LLMCompressor](https://github.com/vllm-project/llm-compressor)
|
| 39 |
|
| 40 |
+
`vllm serve nm-testing/Devstral-Small-2505-FP8-dynamic --tokenizer_mode mistral`
|
| 41 |
|
| 42 |
|
| 43 |
# Devstral-Small-2505
|