File size: 276 Bytes
77f5ba3 9726ba2 77f5ba3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
base_model:
- mistralai/Devstral-Small-2505
---
```python
python3 -m vllm.entrypoints.openai.api_server \
--host 0.0.0.0 --port 8000 \
--model miike-ai/devstral-fp8 \
--tokenizer mistralai/Devstral-Small-2505 \
--tokenizer-mode mistral \
--trust-remote-code
``` |