Update README.md
Browse files
README.md
CHANGED
|
@@ -28,4 +28,13 @@ The evaluation was conducted using our MCP-based benchmark approach, which asses
|
|
| 28 |
|
| 29 |
Jan-Nano is currently supported by [Jan - beta build](https://www.jan.ai/docs/desktop/beta), an open-source ChatGPT alternative that runs entirely on your computer. Jan provides a user-friendly interface for running local AI models with full privacy and control.
|
| 30 |
|
| 31 |
-
For non-jan app or tutorials there are guidance inside community section, please check those out! [Discussion](https://huggingface.co/Menlo/Jan-nano/discussions)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
Jan-Nano is currently supported by [Jan - beta build](https://www.jan.ai/docs/desktop/beta), an open-source ChatGPT alternative that runs entirely on your computer. Jan provides a user-friendly interface for running local AI models with full privacy and control.
|
| 30 |
|
| 31 |
+
For non-jan app or tutorials there are guidance inside community section, please check those out! [Discussion](https://huggingface.co/Menlo/Jan-nano/discussions)
|
| 32 |
+
|
| 33 |
+
### VLLM
|
| 34 |
+
Here is an example command you can use to run vllm with Jan-nano
|
| 35 |
+
|
| 36 |
+
```
|
| 37 |
+
vllm serve Menlo/Jan-nano --host 0.0.0.0 --port 1234 --enable-auto-tool-choice --tool-call-parser hermes --chat-template ./qwen3_nonthinking.jinja
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
Chat-template is already included in tokenizer so chat-template is optional, but in case it has issue you can download the template here [Non-think chat template](https://qwen.readthedocs.io/en/latest/_downloads/c101120b5bebcc2f12ec504fc93a965e/qwen3_nonthinking.jinja)
|