Update README.md
Browse files
README.md
CHANGED
|
@@ -40,7 +40,7 @@ Jan-code is optimized for direct integration with [Jan Desktop](https://jan.ai/)
|
|
| 40 |
|
| 41 |
**Using vLLM:**
|
| 42 |
```bash
|
| 43 |
-
vllm serve janhq/Jan-code \
|
| 44 |
--host 0.0.0.0 \
|
| 45 |
--port 1234 \
|
| 46 |
--enable-auto-tool-choice \
|
|
@@ -50,7 +50,7 @@ vllm serve janhq/Jan-code \
|
|
| 50 |
|
| 51 |
**Using llama.cpp:**
|
| 52 |
```bash
|
| 53 |
-
llama-server --model Jan-code-Q8_0.gguf \
|
| 54 |
--host 0.0.0.0 \
|
| 55 |
--port 1234 \
|
| 56 |
--jinja \
|
|
|
|
| 40 |
|
| 41 |
**Using vLLM:**
|
| 42 |
```bash
|
| 43 |
+
vllm serve janhq/Jan-code-4b \
|
| 44 |
--host 0.0.0.0 \
|
| 45 |
--port 1234 \
|
| 46 |
--enable-auto-tool-choice \
|
|
|
|
| 50 |
|
| 51 |
**Using llama.cpp:**
|
| 52 |
```bash
|
| 53 |
+
llama-server --model Jan-code-4b-Q8_0.gguf \
|
| 54 |
--host 0.0.0.0 \
|
| 55 |
--port 1234 \
|
| 56 |
--jinja \
|