Update README.md
Browse files
README.md
CHANGED
|
@@ -73,6 +73,7 @@ Raw prompt template:
|
|
| 73 |
<|im_start|>assistant
|
| 74 |
|
| 75 |
```
|
|
|
|
| 76 |
|
| 77 |
You may want to use `vllm` to deploy an OpenAI-like API service. For more information, please refer to the [vllm documentation](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html).
|
| 78 |
|
|
|
|
| 73 |
<|im_start|>assistant
|
| 74 |
|
| 75 |
```
|
| 76 |
+
(There should be a `\n` at the end of prompt.)
|
| 77 |
|
| 78 |
You may want to use `vllm` to deploy an OpenAI-like API service. For more information, please refer to the [vllm documentation](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html).
|
| 79 |
|