Update README.md
Browse files
README.md
CHANGED
|
@@ -13,10 +13,12 @@ We write our prompts in the ChatML format.
|
|
| 13 |
### With vLLM (recommended for much faster inference)
|
| 14 |
|
| 15 |
<details><summary>Install vLLM</summary>
|
|
|
|
|
|
|
|
|
|
| 16 |
```bash
|
| 17 |
pip install vllm
|
| 18 |
```
|
| 19 |
-
[Reference](https://vllm.readthedocs.io/en/latest/getting_started/installation.html)
|
| 20 |
</details>
|
| 21 |
|
| 22 |
```python
|
|
|
|
| 13 |
### With vLLM (recommended for much faster inference)
|
| 14 |
|
| 15 |
<details><summary>Install vLLM</summary>
|
| 16 |
+
|
| 17 |
+
[Reference](https://vllm.readthedocs.io/en/latest/getting_started/installation.html)
|
| 18 |
+
|
| 19 |
```bash
|
| 20 |
pip install vllm
|
| 21 |
```
|
|
|
|
| 22 |
</details>
|
| 23 |
|
| 24 |
```python
|