kl commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -80,7 +80,7 @@ generated_ids = [
|
|
| 80 |
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
| 81 |
```
|
| 82 |
|
| 83 |
-
For deployment, you can use sglang>=0.4.
|
| 84 |
- SGLang:
|
| 85 |
|
| 86 |
```shell
|
|
|
|
| 80 |
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
| 81 |
```
|
| 82 |
|
| 83 |
+
For deployment, you can use sglang>=0.4.9.post1 to create an OpenAI-compatible API endpoint:
|
| 84 |
- SGLang:
|
| 85 |
|
| 86 |
```shell
|