Update README.md
Browse files
README.md
CHANGED
|
@@ -286,7 +286,7 @@ lm_eval \
|
|
| 286 |
|
| 287 |
|
| 288 |
This model achieves up to 1.6x speedup in both single-stream and multi-stream asynchronous deployment, depending on hardware and use-case scenario.
|
| 289 |
-
The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.
|
| 290 |
|
| 291 |
<details>
|
| 292 |
<summary>Benchmarking Command</summary>
|
|
|
|
| 286 |
|
| 287 |
|
| 288 |
This model achieves up to 1.6x speedup in both single-stream and multi-stream asynchronous deployment, depending on hardware and use-case scenario.
|
| 289 |
+
The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
|
| 290 |
|
| 291 |
<details>
|
| 292 |
<summary>Benchmarking Command</summary>
|