Update README.md
Browse files
README.md
CHANGED
|
@@ -319,6 +319,8 @@ python benchmarks/benchmark_latency.py --input-len 256 --output-len 256 --model
|
|
| 319 |
We also benchmarked the throughput in a serving environment.
|
| 320 |
|
| 321 |
Download sharegpt dataset: `wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json`
|
|
|
|
|
|
|
| 322 |
Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
|
| 323 |
|
| 324 |
Get vllm source code:
|
|
|
|
| 319 |
We also benchmarked the throughput in a serving environment.
|
| 320 |
|
| 321 |
Download sharegpt dataset: `wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json`
|
| 322 |
+
|
| 323 |
+
|
| 324 |
Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
|
| 325 |
|
| 326 |
Get vllm source code:
|