Update README.md
Browse files
README.md
CHANGED
|
@@ -177,10 +177,10 @@ Accuracy-norm score*
|
|
| 177 |
|
| 178 |
|Inference Tool/Hardware | A10 (tokens/sec) |
|
| 179 |
|:----------|:----------|
|
| 180 |
-
|
|
| 181 |
| Infery LLM | 2,029.6 |
|
| 182 |
|
| 183 |
-
- Throughput (tokens/sec) - Measured with optimal batch -
|
| 184 |
|
| 185 |
|
| 186 |
## How to Cite
|
|
|
|
| 177 |
|
| 178 |
|Inference Tool/Hardware | A10 (tokens/sec) |
|
| 179 |
|:----------|:----------|
|
| 180 |
+
| PyTorch | 652.49 |
|
| 181 |
| Infery LLM | 2,029.6 |
|
| 182 |
|
| 183 |
+
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
| 184 |
|
| 185 |
|
| 186 |
## How to Cite
|