KucLab commited on
Commit
e86f190
·
verified ·
1 Parent(s): ef90e43

Add report benchmark.md

Browse files
Files changed (1) hide show
  1. reports/benchmark.md +3 -3
reports/benchmark.md CHANGED
@@ -24,10 +24,10 @@ Generated by `scripts/benchmark.py`.
24
 
25
  | Metric | Value |
26
  | --- | --- |
27
- | Single text latency | 1.06 ms |
28
- | Single text throughput | 946.8 texts/s |
29
  | Batch of 8 latency | 1.2 ms |
30
- | Batched throughput | 6646.8 texts/s |
31
  | Peak VRAM (inference) | 84.7 MB |
32
 
33
  ## Accuracy
 
24
 
25
  | Metric | Value |
26
  | --- | --- |
27
+ | Single text latency | 1.07 ms |
28
+ | Single text throughput | 938.3 texts/s |
29
  | Batch of 8 latency | 1.2 ms |
30
+ | Batched throughput | 6650.3 texts/s |
31
  | Peak VRAM (inference) | 84.7 MB |
32
 
33
  ## Accuracy