KucLab commited on
Commit
63afd3a
·
verified ·
1 Parent(s): fdcddb1

Add report benchmark_cpu.md

Browse files
Files changed (1) hide show
  1. reports/benchmark_cpu.md +3 -3
reports/benchmark_cpu.md CHANGED
@@ -25,9 +25,9 @@ Generated by `scripts/benchmark.py`.
25
  | Metric | Value |
26
  | --- | --- |
27
  | Single text latency | 0.54 ms |
28
- | Single text throughput | 1868.0 texts/s |
29
- | Batch of 8 latency | 1.39 ms |
30
- | Batched throughput | 5738.0 texts/s |
31
  | Peak VRAM (inference) | n/a (CPU) |
32
 
33
  ## Accuracy
 
25
  | Metric | Value |
26
  | --- | --- |
27
  | Single text latency | 0.54 ms |
28
+ | Single text throughput | 1856.3 texts/s |
29
+ | Batch of 8 latency | 1.53 ms |
30
+ | Batched throughput | 5232.5 texts/s |
31
  | Peak VRAM (inference) | n/a (CPU) |
32
 
33
  ## Accuracy