ERNIE-Image-INT8 / examples /benchmark_overview.md
ixim's picture
Add files using upload-large-folder tool
b90c5ef verified
|
Raw
History Blame Contribute Delete
811 Bytes

Formal Benchmark Overview

Variant Summary

Variant Avg Latency (ms) Avg Peak VRAM (MiB) vs Base Latency vs Base Peak VRAM
transformer-int8 + pe-bf16 + use_pe=true 78053 28516 +0 +0
transformer-int8 + pe-int8 + use_pe=true 81412 28721 +3359 +205
transformer-int8 + use_pe=false 60287 28339 -17766 -177
ERNIE-Image-Turbo Reference 32535 35255 -45518 +6739

Notes

  • pe-int8 is a runtime-quantized benchmark-only variant and does not change the packaged release precision matrix.
  • Peak VRAM is the peak reserved CUDA memory of the current PyTorch process during each generation call.
  • The prompt suite contains 7 prompts, including the added portrait case zh_portrait_studio_east_asian.