Companion-Forge-L4-ONNX / dinov2_trt_validation.json
patdev's picture
Validate DINOv2 TensorRT engine against ORT CUDA on L4
606a380 verified
Raw
History Blame Contribute Delete
299 Bytes
{
"max_abs": 2.6183395385742188,
"mean_abs": 0.058018215000629425,
"cosine": 0.9999297261238098,
"ort_mean_ms": 99.00647160002336,
"ort_p50_ms": 98.5437770000317,
"trt_mean_ms": 20.477989866693253,
"trt_p50_ms": 20.44595499978641,
"speedup": 4.834774909282184,
"gpu": "NVIDIA L4"
}