Hugging Face's logo

EdgeFirst
/
yolov5-det

Object Detection
LiteRT
ONNX
edgefirst
edge-ai
npu
int8
yolo
nxp
hailo
jetson
embedded
Eval Results (legacy)
Model card Files
xet
 Community
1

Publish the 2026Q3 edition of yolov5-det

#1
by sebastientaylor - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+414
-232
Files changed (41) hide show
  1. .gitattributes +3 -0
  2. README.md +321 -178
  3. ara240/yolov5m-det-int16.dvm +2 -2
  4. ara240/yolov5n-det-int16.dvm +2 -2
  5. ara240/yolov5s-det-int16.dvm +2 -2
  6. hailo/yolov5m-det-int8.hailo8l.hef +2 -2
  7. hailo/yolov5n-det-int8.hailo8l.hef +2 -2
  8. hailo/yolov5s-det-int8.hailo8l.hef +2 -2
  9. imx95/yolov5m-det-int8-smart.imx95.tflite +2 -2
  10. imx95/yolov5m-det-int8.imx95.tflite +2 -2
  11. imx95/yolov5n-det-int8-smart.imx95.tflite +2 -2
  12. imx95/yolov5n-det-int8.imx95.tflite +2 -2
  13. imx95/yolov5s-det-int8-smart.imx95.tflite +2 -2
  14. imx95/yolov5s-det-int8.imx95.tflite +2 -2
  15. jetson/yolov5m-det-fp16.engine +2 -2
  16. jetson/yolov5m-det-int8.engine +3 -0
  17. jetson/yolov5n-det-fp16.engine +2 -2
  18. jetson/yolov5n-det-int8.engine +3 -0
  19. jetson/yolov5s-det-fp16.engine +2 -2
  20. jetson/yolov5s-det-int8.engine +3 -0
  21. onnx/yolov5m-det-fp16.onnx +2 -2
  22. onnx/yolov5m-det-fp32.onnx +2 -2
  23. onnx/yolov5n-det-fp16.onnx +2 -2
  24. onnx/yolov5n-det-fp32.onnx +2 -2
  25. onnx/yolov5s-det-fp16.onnx +2 -2
  26. onnx/yolov5s-det-fp32.onnx +2 -2
  27. qnn/yolov5m-det-int16-smart.iq9075.qnn.onnx +3 -0
  28. qnn/yolov5m-det-int8-logical.iq9075.qnn.onnx +3 -0
  29. qnn/yolov5m-det-int8-smart.iq9075.qnn.onnx +3 -0
  30. qnn/yolov5n-det-int16-smart.iq9075.qnn.onnx +3 -0
  31. qnn/yolov5n-det-int8-logical.iq9075.qnn.onnx +3 -0
  32. qnn/yolov5n-det-int8-smart.iq9075.qnn.onnx +3 -0
  33. qnn/yolov5s-det-int16-smart.iq9075.qnn.onnx +3 -0
  34. qnn/yolov5s-det-int8-logical.iq9075.qnn.onnx +3 -0
  35. qnn/yolov5s-det-int8-smart.iq9075.qnn.onnx +3 -0
  36. tflite/yolov5m-det-int8-smart.tflite +2 -2
  37. tflite/yolov5m-det-int8.tflite +2 -2
  38. tflite/yolov5n-det-int8-smart.tflite +2 -2
  39. tflite/yolov5n-det-int8.tflite +2 -2
  40. tflite/yolov5s-det-int8-smart.tflite +2 -2
  41. tflite/yolov5s-det-int8.tflite +2 -2
.gitattributes CHANGED
@@ -42,3 +42,6 @@ hailo/yolov5s-det-int8.hailo8l.hef filter=lfs diff=lfs merge=lfs -text
42
  jetson/yolov5m-det-fp16.engine filter=lfs diff=lfs merge=lfs -text
43
  jetson/yolov5n-det-fp16.engine filter=lfs diff=lfs merge=lfs -text
44
  jetson/yolov5s-det-fp16.engine filter=lfs diff=lfs merge=lfs -text
 
 
 
 
42
  jetson/yolov5m-det-fp16.engine filter=lfs diff=lfs merge=lfs -text
43
  jetson/yolov5n-det-fp16.engine filter=lfs diff=lfs merge=lfs -text
44
  jetson/yolov5s-det-fp16.engine filter=lfs diff=lfs merge=lfs -text
45
+ jetson/yolov5m-det-int8.engine filter=lfs diff=lfs merge=lfs -text
46
+ jetson/yolov5n-det-int8.engine filter=lfs diff=lfs merge=lfs -text
47
+ jetson/yolov5s-det-int8.engine filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -25,22 +25,22 @@ model-index:
25
  metrics:
26
  - name: "mAP@0.5 (Nano ONNX FP32)"
27
  type: map_50
28
- value: 47.75
29
  - name: "mAP@0.5-0.95 (Nano ONNX FP32)"
30
  type: map
31
- value: 32.95
32
  - name: "mAP@0.5 (Small ONNX FP32)"
33
  type: map_50
34
- value: 57.33
35
  - name: "mAP@0.5-0.95 (Small ONNX FP32)"
36
  type: map
37
- value: 41.26
38
  - name: "mAP@0.5 (Medium ONNX FP32)"
39
  type: map_50
40
- value: 63.29
41
  - name: "mAP@0.5-0.95 (Medium ONNX FP32)"
42
  type: map
43
- value: 46.99
44
  ---
45
 
46
  # YOLOv5 Detection — EdgeFirst Model Zoo
@@ -56,7 +56,8 @@ YOLOv5 Detection models trained on [COCO 2017](https://edgefirst.studio/public/p
56
  Part of the [EdgeFirst Model Zoo](https://huggingface.co/spaces/EdgeFirst/Models). New here? **[Introducing the EdgeFirst Model Zoo](https://huggingface.co/blog/EdgeFirst/model-zoo-intro)** covers what is in the zoo, why every figure links to its validation session, and how to reproduce any of it on your own hardware. Want a platform, model or task we don't cover yet? [Vote on what we measure next](https://github.com/orgs/EdgeFirstAI/discussions/categories/polls).
57
 
58
  > [!TIP]
59
- > **Training experiment**: [View on EdgeFirst Studio](https://edgefirst.studio/public/p-694/exp-841/trainings) — dataset, training configuration, metrics, and exported artifacts.
 
60
 
61
  > [!NOTE]
62
  > Legacy architecture, wide deployment base.
@@ -69,9 +70,9 @@ Accuracy ceiling for each size, measured against COCO `val2017` (5,000 images) w
69
 
70
  | Size | Params | GFLOPs | mAP@0.5 | mAP@0.5-0.95 | mAP@0.75 | Source |
71
  |------|--------|--------|---------|--------------|----------|--------|
72
- | Nano | 1.9M | 4.5 | 47.75% | 32.95% | 35.62% | [v-e61](https://edgefirst.studio/public/validation/v-e61/details?mode=charts) |
73
- | Small | 7.2M | 16.5 | 57.33% | 41.26% | 44.95% | [v-e74](https://edgefirst.studio/public/validation/v-e74/details?mode=charts) |
74
- | Medium | 21.2M | 49.0 | 63.29% | 46.99% | 51.33% | [v-e88](https://edgefirst.studio/public/validation/v-e88/details?mode=charts) |
75
  | Large | 46.5M | 109.1 | — | — | — | — |
76
  | XLarge | 86.7M | 205.7 | — | — | — | — |
77
 
@@ -85,7 +86,7 @@ Reconciling **nano** detection (COCO `val2017`, mAP@0.5:0.95, FP32):
85
 
86
  | Source | Nano mAP@0.5:0.95 | What it measures |
87
  |--------|-------------------|------------------|
88
- | **EdgeFirst (this zoo)** | 32.95% | Full deployment path — fixed-input ONNX + `pycocotools` |
89
  | Ultralytics-validator proxy | 33.71% | Portable re-implementation of the Ultralytics validator |
90
  | Ultralytics (official) | 34.3% | Ultralytics' published COCO figure |
91
 
@@ -102,164 +103,188 @@ Row conventions in the table below:
102
  - **Rows whose `Δ` cell reads `ref`** are the float reference runs each quantized/compiled measurement is graded against.
103
  - **Rows without a number** under the metric columns are validation sessions currently in progress, or a session not yet linked to its ONNX FP32 reference. The Studio Source link tracks the current status.
104
  - **Rows whose `Δ vs FP32` cell carries a ⚠** are below our accuracy expectations for that platform (more than 10 percentage points under the float reference). The numbers are real measurements on real hardware, reproducible from the linked Studio session, and we publish them as-is; we are investigating the results to make improvements, and the next snapshot of this card will reflect any recovered accuracy.
 
105
  - **Precision** varies by target: the ONNX reference rows are FP32; macOS CoreML and NVIDIA Jetson TensorRT run FP16; the NXP i.MX 8M Plus, NXP i.MX 95 Neutron, and Hailo NPUs run INT8. The NXP Ara240 DNPU runs a **mixed INT8/INT16** scheme — most of the model is INT8, with the box-regression path (and the ops feeding it) promoted to INT16 to improve localization accuracy.
106
  - **Decoder variants.** EdgeFirst ships three INT8 split-decoders — **smart**, **logical**, and **combined** (described under *Decode* below). Every one we have measured is listed; none is headlined over another, because which one wins is a property of the target, not of the variant. Full converter documentation: [EdgeFirst model conversion](https://doc.edgefirst.ai/latest/models/conversion/) — these are the converters used by this Model Zoo and the EdgeFirst Performance Index report.
107
  - **Runtime.** Which inference stack executed the model. It is a column of its own because one accelerator can be reached by more than one: on Qualcomm Hexagon HTP, `ONNX · QNN EP` is an ONNX Runtime EPContext binary while `LiteRT` is the LiteRT + QNN delegate path, and the two produce measurably different pipelines from the same weights on the same silicon. Compare rows that share a size, platform, precision, and decode to read that difference directly.
108
  - **Decode.** What the exported graph emits, and therefore what your application has to do with it. **Logical** keeps the head's outputs separate and named — boxes, scores, and for segmentation the mask prototypes and coefficients — so reading them needs no decoder beyond taking the tensors as they come. **Smart** cuts the graph further upstream, at a point chosen by dynamic range and sliceability: the operations that quantize worst are lifted out of the model and run outside it, which is what recovers the accuracy, and which is why it needs a decoder implementing that cut (in EdgeFirst deployments, the HAL provides it). **Combined** fuses the decode into the quantized graph — the standard upstream export. It is the least accurate of the three by construction, and the EdgeFirst converters do not emit it for quantized targets; rows appear only where one was measured. Compare rows sharing a size and platform to see what the cut buys on your target — on detection it is often small, on quantized segmentation masks it is usually decisive. A `—` means the run carries no quantized decode split at all (float ONNX / TensorRT / CoreML).
109
  - **Rows are not ranked.** Where a size and platform appear more than once, the rows are competing configurations — a different runtime, precision, decode variant, pipeline mode, or board — not duplicates. Only genuinely repeated measurements of the *same* configuration are collapsed, newest first.
110
- - **Platform-label suffixes.** `(FRDM)` / `(Phytec)` name the NXP i.MX 95 development board a session ran on. `— latency` / `— throughput` mark the two pipeline configurations the NXP i.MX 95 Neutron and NXP Ara240 targets run: the **latency** pipeline runs inference serially for the lowest per-frame latency; the **throughput** pipeline runs multiple inference workers for the highest FPS, which raises per-call inference time in exchange. Rows with neither suffix run a single pipeline.
111
- - **End-to-end (ms)** is the sequential per-image latency of the compute pipeline — preprocess → inference → postprocess. Image acquisition (camera or file load + JPEG decode) overlaps these stages and is excluded from this figure.
112
- - **Realized FPS vs Core-throughput ceiling (FPS).** **Realized FPS** is the *measured* steady-state throughput — the rate at which final results are actually delivered over the full validation pipeline. It normally exceeds `1000 / end-to-end` because the runtime overlaps stages across frames, and it is the **true, priority number**. **Core-throughput ceiling (FPS)** (shown with a `~`) is the accelerator's **core** ceiling — `1000 / device-compute-time`, the rate the NPU/DNPU could sustain *if it were the only bottleneck* — so it is a **possibly-achievable note, not a claim**. It is read from the isolated device-compute stage, which (unlike the host capture/preprocess stages, whose measured time inflates when the pipeline is backpressured) is stable and load-independent. Whether a deployment approaches it depends on the surrounding pipeline, and two levers dominate: (1) **host bottlenecks** — these validation runs decode a JPEG per image, whereas a live **camera pipeline** skips that decode and can run closer to the ceiling; and (2) **confidence threshold** — validation runs at `0.001` to capture every detection for mAP, which makes NMS/decode heavy, while a deployment threshold of `0.25–0.75` produces far fewer candidate boxes and lighter postprocessing, raising realized FPS toward the ceiling.
113
-
114
- | Size | Platform | Runtime | Decode | mAP@0.5 | Δ vs FP32 (pp) | mAP@0.5-0.95 | Inference (ms) | End-to-end (ms) | Realized FPS | Core-throughput ceiling (FPS) | Source |
115
- |------|----------|---------|--------|---------|----------------|--------------|----------------|-----------------|--------------|-------------------------------|--------|
116
- | Nano | ONNX FP32 (AWS Graviton · 4-core) | ONNX | — | 47.74% | -0.01 | 32.94% | 342.52 | 355.18 | 11.5 | ~3 | [v-e53](https://edgefirst.studio/public/validation/v-e53/details?mode=charts) |
117
- | Nano | ONNX FP32 (AWS Graviton4 · 48-core) | ONNX | — | 47.74% | -0.01 | 32.94% | 73.32 | 85.89 | 168.7 | ~14 | [v-e59](https://edgefirst.studio/public/validation/v-e59/details?mode=charts) |
118
- | Nano | ONNX FP32 (AWS Graviton4 · 8-core) | ONNX | — | 47.74% | -0.01 | 32.94% | 213.36 | 220.46 | 36.9 | ~5 | [v-e56](https://edgefirst.studio/public/validation/v-e56/details?mode=charts) |
119
- | Nano | ONNX FP32 (Intel Core i9-13900F · 32-core) | ONNX | — | 47.76% | +0.01 | 32.95% | 34.27 | 45.08 | 80.1 | ~80 | [v-a45](https://edgefirst.studio/public/validation/v-a45/details?mode=charts) |
120
- | Nano | ONNX FP32 (Intel Xeon Platinum 8488C · 24-core) | ONNX | — | 47.75% | +0.00 | 32.95% | 67.99 | 89.22 | 159.4 | ~15 | [v-e5b](https://edgefirst.studio/public/validation/v-e5b/details?mode=charts) |
121
- | Nano | ONNX FP32 (Intel Xeon Platinum 8488C · 4-core) | ONNX | — | 47.76% | +0.01 | 32.95% | 147.37 | 160.10 | 51.2 | ~7 | [v-e58](https://edgefirst.studio/public/validation/v-e58/details?mode=charts) |
122
- | Nano | ONNX FP32 (CUDA) | ONNX | — | 47.75% | ref | 32.95% | 6.76 | 15.78 | 328.9 | ~329 | [v-e61](https://edgefirst.studio/public/validation/v-e61/details?mode=charts) |
123
- | Nano | ONNX FP32 (CUDA) | ONNX | — | 47.75% | +0.00 | 32.95% | 7.71 | 12.85 | 357.8 | ~358 | [v-a87](https://edgefirst.studio/public/validation/v-a87/details?mode=charts) |
124
- | Nano | ONNX FP16 (CUDA) | ONNX | — | 47.75% | +0.00 | 32.93% | 6.00 | 11.65 | 456.8 | ~457 | [v-a9c](https://edgefirst.studio/public/validation/v-a9c/details?mode=charts) |
125
- | Nano | TFLite INT8 (Intel Xeon Platinum 8488C · 24-core) | LiteRT | Combined | 45.14% | -2.61 | 29.98% | 179.39 | 190.06 | 60.8 | ~6 | [v-10f4](https://edgefirst.studio/public/validation/v-10f4/details?mode=charts) |
126
- | Nano | TFLite INT8 (Intel Xeon Platinum 8488C · 4-core) | LiteRT | Combined | 45.15% | -2.60 | 29.98% | 284.68 | 291.34 | 27.7 | ~4 | [v-10dd](https://edgefirst.studio/public/validation/v-10dd/details?mode=charts) |
127
- | Nano | TFLite INT8 (AWS Graviton4 · 48-core) | LiteRT | Combined | 45.13% | -2.62 | 30.03% | 75.46 | 85.56 | 167.9 | ~13 | [v-10ea](https://edgefirst.studio/public/validation/v-10ea/details?mode=charts) |
128
- | Nano | TFLite INT8 (AWS Graviton4 · 8-core) | LiteRT | Combined | 45.11% | -2.64 | 30.01% | 164.17 | 168.97 | 47.9 | ~6 | [v-10e6](https://edgefirst.studio/public/validation/v-10e6/details?mode=charts) |
129
- | Nano | Apple M2 Max — CoreML Neural Engine (FP16) | ONNX | — | 47.12% | -0.63 | 32.42% | 1.62 | 5.39 | 862.2 | ~864 | [v-baf](https://edgefirst.studio/public/validation/v-baf/details?mode=charts) |
130
- | Nano | Apple M2 Max — CoreML Metal GPU (FP16) | ONNX | — | 47.16% | -0.59 | 32.45% | 5.53 | 9.41 | 477.4 | ~477 | [v-9cb](https://edgefirst.studio/public/validation/v-9cb/details?mode=charts) |
131
- | Nano | Apple M2 Max — CoreML CPU (FP16) | ONNX | — | 47.14% | -0.61 | 32.43% | 15.43 | 19.38 | 121.3 | ~121 | [v-9cc](https://edgefirst.studio/public/validation/v-9cc/details?mode=charts) |
132
- | Nano | Apple iPhone 17 Pro — CoreML Neural Engine (FP16) | ONNX | — | 47.13% | -0.62 | 32.42% | 1.84 | 6.06 | 825.8 | ~335 | [v-f49](https://edgefirst.studio/public/validation/v-f49/details?mode=charts) |
133
- | Nano | Apple iPhone 17 Pro — CoreML Metal GPU (FP16) | ONNX | — | 47.16% | -0.59 | 32.45% | 4.60 | 8.58 | 390.3 | ~217 | [v-f44](https://edgefirst.studio/public/validation/v-f44/details?mode=charts) |
134
- | Nano | Apple iPhone 17 Pro — CoreML CPU (FP16) | ONNX | — | 47.14% | -0.61 | 32.42% | 14.85 | 20.54 | 127.4 | ~67 | [v-f2e](https://edgefirst.studio/public/validation/v-f2e/details?mode=charts) |
135
- | Nano | Apple iPhone 15 Pro — CoreML Neural Engine (FP16) | ONNX | — | 47.14% | -0.61 | 32.42% | 1.81 | 9.79 | 630.1 | ~178 | [v-f0a](https://edgefirst.studio/public/validation/v-f0a/details?mode=charts) |
136
- | Nano | Apple iPhone 15 Pro — CoreML Metal GPU (FP16) | ONNX | — | 47.16% | -0.59 | 32.45% | 12.35 | 16.40 | 152.6 | ~81 | [v-f09](https://edgefirst.studio/public/validation/v-f09/details?mode=charts) |
137
- | Nano | Apple iPhone 15 Pro — CoreML CPU (FP16) | ONNX | — | 47.14% | -0.61 | 32.42% | 16.95 | 24.64 | 110.1 | ~59 | [v-f08](https://edgefirst.studio/public/validation/v-f08/details?mode=charts) |
138
- | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 46.70% | -1.05 | 31.87% | 1.47 | 14.34 | 274.2 | ~278 | [v-1058](https://edgefirst.studio/public/validation/v-1058/details?mode=charts) |
139
- | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 44.60% | -3.15 | 29.46% | 1.80 | 6.80 | 745.9 | ~757 | [v-105a](https://edgefirst.studio/public/validation/v-105a/details?mode=charts) |
140
- | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 47.70% | -0.05 | 32.73% | 2.73 | 16.83 | 243.1 | ~247 | [v-1051](https://edgefirst.studio/public/validation/v-1051/details?mode=charts) |
141
- | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Logical | 46.93% | -0.82 | 31.89% | 4.71 | 13.65 | 359.2 | ~375 | [v-1055](https://edgefirst.studio/public/validation/v-1055/details?mode=charts) |
142
- | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | LiteRT | Smart | 47.04% | -0.71 | 32.20% | 3.83 | 17.99 | 233.4 | ~239 | [v-1052](https://edgefirst.studio/public/validation/v-1052/details?mode=charts) |
143
- | Nano | Samsung Galaxy S26 Ultra — CPU | LiteRT | Smart | 46.90% | -0.85 | 32.21% | 72.73 | 91.95 | 74.7 | ~14 | [v-1053](https://edgefirst.studio/public/validation/v-1053/details?mode=charts) |
144
- | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Combined | 44.51% | -3.24 | 29.47% | 63.59 | 97.48 | 13.5 | ~16 | [v-8ba](https://edgefirst.studio/public/validation/v-8ba/details?mode=charts) |
145
- | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Logical | 44.51% | -3.24 | 29.47% | 63.37 | 97.31 | 13.5 | ~16 | [v-8bd](https://edgefirst.studio/public/validation/v-8bd/details?mode=charts) |
146
- | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Smart | 46.53% | -1.22 | 31.89% | 57.78 | 110.65 | 14.6 | ~17 | [v-8bf](https://edgefirst.studio/public/validation/v-8bf/details?mode=charts) |
147
- | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — latency | LiteRT | Logical | 44.51% | -3.24 | 29.47% | 64.14 | 106.94 | 13.4 | ~15 | [v-c79](https://edgefirst.studio/public/validation/v-c79/details?mode=charts) |
148
- | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — throughput | LiteRT | Smart | 46.53% | -1.22 | 31.89% | 58.37 | 132.24 | 14.4 | ~17 | [v-c76](https://edgefirst.studio/public/validation/v-c76/details?mode=charts) |
149
- | Nano | NXP i.MX 95 + eIQ Neutron NPU — latency | LiteRT | Smart | 46.46% | -1.29 | 31.57% | 12.76 | 38.67 | 61.2 | ~63 | [v-e30](https://edgefirst.studio/public/validation/v-e30/details?mode=charts) |
150
- | Nano | NXP i.MX 95 + eIQ Neutron NPU — throughput | LiteRT | Smart | 46.46% | -1.29 | 31.58% | 32.56 | 67.58 | 85.3 | ~50 | [v-e31](https://edgefirst.studio/public/validation/v-e31/details?mode=charts) |
151
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Smart | 45.86% | -1.89 | 31.14% | 12.95 | 43.75 | 55.2 | ~56 | [v-8ad](https://edgefirst.studio/public/validation/v-8ad/details?mode=charts) |
152
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Logical | 43.80% | -3.95 | 28.82% | 42.83 | 57.28 | 22.3 | ~23 | [v-8aa](https://edgefirst.studio/public/validation/v-8aa/details?mode=charts) |
153
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Combined | 43.80% | -3.95 | 28.82% | 42.51 | 56.90 | 22.5 | ~23 | [v-8a6](https://edgefirst.studio/public/validation/v-8a6/details?mode=charts) |
154
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Smart | 45.86% | -1.89 | 31.14% | 20.97 | 59.88 | 75.1 | ~45 | [v-8ae](https://edgefirst.studio/public/validation/v-8ae/details?mode=charts) |
155
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Logical | 43.80% | -3.95 | 28.82% | 60.59 | 79.85 | 62.5 | ~62 | [v-8ac](https://edgefirst.studio/public/validation/v-8ac/details?mode=charts) |
156
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Combined | 43.80% | -3.95 | 28.82% | 59.78 | 78.73 | 63.4 | ~63 | [v-8a9](https://edgefirst.studio/public/validation/v-8a9/details?mode=charts) |
157
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (Phytec) — throughput | LiteRT | Smart | 45.86% | -1.89 | 31.14% | 25.10 | 58.30 | 84.0 | ~49 | [v-897](https://edgefirst.studio/public/validation/v-897/details?mode=charts) |
158
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Smart | 46.46% | -1.29 | 31.57% | 13.08 | 40.94 | 58.0 | ~60 | [v-e20](https://edgefirst.studio/public/validation/v-e20/details?mode=charts) |
159
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Logical | 44.44% | -3.31 | 29.26% | 39.12 | 51.13 | 24.5 | ~25 | [v-bc7](https://edgefirst.studio/public/validation/v-bc7/details?mode=charts) |
160
- | Nano | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — throughput | LiteRT | Smart | 46.46% | -1.29 | 31.58% | 22.65 | 62.67 | 78.9 | ~47 | [v-e09](https://edgefirst.studio/public/validation/v-e09/details?mode=charts) |
161
- | Nano | NXP Ara240 (FRDM) — latency | Ara DVM | Smart | 45.00% | -2.75 | 30.12% | 8.28 | 20.52 | 104.1 | ~106 | [v-a10](https://edgefirst.studio/public/validation/v-a10/details?mode=charts) |
162
- | Nano | NXP Ara240 (FRDM) — throughput | Ara DVM | Smart | 44.99% | -2.76 | 30.11% | 8.66 | 31.50 | 193.5 | ~194 | [v-a11](https://edgefirst.studio/public/validation/v-a11/details?mode=charts) |
163
- | Nano | Raspberry Pi 5 + Hailo-8L NPU | Hailo HEF | — | 45.97% | -1.78 | 31.57% | 14.67 | 26.44 | 66.6 | ~67 | [v-8de](https://edgefirst.studio/public/validation/v-8de/details?mode=charts) |
164
- | Nano | NVIDIA Jetson Orin Nano (TensorRT FP16) | TensorRT | — | 47.77% | +0.02 | 32.93% | 8.54 | 23.99 | 271.2 | ~271 | [v-919](https://edgefirst.studio/public/validation/v-919/details?mode=charts) |
165
- | Small | ONNX FP32 (AWS Graviton · 4-core) | ONNX | — | 57.29% | -0.04 | 41.22% | 688.02 | 699.25 | 5.8 | ~1 | [v-e54](https://edgefirst.studio/public/validation/v-e54/details?mode=charts) |
166
- | Small | ONNX FP32 (AWS Graviton4 · 8-core) | ONNX | — | 57.29% | -0.04 | 41.23% | 563.94 | 570.32 | 14.1 | ~2 | [v-e71](https://edgefirst.studio/public/validation/v-e71/details?mode=charts) |
167
- | Small | ONNX FP32 (AWS Graviton4 · 48-core) | ONNX | — | 57.29% | -0.04 | 41.23% | 187.11 | 198.04 | 68.0 | ~5 | [v-e64](https://edgefirst.studio/public/validation/v-e64/details?mode=charts) |
168
- | Small | ONNX FP32 (Intel Core i9-13900F · 32-core) | ONNX | — | 57.32% | -0.01 | 41.26% | 82.06 | 93.67 | 33.6 | ~34 | [v-a4c](https://edgefirst.studio/public/validation/v-a4c/details?mode=charts) |
169
- | Small | ONNX FP32 (Intel Xeon Platinum 8488C · 24-core) | ONNX | — | 57.33% | +0.00 | 41.26% | 153.74 | 174.85 | 80.1 | ~7 | [v-e65](https://edgefirst.studio/public/validation/v-e65/details?mode=charts) |
170
- | Small | ONNX FP32 (Intel Xeon Platinum 8488C · 4-core) | ONNX | — | 57.33% | +0.00 | 41.26% | 302.69 | 312.31 | 25.9 | ~3 | [v-e79](https://edgefirst.studio/public/validation/v-e79/details?mode=charts) |
171
- | Small | ONNX FP32 (CUDA) | ONNX | — | 57.33% | ref | 41.26% | 9.54 | 18.54 | 321.5 | ~322 | [v-e74](https://edgefirst.studio/public/validation/v-e74/details?mode=charts) |
172
- | Small | ONNX FP32 (CUDA) | ONNX | — | 57.33% | +0.00 | 41.26% | 13.69 | 19.29 | 224.0 | ~224 | [v-a8e](https://edgefirst.studio/public/validation/v-a8e/details?mode=charts) |
173
- | Small | ONNX FP16 (CUDA) | ONNX | — | 57.33% | +0.00 | 41.22% | 9.73 | 15.36 | 319.3 | ~319 | [v-aa3](https://edgefirst.studio/public/validation/v-aa3/details?mode=charts) |
174
- | Small | TFLite INT8 (Intel Xeon Platinum 8488C · 24-core) | LiteRT | Combined | 54.94% | -2.39 | 37.45% | 342.35 | 353.13 | 33.5 | ~3 | [v-10fa](https://edgefirst.studio/public/validation/v-10fa/details?mode=charts) |
175
- | Small | TFLite INT8 (Intel Xeon Platinum 8488C · 4-core) | LiteRT | Combined | 54.94% | -2.39 | 37.45% | 681.61 | 688.17 | 11.6 | ~1 | [v-10f3](https://edgefirst.studio/public/validation/v-10f3/details?mode=charts) |
176
- | Small | TFLite INT8 (AWS Graviton4 · 48-core) | LiteRT | Combined | 54.68% | -2.65 | 37.32% | 172.71 | 182.54 | 74.0 | ~6 | [v-10ef](https://edgefirst.studio/public/validation/v-10ef/details?mode=charts) |
177
- | Small | TFLite INT8 (AWS Graviton4 · 8-core) | LiteRT | Combined | 54.68% | -2.65 | 37.32% | 426.25 | 430.63 | 18.7 | ~2 | [v-10e9](https://edgefirst.studio/public/validation/v-10e9/details?mode=charts) |
178
- | Small | Apple M2 Max — CoreML Neural Engine (FP16) | ONNX | — | 56.72% | -0.61 | 40.68% | 4.31 | 7.85 | 394.1 | ~404 | [v-9ea](https://edgefirst.studio/public/validation/v-9ea/details?mode=charts) |
179
- | Small | Apple M2 Max — CoreML Metal GPU (FP16) | ONNX | — | 56.75% | -0.58 | 40.76% | 13.81 | 17.34 | 205.1 | ~205 | [v-9eb](https://edgefirst.studio/public/validation/v-9eb/details?mode=charts) |
180
- | Small | Apple M2 Max — CoreML CPU (FP16) | ONNX | — | 56.72% | -0.61 | 40.71% | 29.96 | 34.04 | 64.2 | ~64 | [v-9ec](https://edgefirst.studio/public/validation/v-9ec/details?mode=charts) |
181
- | Small | Apple iPhone 17 Pro — CoreML Neural Engine (FP16) | ONNX | — | 56.72% | -0.61 | 40.70% | 4.97 | 8.56 | 350.8 | ~201 | [v-f53](https://edgefirst.studio/public/validation/v-f53/details?mode=charts) |
182
- | Small | Apple iPhone 17 Pro — CoreML Metal GPU (FP16) | ONNX | — | 56.75% | -0.58 | 40.76% | 16.40 | 20.23 | 116.5 | ~61 | [v-f4a](https://edgefirst.studio/public/validation/v-f4a/details?mode=charts) |
183
- | Small | Apple iPhone 17 Pro — CoreML CPU (FP16) | ONNX | — | 56.72% | -0.61 | 40.71% | 40.17 | 46.62 | 48.6 | ~25 | [v-f36](https://edgefirst.studio/public/validation/v-f36/details?mode=charts) |
184
- | Small | Apple iPhone 15 Pro — CoreML Neural Engine (FP16) | ONNX | — | 56.72% | -0.61 | 40.69% | 6.94 | 13.63 | 247.0 | ~144 | [v-f12](https://edgefirst.studio/public/validation/v-f12/details?mode=charts) |
185
- | Small | Apple iPhone 15 Pro — CoreML Metal GPU (FP16) | ONNX | — | 56.75% | -0.58 | 40.76% | 41.85 | 51.11 | 45.6 | ~24 | [v-f1a](https://edgefirst.studio/public/validation/v-f1a/details?mode=charts) |
186
- | Small | Apple iPhone 15 Pro — CoreML CPU (FP16) | ONNX | — | 56.72% | -0.61 | 40.71% | 52.61 | 61.21 | 37.0 | ~19 | [v-f1c](https://edgefirst.studio/public/validation/v-f1c/details?mode=charts) |
187
- | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 56.69% | -0.64 | 40.42% | 1.90 | 14.88 | 271.5 | ~276 | [v-1061](https://edgefirst.studio/public/validation/v-1061/details?mode=charts) |
188
- | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 53.79% | -3.54 | 36.43% | 2.67 | 7.69 | 620.9 | ~640 | [v-1064](https://edgefirst.studio/public/validation/v-1064/details?mode=charts) |
189
- | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 57.51% | +0.18 | 41.20% | 3.62 | 19.35 | 221.6 | ~225 | [v-105c](https://edgefirst.studio/public/validation/v-105c/details?mode=charts) |
190
- | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Logical | 56.56% | -0.77 | 40.25% | 6.17 | 14.95 | 297.5 | ~316 | [v-1060](https://edgefirst.studio/public/validation/v-1060/details?mode=charts) |
191
- | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | LiteRT | Smart | 57.49% | +0.16 | 41.02% | 5.49 | 19.09 | 216.8 | ~224 | [v-105d](https://edgefirst.studio/public/validation/v-105d/details?mode=charts) |
192
- | Small | Samsung Galaxy S26 Ultra — CPU | LiteRT | Smart | 57.29% | -0.04 | 40.93% | 161.61 | 187.60 | 35.2 | ~6 | [v-1063](https://edgefirst.studio/public/validation/v-1063/details?mode=charts) |
193
- | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Combined | 54.21% | -3.12 | 37.02% | 115.14 | 148.92 | 8.0 | ~9 | [v-932](https://edgefirst.studio/public/validation/v-932/details?mode=charts) |
194
- | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Logical | 54.21% | -3.12 | 37.02% | 114.90 | 148.55 | 8.0 | ~9 | [v-936](https://edgefirst.studio/public/validation/v-936/details?mode=charts) |
195
- | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Smart | 56.87% | -0.46 | 40.69% | 109.41 | 161.03 | 8.3 | ~9 | [v-939](https://edgefirst.studio/public/validation/v-939/details?mode=charts) |
196
- | Small | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — latency | LiteRT | Logical | 54.21% | -3.12 | 37.02% | 116.35 | 158.76 | 7.9 | ~9 | [v-c8b](https://edgefirst.studio/public/validation/v-c8b/details?mode=charts) |
197
- | Small | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — throughput | LiteRT | Smart | 56.87% | -0.46 | 40.69% | 110.65 | 181.56 | 8.2 | ~9 | [v-c8a](https://edgefirst.studio/public/validation/v-c8a/details?mode=charts) |
198
- | Small | NXP i.MX 95 + eIQ Neutron NPU — latency | LiteRT | Smart | 57.43% | +0.10 | 40.93% | 33.20 | 63.59 | 28.8 | ~29 | [v-e38](https://edgefirst.studio/public/validation/v-e38/details?mode=charts) |
199
- | Small | NXP i.MX 95 + eIQ Neutron NPU — throughput | LiteRT | Smart | 57.42% | +0.09 | 40.92% | 247.74 | 276.95 | 31.9 | ~32 | [v-e39](https://edgefirst.studio/public/validation/v-e39/details?mode=charts) |
200
- | Small | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Smart | 56.67% | -0.66 | 40.36% | 33.73 | 67.63 | 27.3 | ~27 | [v-8fa](https://edgefirst.studio/public/validation/v-8fa/details?mode=charts) |
201
- | Small | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Logical | 53.96% | -3.37 | 36.64% | 69.33 | 83.93 | 14.0 | ~14 | [v-8f6](https://edgefirst.studio/public/validation/v-8f6/details?mode=charts) |
202
- | Small | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Combined | 53.96% | -3.37 | 36.64% | 67.61 | 84.87 | 14.4 | ~15 | [v-8f2](https://edgefirst.studio/public/validation/v-8f2/details?mode=charts) |
203
- | Small | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Smart | 56.67% | -0.66 | 40.36% | 124.58 | 159.61 | 31.2 | ~31 | [v-8fb](https://edgefirst.studio/public/validation/v-8fb/details?mode=charts) |
204
- | Small | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Logical | 53.96% | -3.37 | 36.64% | 126.63 | 142.97 | 30.9 | ~31 | [v-8f8](https://edgefirst.studio/public/validation/v-8f8/details?mode=charts) |
205
- | Small | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Combined | 53.96% | -3.37 | 36.64% | 126.49 | 142.70 | 31.0 | ~31 | [v-8f4](https://edgefirst.studio/public/validation/v-8f4/details?mode=charts) |
206
- | Small | NXP i.MX 95 + eIQ Neutron NPU (Phytec) — throughput | LiteRT | Smart | 56.67% | -0.66 | 40.36% | 121.68 | 154.45 | 32.0 | ~32 | [v-8f0](https://edgefirst.studio/public/validation/v-8f0/details?mode=charts) |
207
- | Small | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Smart | 57.43% | +0.10 | 40.92% | 33.21 | 65.39 | 28.8 | ~29 | [v-e21](https://edgefirst.studio/public/validation/v-e21/details?mode=charts) |
208
- | Small | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Logical | 54.52% | -2.81 | 37.10% | 59.58 | 71.59 | 16.3 | ~17 | [v-bd5](https://edgefirst.studio/public/validation/v-bd5/details?mode=charts) |
209
- | Small | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — throughput | LiteRT | Smart | 57.42% | +0.09 | 40.92% | 250.01 | 281.20 | 31.6 | ~32 | [v-e10](https://edgefirst.studio/public/validation/v-e10/details?mode=charts) |
210
- | Small | NXP Ara240 (FRDM) — latency | Ara DVM | Smart | 54.56% | -2.77 | 37.69% | 13.47 | 25.54 | 68.1 | ~68 | [v-a1e](https://edgefirst.studio/public/validation/v-a1e/details?mode=charts) |
211
- | Small | NXP Ara240 (FRDM) — throughput | Ara DVM | Smart | 54.54% | -2.79 | 37.67% | 13.50 | 26.58 | 96.3 | ~96 | [v-a1f](https://edgefirst.studio/public/validation/v-a1f/details?mode=charts) |
212
- | Small | Raspberry Pi 5 + Hailo-8L NPU | Hailo HEF | — | 56.13% | -1.20 | 40.02% | 29.36 | 43.90 | 32.1 | ~32 | [v-8eb](https://edgefirst.studio/public/validation/v-8eb/details?mode=charts) |
213
- | Small | NVIDIA Jetson Orin Nano (TensorRT FP16) | TensorRT | — | 57.32% | -0.01 | 41.24% | 22.04 | 34.77 | 174.6 | ~174 | [v-921](https://edgefirst.studio/public/validation/v-921/details?mode=charts) |
214
- | Medium | ONNX FP32 (AWS Graviton · 4-core) | ONNX | — | 63.30% | +0.01 | 47.00% | 1697.56 | 1706.65 | 2.4 | ~1 | [v-e55](https://edgefirst.studio/public/validation/v-e55/details?mode=charts) |
215
- | Medium | ONNX FP32 (AWS Graviton4 · 8-core) | ONNX | — | 63.30% | +0.01 | 47.00% | 1416.24 | 1422.32 | 5.6 | ~1 | [v-e73](https://edgefirst.studio/public/validation/v-e73/details?mode=charts) |
216
- | Medium | ONNX FP32 (AWS Graviton4 · 48-core) | ONNX | — | 63.30% | +0.01 | 47.00% | 459.77 | 470.92 | 27.7 | ~2 | [v-e6b](https://edgefirst.studio/public/validation/v-e6b/details?mode=charts) |
217
- | Medium | ONNX FP32 (Intel Core i9-13900F · 32-core) | ONNX | — | 63.29% | +0.00 | 46.99% | 200.15 | 211.96 | 14.1 | ~14 | [v-a53](https://edgefirst.studio/public/validation/v-a53/details?mode=charts) |
218
- | Medium | ONNX FP32 (Intel Xeon Platinum 8488C · 24-core) | ONNX | — | 63.29% | +0.00 | 46.99% | 364.00 | 385.39 | 34.1 | ~3 | [v-e6a](https://edgefirst.studio/public/validation/v-e6a/details?mode=charts) |
219
- | Medium | ONNX FP32 (Intel Xeon Platinum 8488C · 4-core) | ONNX | — | 63.29% | +0.00 | 46.99% | 933.88 | 944.85 | 8.5 | ~1 | [v-e7a](https://edgefirst.studio/public/validation/v-e7a/details?mode=charts) |
220
- | Medium | ONNX FP32 (CUDA) | ONNX | — | 63.29% | ref | 46.99% | 21.19 | 29.12 | 176.2 | ~176 | [v-e88](https://edgefirst.studio/public/validation/v-e88/details?mode=charts) |
221
- | Medium | ONNX FP32 (CUDA) | ONNX | — | 63.29% | +0.00 | 46.99% | 33.81 | 40.48 | 97.0 | ~97 | [v-a95](https://edgefirst.studio/public/validation/v-a95/details?mode=charts) |
222
- | Medium | ONNX FP16 (CUDA) | ONNX | — | 63.27% | -0.02 | 46.94% | 20.03 | 26.34 | 166.1 | ~166 | [v-aaa](https://edgefirst.studio/public/validation/v-aaa/details?mode=charts) |
223
- | Medium | TFLite INT8 (Intel Xeon Platinum 8488C · 24-core) | LiteRT | Combined | 60.15% | -3.14 | 42.20% | 757.74 | 769.79 | 16.1 | ~1 | [v-10fb](https://edgefirst.studio/public/validation/v-10fb/details?mode=charts) |
224
- | Medium | TFLite INT8 (Intel Xeon Platinum 8488C · 4-core) | LiteRT | Combined | 60.15% | -3.14 | 42.20% | 1712.52 | 1719.58 | 4.6 | ~1 | [v-10e0](https://edgefirst.studio/public/validation/v-10e0/details?mode=charts) |
225
- | Medium | TFLite INT8 (AWS Graviton4 · 48-core) | LiteRT | Combined | 60.16% | -3.13 | 42.34% | 396.14 | 406.13 | 32.3 | ~3 | [v-10f0](https://edgefirst.studio/public/validation/v-10f0/details?mode=charts) |
226
- | Medium | TFLite INT8 (AWS Graviton4 · 8-core) | LiteRT | Combined | 60.15% | -3.14 | 42.33% | 1060.22 | 1064.51 | 7.5 | ~1 | [v-10eb](https://edgefirst.studio/public/validation/v-10eb/details?mode=charts) |
227
- | Medium | Apple M2 Max — CoreML Neural Engine (FP16) | ONNX | — | 62.78% | -0.51 | 46.53% | 11.53 | 15.16 | 162.2 | ~164 | [v-75b](https://edgefirst.studio/public/validation/v-75b/details?mode=charts) |
228
- | Medium | Apple M2 Max — CoreML Metal GPU (FP16) | ONNX | — | 62.80% | -0.49 | 46.52% | 33.27 | 37.50 | 87.8 | ~88 | [v-765](https://edgefirst.studio/public/validation/v-765/details?mode=charts) |
229
- | Medium | Apple M2 Max — CoreML CPU (FP16) | ONNX | — | 62.75% | -0.54 | 46.46% | 56.58 | 60.68 | 34.6 | ~35 | [v-9dc](https://edgefirst.studio/public/validation/v-9dc/details?mode=charts) |
230
- | Medium | Apple iPhone 17 Pro — CoreML Neural Engine (FP16) | ONNX | — | 62.78% | -0.51 | 46.53% | 14.41 | 18.32 | 131.8 | ~69 | [v-f59](https://edgefirst.studio/public/validation/v-f59/details?mode=charts) |
231
- | Medium | Apple iPhone 17 Pro — CoreML Metal GPU (FP16) | ONNX | — | 62.80% | -0.49 | 46.51% | 32.08 | 40.59 | 59.7 | ~31 | [v-f54](https://edgefirst.studio/public/validation/v-f54/details?mode=charts) |
232
- | Medium | Apple iPhone 17 Pro — CoreML CPU (FP16) | ONNX | — | 62.75% | -0.54 | 46.45% | 92.85 | 99.63 | 21.3 | ~11 | [v-f3d](https://edgefirst.studio/public/validation/v-f3d/details?mode=charts) |
233
- | Medium | Apple iPhone 15 Pro — CoreML Neural Engine (FP16) | ONNX | — | 62.78% | -0.51 | 46.54% | 18.03 | 23.79 | 104.7 | ~55 | [v-f1b](https://edgefirst.studio/public/validation/v-f1b/details?mode=charts) |
234
- | Medium | Apple iPhone 15 Pro — CoreML Metal GPU (FP16) | ONNX | — | 62.80% | -0.49 | 46.51% | 114.12 | 129.31 | 17.0 | ~9 | [v-f28](https://edgefirst.studio/public/validation/v-f28/details?mode=charts) |
235
- | Medium | Apple iPhone 15 Pro — CoreML CPU (FP16) | ONNX | — | 62.75% | -0.54 | 46.46% | 121.21 | 129.68 | 16.3 | ~8 | [v-f29](https://edgefirst.studio/public/validation/v-f29/details?mode=charts) |
236
- | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 62.86% | -0.43 | 46.44% | 4.02 | 16.44 | 265.0 | ~270 | [v-106b](https://edgefirst.studio/public/validation/v-106b/details?mode=charts) |
237
- | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 59.41% | -3.88 | 41.50% | 5.91 | 11.13 | 326.4 | ~338 | [v-106d](https://edgefirst.studio/public/validation/v-106d/details?mode=charts) |
238
- | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 63.51% | +0.22 | 47.08% | 7.99 | 28.41 | 155.0 | ~157 | [v-1066](https://edgefirst.studio/public/validation/v-1066/details?mode=charts) |
239
- | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Logical | 62.53% | -0.76 | 46.05% | 12.27 | 22.11 | 158.0 | ~163 | [v-1069](https://edgefirst.studio/public/validation/v-1069/details?mode=charts) |
240
- | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | LiteRT | Smart | 63.21% | -0.08 | 46.75% | 14.28 | 27.31 | 134.2 | ~139 | [v-1067](https://edgefirst.studio/public/validation/v-1067/details?mode=charts) |
241
- | Medium | Samsung Galaxy S26 Ultra — CPU | LiteRT | Smart | 63.35% | +0.06 | 46.79% | 352.87 | 379.87 | 16.6 | ~3 | [v-1076](https://edgefirst.studio/public/validation/v-1076/details?mode=charts) |
242
- | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Combined | 59.62% | -3.67 | 41.74% | 212.49 | 247.33 | 4.5 | ~5 | [v-975](https://edgefirst.studio/public/validation/v-975/details?mode=charts) |
243
- | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Logical | 59.62% | -3.67 | 41.74% | 212.31 | 246.13 | 4.5 | ~5 | [v-978](https://edgefirst.studio/public/validation/v-978/details?mode=charts) |
244
- | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Smart | 62.79% | -0.50 | 46.34% | 206.67 | 258.59 | 4.6 | ~5 | [v-97b](https://edgefirst.studio/public/validation/v-97b/details?mode=charts) |
245
- | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — latency | LiteRT | Logical | 59.62% | -3.67 | 41.74% | 215.14 | 257.32 | 4.4 | ~5 | [v-c9d](https://edgefirst.studio/public/validation/v-c9d/details?mode=charts) |
246
- | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — throughput | LiteRT | Smart | 62.79% | -0.50 | 46.34% | 208.98 | 279.94 | 4.5 | ~5 | [v-c9c](https://edgefirst.studio/public/validation/v-c9c/details?mode=charts) |
247
- | Medium | NXP i.MX 95 + eIQ Neutron NPU — latency | LiteRT | Smart | 63.42% | +0.13 | 46.86% | 77.85 | 116.52 | 12.6 | ~13 | [v-e3d](https://edgefirst.studio/public/validation/v-e3d/details?mode=charts) |
248
- | Medium | NXP i.MX 95 + eIQ Neutron NPU — throughput | LiteRT | Smart | 63.42% | +0.13 | 46.86% | 604.29 | 640.13 | 13.2 | ~13 | [v-e3e](https://edgefirst.studio/public/validation/v-e3e/details?mode=charts) |
249
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Smart | 62.77% | -0.52 | 46.30% | 78.06 | 110.95 | 12.3 | ~12 | [v-96b](https://edgefirst.studio/public/validation/v-96b/details?mode=charts) |
250
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Logical | 59.40% | -3.89 | 41.61% | 113.44 | 127.73 | 8.6 | ~9 | [v-968](https://edgefirst.studio/public/validation/v-968/details?mode=charts) |
251
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — latency | LiteRT | Combined | 59.40% | -3.89 | 41.61% | 112.99 | 127.12 | 8.7 | ~9 | [v-966](https://edgefirst.studio/public/validation/v-966/details?mode=charts) |
252
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Smart | 62.77% | -0.52 | 46.30% | 301.76 | 335.74 | 13.1 | ~13 | [v-96c](https://edgefirst.studio/public/validation/v-96c/details?mode=charts) |
253
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Logical | 59.40% | -3.89 | 41.61% | 304.24 | 321.05 | 13.0 | ~13 | [v-96a](https://edgefirst.studio/public/validation/v-96a/details?mode=charts) |
254
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (FRDM) — throughput | LiteRT | Combined | 59.40% | -3.89 | 41.61% | 304.16 | 320.96 | 13.0 | ~13 | [v-967](https://edgefirst.studio/public/validation/v-967/details?mode=charts) |
255
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (Phytec) — throughput | LiteRT | Smart | 62.77% | -0.52 | 46.30% | 297.44 | 329.30 | 13.2 | ~13 | [v-94b](https://edgefirst.studio/public/validation/v-94b/details?mode=charts) |
256
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Smart | 63.42% | +0.13 | 46.86% | 77.47 | 120.05 | 12.7 | ~13 | [v-e22](https://edgefirst.studio/public/validation/v-e22/details?mode=charts) |
257
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Logical | 59.97% | -3.32 | 42.12% | 103.73 | 115.73 | 9.5 | ~10 | [v-be3](https://edgefirst.studio/public/validation/v-be3/details?mode=charts) |
258
- | Medium | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — throughput | LiteRT | Smart | 63.42% | +0.13 | 46.87% | 604.31 | 647.61 | 13.2 | ~13 | [v-e17](https://edgefirst.studio/public/validation/v-e17/details?mode=charts) |
259
- | Medium | NXP Ara240 (FRDM) — latency | Ara DVM | Smart | 60.72% | -2.57 | 43.55% | 24.38 | 36.41 | 39.0 | ~39 | [v-a2c](https://edgefirst.studio/public/validation/v-a2c/details?mode=charts) |
260
- | Medium | NXP Ara240 (FRDM) — throughput | Ara DVM | Smart | 60.70% | -2.59 | 43.54% | 24.36 | 37.19 | 47.0 | ~47 | [v-a2d](https://edgefirst.studio/public/validation/v-a2d/details?mode=charts) |
261
- | Medium | Raspberry Pi 5 + Hailo-8L NPU | Hailo HEF | — | 62.40% | -0.89 | 46.17% | 57.38 | 72.71 | 16.2 | ~16 | [v-906](https://edgefirst.studio/public/validation/v-906/details?mode=charts) |
262
- | Medium | NVIDIA Jetson Orin Nano (TensorRT FP16) | TensorRT | — | 63.31% | +0.02 | 46.96% | 44.49 | 56.80 | 88.2 | ~88 | [v-92a](https://edgefirst.studio/public/validation/v-92a/details?mode=charts) |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
263
 
264
 
265
 
@@ -273,9 +298,9 @@ These results are produced by the EdgeFirst on-target validation pipeline:
273
  2. **EdgeFirst Studio** receives the metrics, predictions, charts and trace, and publishes them as the `v-XXXX` validation session every row above cites. Studio is where results are published, compared and browsed — it is not where they are computed.
274
  3. **EdgeFirst HAL** ([open source](https://github.com/EdgeFirstAI/hal)) provides the hardware-accelerated preprocessing and post-decoding primitives used at both validation and deployment time, so the timings measured here reflect the same accelerated paths a production runtime would take.
275
 
276
- Inference latency is reported as the on-accelerator inference time. End-to-end latency is the sequential per-image latency across the compute pipeline — preprocessing, inference, and postprocessing; image acquisition (file or camera load and JPEG decode) overlaps these stages and is excluded from this figure.
277
 
278
- Two throughput figures are reported. **Realized FPS** is the *measured* steady-state rate at which final results are emitted, measured directly from the profiler's per-frame result-emission timestamps over the steady-state stream — trace-independent; the Perfetto trace's own FPS is used only as a fallback on sessions where that scalar isn't available. It is the true, priority number and generally exceeds `1000 / end-to-end` because the runtime overlaps stages across frames. **Core-throughput ceiling (FPS)** is the accelerator's **core** ceiling — `1000 / device-compute-time`, i.e. the throughput if the accelerator were the *only* bottleneck. It is taken from the isolated device-compute stage (on transfer-split runtimes the trace separates host↔device transfers from device compute), which is load-independent — unlike the host capture/preprocess service times, whose measured cost inflates under pipeline backpressure (the same 5000 JPEGs cost ~7.8 ms/frame serialized but far more under throughput backpressure), so the slowest-stage figure would *understate* a fast accelerator. It is a possibly-achievable ceiling, not a measured result: reaching it depends on the deployment pipeline. A validation run decodes a JPEG per image and evaluates at a `0.001` confidence threshold (to capture every detection for mAP), both of which load the host and postprocess stages; a production camera pipeline (no JPEG decode) at a deployment threshold of `0.25–0.75` (far fewer candidate boxes through NMS) moves realized throughput toward the core-throughput ceiling.
279
 
280
  See [EdgeFirst Studio](https://edgefirst.studio) for the full validation pipeline.
281
 
@@ -285,19 +310,137 @@ See [EdgeFirst Studio](https://edgefirst.studio) for the full validation pipelin
285
 
286
  Artifacts are organized by deployment target. Each model file embeds the EdgeFirst `edgefirst.json` metadata (training session, dataset version, calibration artifact, converter chain) so a single file is sufficient for deployment — no sidecar configuration required.
287
 
288
- Browse and download every artifact from the **[repository file tree](https://huggingface.co/EdgeFirst/yolov5-det/tree/main)**. Files are organized into per-target folders and follow the naming convention `yolov5{size}-det-{precision}[-smart]{extension}`:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
289
 
290
- | Target | Folder | Format |
291
- |--------|--------|--------|
292
- | ONNX FP32 | `onnx/` | `.onnx` |
293
- | TFLite INT8 | `tflite/` | `.tflite` |
294
- | NXP i.MX 95 (eIQ Neutron) | `imx95/` | `.imx95.tflite` |
295
- | NXP Ara240 | `ara240/` | `.dvm` |
296
- | RPi5 + Hailo-8L (13 TOPS) | `hailo/` | `.hailo8l.hef` |
297
- | NVIDIA Jetson (TensorRT) | `jetson/` | `.engine` |
298
- | Snapdragon (Qualcomm Hexagon HTP) | `qnn/` | `.htp-v81.qnn.onnx` |
299
-
300
- Each file embeds its `edgefirst.json` metadata (training session, dataset version, calibration artifact, converter chain), so a single download is sufficient for deployment — no sidecar configuration required.
301
 
302
  ---
303
 
 
25
  metrics:
26
  - name: "mAP@0.5 (Nano ONNX FP32)"
27
  type: map_50
28
+ value: 48.76
29
  - name: "mAP@0.5-0.95 (Nano ONNX FP32)"
30
  type: map
31
+ value: 33.73
32
  - name: "mAP@0.5 (Small ONNX FP32)"
33
  type: map_50
34
+ value: 58.64
35
  - name: "mAP@0.5-0.95 (Small ONNX FP32)"
36
  type: map
37
+ value: 42.2
38
  - name: "mAP@0.5 (Medium ONNX FP32)"
39
  type: map_50
40
+ value: 64.67
41
  - name: "mAP@0.5-0.95 (Medium ONNX FP32)"
42
  type: map
43
+ value: 48.12
44
  ---
45
 
46
  # YOLOv5 Detection — EdgeFirst Model Zoo
 
56
  Part of the [EdgeFirst Model Zoo](https://huggingface.co/spaces/EdgeFirst/Models). New here? **[Introducing the EdgeFirst Model Zoo](https://huggingface.co/blog/EdgeFirst/model-zoo-intro)** covers what is in the zoo, why every figure links to its validation session, and how to reproduce any of it on your own hardware. Want a platform, model or task we don't cover yet? [Vote on what we measure next](https://github.com/orgs/EdgeFirstAI/discussions/categories/polls).
57
 
58
  > [!TIP]
59
+ > **Training experiment**: [View on EdgeFirst Studio](https://edgefirst.studio/public/p-694/exp-be2/trainings) — dataset, training configuration, metrics, and exported artifacts.
60
+ > Rows badged **2026 Q2** come from the [2026 Q2 training experiment](https://edgefirst.studio/public/p-694/exp-841/trainings), whose weights the repository's `2026Q2` tag holds.
61
 
62
  > [!NOTE]
63
  > Legacy architecture, wide deployment base.
 
70
 
71
  | Size | Params | GFLOPs | mAP@0.5 | mAP@0.5-0.95 | mAP@0.75 | Source |
72
  |------|--------|--------|---------|--------------|----------|--------|
73
+ | Nano | 1.9M | 4.5 | 48.76% | 33.73% | 36.64% | [v-1921](https://edgefirst.studio/public/validation/v-1921/details?mode=charts) |
74
+ | Small | 7.2M | 16.5 | 58.64% | 42.20% | 45.69% | [v-1923](https://edgefirst.studio/public/validation/v-1923/details?mode=charts) |
75
+ | Medium | 21.2M | 49.0 | 64.67% | 48.12% | 52.75% | [v-1924](https://edgefirst.studio/public/validation/v-1924/details?mode=charts) |
76
  | Large | 46.5M | 109.1 | — | — | — | — |
77
  | XLarge | 86.7M | 205.7 | — | — | — | — |
78
 
 
86
 
87
  | Source | Nano mAP@0.5:0.95 | What it measures |
88
  |--------|-------------------|------------------|
89
+ | **EdgeFirst (this zoo)** | 33.73% | Full deployment path — fixed-input ONNX + `pycocotools` |
90
  | Ultralytics-validator proxy | 33.71% | Portable re-implementation of the Ultralytics validator |
91
  | Ultralytics (official) | 34.3% | Ultralytics' published COCO figure |
92
 
 
103
  - **Rows whose `Δ` cell reads `ref`** are the float reference runs each quantized/compiled measurement is graded against.
104
  - **Rows without a number** under the metric columns are validation sessions currently in progress, or a session not yet linked to its ONNX FP32 reference. The Studio Source link tracks the current status.
105
  - **Rows whose `Δ vs FP32` cell carries a ⚠** are below our accuracy expectations for that platform (more than 10 percentage points under the float reference). The numbers are real measurements on real hardware, reproducible from the linked Studio session, and we publish them as-is; we are investigating the results to make improvements, and the next snapshot of this card will reflect any recovered accuracy.
106
+ - **Edition badges.** A Source cell such as `v-XXXX · 2026 Q2` marks a result carried from an earlier EdgeFirst Perception Index edition: this configuration was not re-measured on the current weights, so the row keeps the measurement, Studio session and model artifact of the edition that produced it. Rows without a badge come from the current edition.
107
  - **Precision** varies by target: the ONNX reference rows are FP32; macOS CoreML and NVIDIA Jetson TensorRT run FP16; the NXP i.MX 8M Plus, NXP i.MX 95 Neutron, and Hailo NPUs run INT8. The NXP Ara240 DNPU runs a **mixed INT8/INT16** scheme — most of the model is INT8, with the box-regression path (and the ops feeding it) promoted to INT16 to improve localization accuracy.
108
  - **Decoder variants.** EdgeFirst ships three INT8 split-decoders — **smart**, **logical**, and **combined** (described under *Decode* below). Every one we have measured is listed; none is headlined over another, because which one wins is a property of the target, not of the variant. Full converter documentation: [EdgeFirst model conversion](https://doc.edgefirst.ai/latest/models/conversion/) — these are the converters used by this Model Zoo and the EdgeFirst Performance Index report.
109
  - **Runtime.** Which inference stack executed the model. It is a column of its own because one accelerator can be reached by more than one: on Qualcomm Hexagon HTP, `ONNX · QNN EP` is an ONNX Runtime EPContext binary while `LiteRT` is the LiteRT + QNN delegate path, and the two produce measurably different pipelines from the same weights on the same silicon. Compare rows that share a size, platform, precision, and decode to read that difference directly.
110
  - **Decode.** What the exported graph emits, and therefore what your application has to do with it. **Logical** keeps the head's outputs separate and named — boxes, scores, and for segmentation the mask prototypes and coefficients — so reading them needs no decoder beyond taking the tensors as they come. **Smart** cuts the graph further upstream, at a point chosen by dynamic range and sliceability: the operations that quantize worst are lifted out of the model and run outside it, which is what recovers the accuracy, and which is why it needs a decoder implementing that cut (in EdgeFirst deployments, the HAL provides it). **Combined** fuses the decode into the quantized graph — the standard upstream export. It is the least accurate of the three by construction, and the EdgeFirst converters do not emit it for quantized targets; rows appear only where one was measured. Compare rows sharing a size and platform to see what the cut buys on your target — on detection it is often small, on quantized segmentation masks it is usually decisive. A `—` means the run carries no quantized decode split at all (float ONNX / TensorRT / CoreML).
111
  - **Rows are not ranked.** Where a size and platform appear more than once, the rows are competing configurations — a different runtime, precision, decode variant, pipeline mode, or board — not duplicates. Only genuinely repeated measurements of the *same* configuration are collapsed, newest first.
112
+ - **Platform-label suffixes.** `(EVK)` / `(FRDM)` / `(Phytec)` / `(Verdin)` / `(Ezurio)` name the NXP i.MX development board a session ran on. `— latency` / `— throughput` mark the two pipeline configurations the NXP i.MX 95 Neutron and NXP Ara240 targets run: the **latency** pipeline runs inference serially for the lowest per-frame latency; the **throughput** pipeline runs multiple inference workers for the highest FPS, which raises per-frame latency in exchange. Rows with neither suffix run a single pipeline.
113
+ - **End-to-end (ms)** is the per-image latency from the moment a frame is available to the moment its results are ready: preprocess → inference → postprocess. Image acquisition (camera capture, or file load and JPEG decode), mask encoding and writing results to disk are excluded.
114
+ - **Realized FPS** is the *measured* steady-state throughput — the rate at which final results are actually delivered over the full validation pipeline. It normally exceeds `1000 / end-to-end` because the runtime overlaps stages across frames. Validation runs decode a JPEG per image and evaluate at a `0.001` confidence threshold to capture every detection for mAP; a live camera pipeline at a deployment threshold of `0.25–0.75` carries a lighter host and postprocess load.
115
+
116
+ | Size | Platform | Runtime | Decode | mAP@0.5 | Δ vs FP32 (pp) | mAP@0.5-0.95 | End-to-end (ms) | Realized FPS | Source |
117
+ |------|----------|---------|--------|---------|----------------|--------------|-----------------|--------------|--------|
118
+ | Nano | ONNX FP32 (AWS Graviton · 4-core) | ONNX | — | 47.74% | -0.01 | 32.94% | 349.89 | 11.5 | [v-e53](https://edgefirst.studio/public/validation/v-e53/details?mode=charts) · 2026 Q2 |
119
+ | Nano | ONNX FP32 (AWS Graviton4 · 48-core) | ONNX | — | 47.74% | -0.01 | 32.94% | 82.63 | 168.7 | [v-e59](https://edgefirst.studio/public/validation/v-e59/details?mode=charts) · 2026 Q2 |
120
+ | Nano | ONNX FP32 (AWS Graviton4 · 8-core) | ONNX | — | 47.74% | -0.01 | 32.94% | 217.32 | 36.9 | [v-e56](https://edgefirst.studio/public/validation/v-e56/details?mode=charts) · 2026 Q2 |
121
+ | Nano | ONNX FP32 (Intel Core i9-13900F · 32-core) | ONNX | — | 47.76% | +0.01 | 32.95% | 40.89 | 80.1 | [v-a45](https://edgefirst.studio/public/validation/v-a45/details?mode=charts) · 2026 Q2 |
122
+ | Nano | ONNX FP32 (Intel Xeon Platinum 8488C · 24-core) | ONNX | — | 47.75% | +0.00 | 32.95% | 84.28 | 159.4 | [v-e5b](https://edgefirst.studio/public/validation/v-e5b/details?mode=charts) · 2026 Q2 |
123
+ | Nano | ONNX FP32 (Intel Xeon Platinum 8488C · 4-core) | ONNX | — | 47.76% | +0.01 | 32.95% | 154.69 | 51.2 | [v-e58](https://edgefirst.studio/public/validation/v-e58/details?mode=charts) · 2026 Q2 |
124
+ | Nano | ONNX FP32 (CUDA · A10G) | ONNX | — | 47.75% | ref | 32.95% | 11.30 | 328.9 | [v-e61](https://edgefirst.studio/public/validation/v-e61/details?mode=charts) · 2026 Q2 |
125
+ | Nano | ONNX FP32 (CUDA · RTX 4060) | ONNX | — | 47.75% | +0.00 | 32.95% | 10.24 | 357.8 | [v-a87](https://edgefirst.studio/public/validation/v-a87/details?mode=charts) · 2026 Q2 |
126
+ | Nano | ONNX FP16 (CUDA · RTX 4060) | ONNX | — | 47.75% | +0.00 | 32.93% | 8.74 | 456.8 | [v-a9c](https://edgefirst.studio/public/validation/v-a9c/details?mode=charts) · 2026 Q2 |
127
+ | Nano | ONNX FP32 (CUDA · RTX 3090) | ONNX | — | 48.76% | ref | 33.73% | 11.76 | 364.8 | [v-1921](https://edgefirst.studio/public/validation/v-1921/details?mode=charts) |
128
+ | Nano | ONNX FP16 (CUDA · RTX 3090) | ONNX | — | 48.75% | -0.01 | 33.70% | 8.89 | 515.5 | [v-1997](https://edgefirst.studio/public/validation/v-1997/details?mode=charts) |
129
+ | Nano | TFLite INT8 (Intel Xeon Platinum 8488C · 24-core) | LiteRT | Combined | 45.14% | -2.61 | 29.98% | 186.42 | 60.8 | [v-10f4](https://edgefirst.studio/public/validation/v-10f4/details?mode=charts) · 2026 Q2 |
130
+ | Nano | TFLite INT8 (Intel Xeon Platinum 8488C · 4-core) | LiteRT | Combined | 45.15% | -2.60 | 29.98% | 287.39 | 27.7 | [v-10dd](https://edgefirst.studio/public/validation/v-10dd/details?mode=charts) · 2026 Q2 |
131
+ | Nano | TFLite INT8 (AWS Graviton4 · 48-core) | LiteRT | Combined | 45.13% | -2.62 | 30.03% | 82.46 | 167.9 | [v-10ea](https://edgefirst.studio/public/validation/v-10ea/details?mode=charts) · 2026 Q2 |
132
+ | Nano | TFLite INT8 (AWS Graviton4 · 8-core) | LiteRT | Combined | 45.11% | -2.64 | 30.01% | 165.85 | 47.9 | [v-10e6](https://edgefirst.studio/public/validation/v-10e6/details?mode=charts) · 2026 Q2 |
133
+ | Nano | Apple M2 Max — CoreML Neural Engine (FP16) | ONNX | — | 47.12% | -0.63 | 32.42% | 2.90 | 862.2 | [v-baf](https://edgefirst.studio/public/validation/v-baf/details?mode=charts) · 2026 Q2 |
134
+ | Nano | Apple M2 Max — CoreML Metal GPU (FP16) | ONNX | — | 47.16% | -0.59 | 32.45% | 6.87 | 477.4 | [v-9cb](https://edgefirst.studio/public/validation/v-9cb/details?mode=charts) · 2026 Q2 |
135
+ | Nano | Apple M2 Max — CoreML CPU (FP16) | ONNX | — | 47.14% | -0.61 | 32.43% | 16.96 | 121.3 | [v-9cc](https://edgefirst.studio/public/validation/v-9cc/details?mode=charts) · 2026 Q2 |
136
+ | Nano | Apple iPhone 17 Pro — CoreML Neural Engine (FP16) | ONNX | — | 47.13% | -0.62 | 32.42% | 3.08 | 825.8 | [v-f49](https://edgefirst.studio/public/validation/v-f49/details?mode=charts) · 2026 Q2 |
137
+ | Nano | Apple iPhone 17 Pro — CoreML Metal GPU (FP16) | ONNX | — | 47.16% | -0.59 | 32.45% | 5.76 | 390.3 | [v-f44](https://edgefirst.studio/public/validation/v-f44/details?mode=charts) · 2026 Q2 |
138
+ | Nano | Apple iPhone 17 Pro — CoreML CPU (FP16) | ONNX | — | 47.14% | -0.61 | 32.42% | 16.38 | 127.4 | [v-f2e](https://edgefirst.studio/public/validation/v-f2e/details?mode=charts) · 2026 Q2 |
139
+ | Nano | Apple iPhone 15 Pro — CoreML Neural Engine (FP16) | ONNX | — | 47.14% | -0.61 | 32.42% | 4.17 | 630.1 | [v-f0a](https://edgefirst.studio/public/validation/v-f0a/details?mode=charts) · 2026 Q2 |
140
+ | Nano | Apple iPhone 15 Pro — CoreML Metal GPU (FP16) | ONNX | — | 47.16% | -0.59 | 32.45% | 13.67 | 152.6 | [v-f09](https://edgefirst.studio/public/validation/v-f09/details?mode=charts) · 2026 Q2 |
141
+ | Nano | Apple iPhone 15 Pro — CoreML CPU (FP16) | ONNX | — | 47.14% | -0.61 | 32.42% | 19.05 | 110.1 | [v-f08](https://edgefirst.studio/public/validation/v-f08/details?mode=charts) · 2026 Q2 |
142
+ | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 46.70% | -1.05 | 31.87% | 10.83 | 274.2 | [v-1058](https://edgefirst.studio/public/validation/v-1058/details?mode=charts) · 2026 Q2 |
143
+ | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 44.60% | -3.15 | 29.46% | 3.65 | 745.9 | [v-105a](https://edgefirst.studio/public/validation/v-105a/details?mode=charts) · 2026 Q2 |
144
+ | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 47.70% | -0.05 | 32.73% | 13.26 | 243.1 | [v-1051](https://edgefirst.studio/public/validation/v-1051/details?mode=charts) · 2026 Q2 |
145
+ | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Logical | 46.93% | -0.82 | 31.89% | 8.97 | 359.2 | [v-1055](https://edgefirst.studio/public/validation/v-1055/details?mode=charts) · 2026 Q2 |
146
+ | Nano | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | LiteRT | Smart | 47.04% | -0.71 | 32.20% | 13.87 | 233.4 | [v-1052](https://edgefirst.studio/public/validation/v-1052/details?mode=charts) · 2026 Q2 |
147
+ | Nano | Samsung Galaxy S26 Ultra — CPU | LiteRT | Smart | 46.90% | -0.85 | 32.21% | 86.24 | 74.7 | [v-1053](https://edgefirst.studio/public/validation/v-1053/details?mode=charts) · 2026 Q2 |
148
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (Ezurio) — latency | LiteRT | Logical | 46.27% | -2.49 | 30.74% | 288.44 | 4.5 | [v-14ed](https://edgefirst.studio/public/validation/v-14ed/details?mode=charts) |
149
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Combined | 46.27% | -2.49 | 30.74% | 75.71 | 13.7 | [v-14d7](https://edgefirst.studio/public/validation/v-14d7/details?mode=charts) |
150
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Logical | 46.27% | -2.49 | 30.74% | 75.59 | 13.7 | [v-14f6](https://edgefirst.studio/public/validation/v-14f6/details?mode=charts) |
151
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Smart | 47.71% | -1.05 | 32.94% | 87.41 | 14.9 | [v-150c](https://edgefirst.studio/public/validation/v-150c/details?mode=charts) |
152
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (Phytec) — latency | LiteRT | Logical | 46.12% | -2.64 | 30.70% | 75.46 | 15.0 | [v-14ef](https://edgefirst.studio/public/validation/v-14ef/details?mode=charts) |
153
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — latency | LiteRT | Logical | 46.27% | -2.49 | 30.74% | 76.31 | 13.6 | [v-14f3](https://edgefirst.studio/public/validation/v-14f3/details?mode=charts) |
154
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Ezurio) — latency | LiteRT | Smart | 46.74% | -2.02 | 31.96% | 31.22 | 65.2 | [v-14ce](https://edgefirst.studio/public/validation/v-14ce/details?mode=charts) |
155
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Ezurio) — throughput | LiteRT | Smart | 46.74% | -2.02 | 31.96% | 54.69 | 87.8 | [v-18af](https://edgefirst.studio/public/validation/v-18af/details?mode=charts) |
156
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Smart | 46.84% | -1.92 | 31.95% | 31.41 | 62.0 | [v-1505](https://edgefirst.studio/public/validation/v-1505/details?mode=charts) |
157
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Logical | 45.41% | -3.35 | 29.95% | 45.96 | 24.0 | [v-14ee](https://edgefirst.studio/public/validation/v-14ee/details?mode=charts) |
158
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Combined | 45.42% | -3.34 | 29.95% | 48.07 | 22.8 | [v-14d2](https://edgefirst.studio/public/validation/v-14d2/details?mode=charts) |
159
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Smart | 46.84% | -1.92 | 31.95% | 54.27 | 88.6 | [v-150a](https://edgefirst.studio/public/validation/v-150a/details?mode=charts) |
160
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (EVK) �� throughput | LiteRT | Logical | 45.41% | -3.35 | 29.95% | 60.99 | 73.5 | [v-14fe](https://edgefirst.studio/public/validation/v-14fe/details?mode=charts) |
161
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Combined | 45.42% | -3.34 | 29.95% | 57.66 | 79.8 | [v-14e7](https://edgefirst.studio/public/validation/v-14e7/details?mode=charts) |
162
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Phytec) — throughput | LiteRT | Smart | 46.84% | -1.92 | 31.95% | 53.11 | 88.4 | [v-14d0](https://edgefirst.studio/public/validation/v-14d0/details?mode=charts) |
163
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Smart | 46.74% | -2.02 | 31.96% | 32.72 | 62.3 | [v-14d4](https://edgefirst.studio/public/validation/v-14d4/details?mode=charts) |
164
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Logical | 44.44% | -3.31 | 29.26% | 45.60 | 24.5 | [v-bc7](https://edgefirst.studio/public/validation/v-bc7/details?mode=charts) · 2026 Q2 |
165
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — throughput | LiteRT | Smart | 46.74% | -2.02 | 31.96% | 54.44 | 83.5 | [v-18b2](https://edgefirst.studio/public/validation/v-18b2/details?mode=charts) |
166
+ | Nano | NXP Ara240 (FRDM) — latency | Ara DVM | Smart | 46.61% | -2.15 | 31.31% | 18.07 | 92.0 | [v-14cf](https://edgefirst.studio/public/validation/v-14cf/details?mode=charts) |
167
+ | Nano | NXP Ara240 (FRDM) — throughput | Ara DVM | Smart | 46.61% | -2.15 | 31.31% | 14.55 | 193.9 | [v-18b0](https://edgefirst.studio/public/validation/v-18b0/details?mode=charts) |
168
+ | Nano | Raspberry Pi 5 + Hailo-8L NPU | Hailo HEF | — | 46.45% | -2.31 | 31.97% | 19.57 | 66.6 | [v-1497](https://edgefirst.studio/public/validation/v-1497/details?mode=charts) |
169
+ | Nano | NVIDIA Jetson Orin Nano (TensorRT FP16) | TensorRT | — | 48.74% | -0.02 | 33.70% | 24.83 | 266.9 | [v-173a](https://edgefirst.studio/public/validation/v-173a/details?mode=charts) |
170
+ | Nano | NVIDIA Jetson Orin Nano (TensorRT INT8) | TensorRT | — | 47.70% | -1.06 | 32.71% | 23.34 | 278.9 | [v-173b](https://edgefirst.studio/public/validation/v-173b/details?mode=charts) |
171
+ | Nano | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 47.23% | -1.53 | 32.28% | 10.11 | 303.5 | [v-14d8](https://edgefirst.studio/public/validation/v-14d8/details?mode=charts) |
172
+ | Nano | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 46.54% | -2.22 | 30.77% | 7.78 | 606.6 | [v-14d5](https://edgefirst.studio/public/validation/v-14d5/details?mode=charts) |
173
+ | Nano | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 48.70% | -0.06 | 33.69% | 16.95 | 241.9 | [v-14d9](https://edgefirst.studio/public/validation/v-14d9/details?mode=charts) |
174
+ | Small | ONNX FP32 (AWS Graviton · 4-core) | ONNX | — | 57.29% | -0.04 | 41.22% | 695.50 | 5.8 | [v-e54](https://edgefirst.studio/public/validation/v-e54/details?mode=charts) · 2026 Q2 |
175
+ | Small | ONNX FP32 (AWS Graviton4 · 8-core) | ONNX | — | 57.29% | -0.04 | 41.23% | 567.20 | 14.1 | [v-e71](https://edgefirst.studio/public/validation/v-e71/details?mode=charts) · 2026 Q2 |
176
+ | Small | ONNX FP32 (AWS Graviton4 · 48-core) | ONNX | — | 57.29% | -0.04 | 41.23% | 194.87 | 68.0 | [v-e64](https://edgefirst.studio/public/validation/v-e64/details?mode=charts) · 2026 Q2 |
177
+ | Small | ONNX FP32 (Intel Core i9-13900F · 32-core) | ONNX | — | 57.32% | -0.01 | 41.26% | 89.17 | 33.6 | [v-a4c](https://edgefirst.studio/public/validation/v-a4c/details?mode=charts) · 2026 Q2 |
178
+ | Small | ONNX FP32 (Intel Xeon Platinum 8488C · 24-core) | ONNX | — | 57.33% | +0.00 | 41.26% | 169.92 | 80.1 | [v-e65](https://edgefirst.studio/public/validation/v-e65/details?mode=charts) · 2026 Q2 |
179
+ | Small | ONNX FP32 (Intel Xeon Platinum 8488C · 4-core) | ONNX | — | 57.33% | +0.00 | 41.26% | 307.98 | 25.9 | [v-e79](https://edgefirst.studio/public/validation/v-e79/details?mode=charts) · 2026 Q2 |
180
+ | Small | ONNX FP32 (CUDA · A10G) | ONNX | — | 57.33% | ref | 41.26% | 14.06 | 321.5 | [v-e74](https://edgefirst.studio/public/validation/v-e74/details?mode=charts) · 2026 Q2 |
181
+ | Small | ONNX FP32 (CUDA · RTX 4060) | ONNX | — | 57.33% | +0.00 | 41.26% | 16.47 | 224.0 | [v-a8e](https://edgefirst.studio/public/validation/v-a8e/details?mode=charts) · 2026 Q2 |
182
+ | Small | ONNX FP16 (CUDA · RTX 4060) | ONNX | — | 57.33% | +0.00 | 41.22% | 12.39 | 319.3 | [v-aa3](https://edgefirst.studio/public/validation/v-aa3/details?mode=charts) · 2026 Q2 |
183
+ | Small | ONNX FP32 (CUDA · RTX 3090) | ONNX | — | 58.64% | ref | 42.20% | 13.16 | 310.5 | [v-1923](https://edgefirst.studio/public/validation/v-1923/details?mode=charts) |
184
+ | Small | ONNX FP16 (CUDA · RTX 3090) | ONNX | — | 58.64% | +0.00 | 42.16% | 8.91 | 428.0 | [v-1998](https://edgefirst.studio/public/validation/v-1998/details?mode=charts) |
185
+ | Small | TFLite INT8 (Intel Xeon Platinum 8488C · 24-core) | LiteRT | Combined | 54.94% | -2.39 | 37.45% | 349.57 | 33.5 | [v-10fa](https://edgefirst.studio/public/validation/v-10fa/details?mode=charts) · 2026 Q2 |
186
+ | Small | TFLite INT8 (Intel Xeon Platinum 8488C · 4-core) | LiteRT | Combined | 54.94% | -2.39 | 37.45% | 684.15 | 11.6 | [v-10f3](https://edgefirst.studio/public/validation/v-10f3/details?mode=charts) · 2026 Q2 |
187
+ | Small | TFLite INT8 (AWS Graviton4 · 48-core) | LiteRT | Combined | 54.68% | -2.65 | 37.32% | 179.41 | 74.0 | [v-10ef](https://edgefirst.studio/public/validation/v-10ef/details?mode=charts) · 2026 Q2 |
188
+ | Small | TFLite INT8 (AWS Graviton4 · 8-core) | LiteRT | Combined | 54.68% | -2.65 | 37.32% | 427.54 | 18.7 | [v-10e9](https://edgefirst.studio/public/validation/v-10e9/details?mode=charts) · 2026 Q2 |
189
+ | Small | Apple M2 Max — CoreML Neural Engine (FP16) | ONNX | — | 56.72% | -0.61 | 40.68% | 5.48 | 394.1 | [v-9ea](https://edgefirst.studio/public/validation/v-9ea/details?mode=charts) · 2026 Q2 |
190
+ | Small | Apple M2 Max — CoreML Metal GPU (FP16) | ONNX | — | 56.75% | -0.58 | 40.76% | 15.04 | 205.1 | [v-9eb](https://edgefirst.studio/public/validation/v-9eb/details?mode=charts) · 2026 Q2 |
191
+ | Small | Apple M2 Max — CoreML CPU (FP16) | ONNX | — | 56.72% | -0.61 | 40.71% | 31.63 | 64.2 | [v-9ec](https://edgefirst.studio/public/validation/v-9ec/details?mode=charts) · 2026 Q2 |
192
+ | Small | Apple iPhone 17 Pro — CoreML Neural Engine (FP16) | ONNX | — | 56.72% | -0.61 | 40.70% | 6.12 | 350.8 | [v-f53](https://edgefirst.studio/public/validation/v-f53/details?mode=charts) · 2026 Q2 |
193
+ | Small | Apple iPhone 17 Pro — CoreML Metal GPU (FP16) | ONNX | — | 56.75% | -0.58 | 40.76% | 17.67 | 116.5 | [v-f4a](https://edgefirst.studio/public/validation/v-f4a/details?mode=charts) · 2026 Q2 |
194
+ | Small | Apple iPhone 17 Pro — CoreML CPU (FP16) | ONNX | — | 56.72% | -0.61 | 40.71% | 41.80 | 48.6 | [v-f36](https://edgefirst.studio/public/validation/v-f36/details?mode=charts) · 2026 Q2 |
195
+ | Small | Apple iPhone 15 Pro — CoreML Neural Engine (FP16) | ONNX | — | 56.72% | -0.61 | 40.69% | 8.82 | 247.0 | [v-f12](https://edgefirst.studio/public/validation/v-f12/details?mode=charts) · 2026 Q2 |
196
+ | Small | Apple iPhone 15 Pro — CoreML Metal GPU (FP16) | ONNX | — | 56.75% | -0.58 | 40.76% | 45.12 | 45.6 | [v-f1a](https://edgefirst.studio/public/validation/v-f1a/details?mode=charts) · 2026 Q2 |
197
+ | Small | Apple iPhone 15 Pro — CoreML CPU (FP16) | ONNX | — | 56.72% | -0.61 | 40.71% | 54.81 | 37.0 | [v-f1c](https://edgefirst.studio/public/validation/v-f1c/details?mode=charts) · 2026 Q2 |
198
+ | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 56.69% | -0.64 | 40.42% | 11.20 | 271.5 | [v-1061](https://edgefirst.studio/public/validation/v-1061/details?mode=charts) · 2026 Q2 |
199
+ | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 53.79% | -3.54 | 36.43% | 4.51 | 620.9 | [v-1064](https://edgefirst.studio/public/validation/v-1064/details?mode=charts) · 2026 Q2 |
200
+ | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 57.51% | +0.18 | 41.20% | 15.20 | 221.6 | [v-105c](https://edgefirst.studio/public/validation/v-105c/details?mode=charts) · 2026 Q2 |
201
+ | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Logical | 56.56% | -0.77 | 40.25% | 10.47 | 297.5 | [v-1060](https://edgefirst.studio/public/validation/v-1060/details?mode=charts) · 2026 Q2 |
202
+ | Small | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | LiteRT | Smart | 57.49% | +0.16 | 41.02% | 15.18 | 216.8 | [v-105d](https://edgefirst.studio/public/validation/v-105d/details?mode=charts) · 2026 Q2 |
203
+ | Small | Samsung Galaxy S26 Ultra — CPU | LiteRT | Smart | 57.29% | -0.04 | 40.93% | 179.47 | 35.2 | [v-1063](https://edgefirst.studio/public/validation/v-1063/details?mode=charts) · 2026 Q2 |
204
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (Ezurio) — latency | LiteRT | Logical | 55.81% | -2.83 | 38.20% | 351.60 | 4.3 | [v-1568](https://edgefirst.studio/public/validation/v-1568/details?mode=charts) |
205
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Combined | 55.81% | -2.83 | 38.20% | 126.86 | 8.0 | [v-1520](https://edgefirst.studio/public/validation/v-1520/details?mode=charts) |
206
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Logical | 55.81% | -2.83 | 38.20% | 126.65 | 8.0 | [v-1555](https://edgefirst.studio/public/validation/v-1555/details?mode=charts) |
207
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Smart | 57.97% | -0.67 | 41.52% | 138.12 | 8.4 | [v-157b](https://edgefirst.studio/public/validation/v-157b/details?mode=charts) |
208
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (Phytec) — latency | LiteRT | Logical | 55.86% | -2.78 | 38.15% | 127.83 | 8.4 | [v-152a](https://edgefirst.studio/public/validation/v-152a/details?mode=charts) |
209
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — latency | LiteRT | Logical | 55.81% | -2.83 | 38.20% | 128.20 | 7.9 | [v-1535](https://edgefirst.studio/public/validation/v-1535/details?mode=charts) |
210
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — throughput | LiteRT | Smart | 56.87% | -0.46 | 40.69% | 148.14 | 8.2 | [v-c8a](https://edgefirst.studio/public/validation/v-c8a/details?mode=charts) · 2026 Q2 |
211
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (Ezurio) — latency | LiteRT | Smart | 57.79% | -0.85 | 41.23% | 49.17 | 33.1 | [v-14e3](https://edgefirst.studio/public/validation/v-14e3/details?mode=charts) |
212
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (Ezurio) — throughput | LiteRT | Smart | 57.79% | -0.85 | 41.23% | 127.57 | 36.8 | [v-18b4](https://edgefirst.studio/public/validation/v-18b4/details?mode=charts) |
213
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Smart | 57.67% | -0.97 | 41.20% | 51.35 | 33.2 | [v-1559](https://edgefirst.studio/public/validation/v-1559/details?mode=charts) |
214
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Logical | 55.56% | -3.08 | 37.84% | 65.06 | 16.4 | [v-152f](https://edgefirst.studio/public/validation/v-152f/details?mode=charts) |
215
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Combined | 55.55% | -3.09 | 37.84% | 67.92 | 15.6 | [v-150e](https://edgefirst.studio/public/validation/v-150e/details?mode=charts) |
216
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Smart | 57.67% | -0.97 | 41.20% | 129.56 | 36.7 | [v-1569](https://edgefirst.studio/public/validation/v-1569/details?mode=charts) |
217
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Logical | 55.56% | -3.08 | 37.84% | 115.54 | 35.5 | [v-1547](https://edgefirst.studio/public/validation/v-1547/details?mode=charts) |
218
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Combined | 55.55% | -3.09 | 37.84% | 114.95 | 36.6 | [v-1522](https://edgefirst.studio/public/validation/v-1522/details?mode=charts) |
219
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (Phytec) — throughput | LiteRT | Smart | 57.67% | -0.97 | 41.20% | 129.64 | 36.7 | [v-14dc](https://edgefirst.studio/public/validation/v-14dc/details?mode=charts) |
220
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Smart | 57.79% | -0.85 | 41.23% | 50.58 | 32.9 | [v-14e4](https://edgefirst.studio/public/validation/v-14e4/details?mode=charts) |
221
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Logical | 54.52% | -2.81 | 37.10% | 65.98 | 16.3 | [v-bd5](https://edgefirst.studio/public/validation/v-bd5/details?mode=charts) · 2026 Q2 |
222
+ | Small | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — throughput | LiteRT | Smart | 57.79% | -0.85 | 41.23% | 129.02 | 36.4 | [v-18b5](https://edgefirst.studio/public/validation/v-18b5/details?mode=charts) |
223
+ | Small | NXP Ara240 (FRDM) — latency | Ara DVM | Smart | 56.58% | -2.06 | 39.33% | 23.69 | 62.4 | [v-1498](https://edgefirst.studio/public/validation/v-1498/details?mode=charts) |
224
+ | Small | NXP Ara240 (FRDM) — throughput | Ara DVM | Smart | 56.56% | -2.08 | 39.31% | 17.92 | 95.7 | [v-18b3](https://edgefirst.studio/public/validation/v-18b3/details?mode=charts) |
225
+ | Small | Raspberry Pi 5 + Hailo-8L NPU | Hailo HEF | — | 57.30% | -1.34 | 40.99% | 35.80 | 32.1 | [v-14a2](https://edgefirst.studio/public/validation/v-14a2/details?mode=charts) |
226
+ | Small | NVIDIA Jetson Orin Nano (TensorRT FP16) | TensorRT | — | 58.64% | +0.00 | 42.15% | 28.75 | 173.7 | [v-1511](https://edgefirst.studio/public/validation/v-1511/details?mode=charts) |
227
+ | Small | NVIDIA Jetson Orin Nano (TensorRT INT8) | TensorRT | — | 57.50% | -1.14 | 41.06% | 24.73 | 240.5 | [v-1514](https://edgefirst.studio/public/validation/v-1514/details?mode=charts) |
228
+ | Small | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 58.12% | -0.52 | 41.59% | 10.99 | 312.2 | [v-14e0](https://edgefirst.studio/public/validation/v-14e0/details?mode=charts) |
229
+ | Small | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 56.34% | -2.30 | 38.65% | 8.20 | 461.4 | [v-14de](https://edgefirst.studio/public/validation/v-14de/details?mode=charts) |
230
+ | Small | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 58.65% | +0.01 | 42.19% | 19.14 | 203.7 | [v-14e2](https://edgefirst.studio/public/validation/v-14e2/details?mode=charts) |
231
+ | Medium | ONNX FP32 (AWS Graviton · 4-core) | ONNX | — | 63.30% | +0.01 | 47.00% | 1703.17 | 2.4 | [v-e55](https://edgefirst.studio/public/validation/v-e55/details?mode=charts) · 2026 Q2 |
232
+ | Medium | ONNX FP32 (AWS Graviton4 · 8-core) | ONNX | — | 63.30% | +0.01 | 47.00% | 1419.20 | 5.6 | [v-e73](https://edgefirst.studio/public/validation/v-e73/details?mode=charts) · 2026 Q2 |
233
+ | Medium | ONNX FP32 (AWS Graviton4 · 48-core) | ONNX | — | 63.30% | +0.01 | 47.00% | 467.75 | 27.7 | [v-e6b](https://edgefirst.studio/public/validation/v-e6b/details?mode=charts) · 2026 Q2 |
234
+ | Medium | ONNX FP32 (Intel Core i9-13900F · 32-core) | ONNX | — | 63.29% | +0.00 | 46.99% | 207.52 | 14.1 | [v-a53](https://edgefirst.studio/public/validation/v-a53/details?mode=charts) · 2026 Q2 |
235
+ | Medium | ONNX FP32 (Intel Xeon Platinum 8488C · 24-core) | ONNX | — | 63.29% | +0.00 | 46.99% | 380.60 | 34.1 | [v-e6a](https://edgefirst.studio/public/validation/v-e6a/details?mode=charts) · 2026 Q2 |
236
+ | Medium | ONNX FP32 (Intel Xeon Platinum 8488C · 4-core) | ONNX | — | 63.29% | +0.00 | 46.99% | 939.29 | 8.5 | [v-e7a](https://edgefirst.studio/public/validation/v-e7a/details?mode=charts) · 2026 Q2 |
237
+ | Medium | ONNX FP32 (CUDA · A10G) | ONNX | — | 63.29% | ref | 46.99% | 25.24 | 176.2 | [v-e88](https://edgefirst.studio/public/validation/v-e88/details?mode=charts) · 2026 Q2 |
238
+ | Medium | ONNX FP32 (CUDA · RTX 4060) | ONNX | — | 63.29% | +0.00 | 46.99% | 37.25 | 97.0 | [v-a95](https://edgefirst.studio/public/validation/v-a95/details?mode=charts) · 2026 Q2 |
239
+ | Medium | ONNX FP16 (CUDA · RTX 4060) | ONNX | — | 63.27% | -0.02 | 46.94% | 23.27 | 166.1 | [v-aaa](https://edgefirst.studio/public/validation/v-aaa/details?mode=charts) · 2026 Q2 |
240
+ | Medium | ONNX FP32 (CUDA · RTX 3090) | ONNX | — | 64.67% | ref | 48.12% | 20.52 | 204.8 | [v-1924](https://edgefirst.studio/public/validation/v-1924/details?mode=charts) |
241
+ | Medium | ONNX FP16 (CUDA · RTX 3090) | ONNX | — | 64.66% | -0.01 | 48.07% | 12.15 | 265.5 | [v-199b](https://edgefirst.studio/public/validation/v-199b/details?mode=charts) |
242
+ | Medium | TFLite INT8 (Intel Xeon Platinum 8488C · 24-core) | LiteRT | Combined | 60.15% | -3.14 | 42.20% | 765.96 | 16.1 | [v-10fb](https://edgefirst.studio/public/validation/v-10fb/details?mode=charts) · 2026 Q2 |
243
+ | Medium | TFLite INT8 (Intel Xeon Platinum 8488C · 4-core) | LiteRT | Combined | 60.15% | -3.14 | 42.20% | 1715.24 | 4.6 | [v-10e0](https://edgefirst.studio/public/validation/v-10e0/details?mode=charts) · 2026 Q2 |
244
+ | Medium | TFLite INT8 (AWS Graviton4 · 48-core) | LiteRT | Combined | 60.16% | -3.13 | 42.34% | 403.03 | 32.3 | [v-10f0](https://edgefirst.studio/public/validation/v-10f0/details?mode=charts) · 2026 Q2 |
245
+ | Medium | TFLite INT8 (AWS Graviton4 · 8-core) | LiteRT | Combined | 60.15% | -3.14 | 42.33% | 1061.42 | 7.5 | [v-10eb](https://edgefirst.studio/public/validation/v-10eb/details?mode=charts) · 2026 Q2 |
246
+ | Medium | Apple M2 Max — CoreML Neural Engine (FP16) | ONNX | — | 62.78% | -0.51 | 46.53% | 12.73 | 162.2 | [v-75b](https://edgefirst.studio/public/validation/v-75b/details?mode=charts) · 2026 Q2 |
247
+ | Medium | Apple M2 Max — CoreML Metal GPU (FP16) | ONNX | — | 62.80% | -0.49 | 46.52% | 34.61 | 87.8 | [v-765](https://edgefirst.studio/public/validation/v-765/details?mode=charts) · 2026 Q2 |
248
+ | Medium | Apple M2 Max — CoreML CPU (FP16) | ONNX | — | 62.75% | -0.54 | 46.46% | 58.28 | 34.6 | [v-9dc](https://edgefirst.studio/public/validation/v-9dc/details?mode=charts) · 2026 Q2 |
249
+ | Medium | Apple iPhone 17 Pro — CoreML Neural Engine (FP16) | ONNX | — | 62.78% | -0.51 | 46.53% | 15.58 | 131.8 | [v-f59](https://edgefirst.studio/public/validation/v-f59/details?mode=charts) · 2026 Q2 |
250
+ | Medium | Apple iPhone 17 Pro — CoreML Metal GPU (FP16) | ONNX | — | 62.80% | -0.49 | 46.51% | 34.57 | 59.7 | [v-f54](https://edgefirst.studio/public/validation/v-f54/details?mode=charts) · 2026 Q2 |
251
+ | Medium | Apple iPhone 17 Pro — CoreML CPU (FP16) | ONNX | — | 62.75% | -0.54 | 46.45% | 94.65 | 21.3 | [v-f3d](https://edgefirst.studio/public/validation/v-f3d/details?mode=charts) · 2026 Q2 |
252
+ | Medium | Apple iPhone 15 Pro — CoreML Neural Engine (FP16) | ONNX | — | 62.78% | -0.51 | 46.54% | 19.63 | 104.7 | [v-f1b](https://edgefirst.studio/public/validation/v-f1b/details?mode=charts) · 2026 Q2 |
253
+ | Medium | Apple iPhone 15 Pro — CoreML Metal GPU (FP16) | ONNX | — | 62.80% | -0.49 | 46.51% | 119.70 | 17.0 | [v-f28](https://edgefirst.studio/public/validation/v-f28/details?mode=charts) · 2026 Q2 |
254
+ | Medium | Apple iPhone 15 Pro — CoreML CPU (FP16) | ONNX | — | 62.75% | -0.54 | 46.46% | 123.56 | 16.3 | [v-f29](https://edgefirst.studio/public/validation/v-f29/details?mode=charts) · 2026 Q2 |
255
+ | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 62.86% | -0.43 | 46.44% | 12.75 | 265.0 | [v-106b](https://edgefirst.studio/public/validation/v-106b/details?mode=charts) · 2026 Q2 |
256
+ | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 59.41% | -3.88 | 41.50% | 7.86 | 326.4 | [v-106d](https://edgefirst.studio/public/validation/v-106d/details?mode=charts) · 2026 Q2 |
257
+ | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 63.51% | +0.22 | 47.08% | 22.35 | 155.0 | [v-1066](https://edgefirst.studio/public/validation/v-1066/details?mode=charts) · 2026 Q2 |
258
+ | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT16) | ONNX · QNN EP | Logical | 62.53% | -0.76 | 46.05% | 16.91 | 158.0 | [v-1069](https://edgefirst.studio/public/validation/v-1069/details?mode=charts) · 2026 Q2 |
259
+ | Medium | Samsung Galaxy S26 Ultra — Qualcomm Hexagon NPU (INT8) | LiteRT | Smart | 63.21% | -0.08 | 46.75% | 22.49 | 134.2 | [v-1067](https://edgefirst.studio/public/validation/v-1067/details?mode=charts) · 2026 Q2 |
260
+ | Medium | Samsung Galaxy S26 Ultra — CPU | LiteRT | Smart | 63.35% | +0.06 | 46.79% | 371.09 | 16.6 | [v-1076](https://edgefirst.studio/public/validation/v-1076/details?mode=charts) · 2026 Q2 |
261
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (Ezurio) — latency | LiteRT | Logical | 61.05% | -3.62 | 42.95% | 474.57 | 3.9 | [v-15e3](https://edgefirst.studio/public/validation/v-15e3/details?mode=charts) |
262
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Combined | 61.05% | -3.62 | 42.95% | 224.11 | 4.5 | [v-1595](https://edgefirst.studio/public/validation/v-1595/details?mode=charts) |
263
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Logical | 61.05% | -3.62 | 42.95% | 223.79 | 4.5 | [v-15df](https://edgefirst.studio/public/validation/v-15df/details?mode=charts) |
264
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | LiteRT | Smart | 63.79% | -0.88 | 47.29% | 235.21 | 4.6 | [v-162e](https://edgefirst.studio/public/validation/v-162e/details?mode=charts) |
265
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (Phytec) — latency | LiteRT | Logical | 61.16% | -3.51 | 42.93% | 225.79 | 4.6 | [v-1594](https://edgefirst.studio/public/validation/v-1594/details?mode=charts) |
266
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — latency | LiteRT | Logical | 61.05% | -3.62 | 42.95% | 226.58 | 4.5 | [v-159e](https://edgefirst.studio/public/validation/v-159e/details?mode=charts) |
267
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (Verdin) — throughput | LiteRT | Smart | 62.79% | -0.50 | 46.34% | 246.43 | 4.5 | [v-c9c](https://edgefirst.studio/public/validation/v-c9c/details?mode=charts) · 2026 Q2 |
268
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (Ezurio) — latency | LiteRT | Smart | 63.91% | -0.76 | 47.41% | 95.49 | 14.1 | [v-14fb](https://edgefirst.studio/public/validation/v-14fb/details?mode=charts) |
269
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (Ezurio) — throughput | LiteRT | Smart | 63.91% | -0.76 | 47.41% | 293.96 | 14.7 | [v-18b9](https://edgefirst.studio/public/validation/v-18b9/details?mode=charts) |
270
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Smart | 63.89% | -0.78 | 47.26% | 91.71 | 14.0 | [v-15c9](https://edgefirst.studio/public/validation/v-15c9/details?mode=charts) |
271
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Logical | 61.13% | -3.54 | 43.02% | 106.83 | 9.7 | [v-1593](https://edgefirst.studio/public/validation/v-1593/details?mode=charts) |
272
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (EVK) — latency | LiteRT | Combined | 61.12% | -3.55 | 43.02% | 108.61 | 9.5 | [v-156e](https://edgefirst.studio/public/validation/v-156e/details?mode=charts) |
273
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Smart | 63.89% | -0.78 | 47.26% | 289.89 | 14.8 | [v-15e6](https://edgefirst.studio/public/validation/v-15e6/details?mode=charts) |
274
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Logical | 61.13% | -3.54 | 43.02% | 278.82 | 14.4 | [v-15ad](https://edgefirst.studio/public/validation/v-15ad/details?mode=charts) |
275
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (EVK) — throughput | LiteRT | Combined | 61.12% | -3.55 | 43.02% | 274.65 | 14.8 | [v-1586](https://edgefirst.studio/public/validation/v-1586/details?mode=charts) |
276
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (Phytec) — throughput | LiteRT | Smart | 63.89% | -0.78 | 47.26% | 290.62 | 14.8 | [v-14e9](https://edgefirst.studio/public/validation/v-14e9/details?mode=charts) |
277
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Smart | 63.91% | -0.76 | 47.41% | 98.55 | 14.1 | [v-14fd](https://edgefirst.studio/public/validation/v-14fd/details?mode=charts) |
278
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — latency | LiteRT | Logical | 59.97% | -3.32 | 42.12% | 110.05 | 9.5 | [v-be3](https://edgefirst.studio/public/validation/v-be3/details?mode=charts) · 2026 Q2 |
279
+ | Medium | NXP i.MX 95 + eIQ Neutron NPU (Verdin) — throughput | LiteRT | Smart | 63.91% | -0.76 | 47.41% | 296.28 | 14.8 | [v-18ba](https://edgefirst.studio/public/validation/v-18ba/details?mode=charts) |
280
+ | Medium | NXP Ara240 (FRDM) — latency | Ara DVM | Smart | 62.28% | -2.39 | 44.40% | 35.30 | 36.8 | [v-14a7](https://edgefirst.studio/public/validation/v-14a7/details?mode=charts) |
281
+ | Medium | NXP Ara240 (FRDM) — throughput | Ara DVM | Smart | 62.26% | -2.41 | 44.38% | 28.71 | 46.9 | [v-18b6](https://edgefirst.studio/public/validation/v-18b6/details?mode=charts) |
282
+ | Medium | Raspberry Pi 5 + Hailo-8L NPU | Hailo HEF | — | 63.63% | -1.04 | 47.17% | 66.58 | 16.2 | [v-14af](https://edgefirst.studio/public/validation/v-14af/details?mode=charts) |
283
+ | Medium | NVIDIA Jetson Orin Nano (TensorRT FP16) | TensorRT | — | 64.68% | +0.01 | 48.10% | 49.80 | 88.7 | [v-1517](https://edgefirst.studio/public/validation/v-1517/details?mode=charts) |
284
+ | Medium | NVIDIA Jetson Orin Nano (TensorRT INT8) | TensorRT | — | 63.68% | -0.99 | 47.13% | 37.04 | 126.5 | [v-151b](https://edgefirst.studio/public/validation/v-151b/details?mode=charts) |
285
+ | Medium | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT8) | ONNX · QNN EP | Smart | 64.22% | -0.45 | 47.54% | 16.75 | 277.5 | [v-14e8](https://edgefirst.studio/public/validation/v-14e8/details?mode=charts) |
286
+ | Medium | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT8) | ONNX · QNN EP | Logical | 61.37% | -3.30 | 42.84% | 9.90 | 267.1 | [v-14e6](https://edgefirst.studio/public/validation/v-14e6/details?mode=charts) |
287
+ | Medium | Qualcomm Dragonwing IQ-9075 — Hexagon NPU (INT16) | ONNX · QNN EP | Smart | 64.62% | -0.05 | 48.04% | 28.66 | 114.8 | [v-14ec](https://edgefirst.studio/public/validation/v-14ec/details?mode=charts) |
288
 
289
 
290
 
 
298
  2. **EdgeFirst Studio** receives the metrics, predictions, charts and trace, and publishes them as the `v-XXXX` validation session every row above cites. Studio is where results are published, compared and browsed — it is not where they are computed.
299
  3. **EdgeFirst HAL** ([open source](https://github.com/EdgeFirstAI/hal)) provides the hardware-accelerated preprocessing and post-decoding primitives used at both validation and deployment time, so the timings measured here reflect the same accelerated paths a production runtime would take.
300
 
301
+ End-to-end latency runs from the moment a frame is available to the moment its results are ready — preprocessing, inference, and postprocessing. Image acquisition (camera capture, or file load and JPEG decode), mask encoding and writing results to disk are excluded. The per-stage breakdown of every row is on its linked Studio session.
302
 
303
+ **Realized FPS** is the *measured* steady-state rate at which final results are emitted, measured directly from the profiler's per-frame result-emission timestamps over the steady-state stream — trace-independent; the Perfetto trace's own FPS is used only as a fallback on sessions where that scalar isn't available. It generally exceeds `1000 / end-to-end` because the runtime overlaps stages across frames.
304
 
305
  See [EdgeFirst Studio](https://edgefirst.studio) for the full validation pipeline.
306
 
 
310
 
311
  Artifacts are organized by deployment target. Each model file embeds the EdgeFirst `edgefirst.json` metadata (training session, dataset version, calibration artifact, converter chain) so a single file is sufficient for deployment — no sidecar configuration required.
312
 
313
+ Every file below is the artifact a validation session in the tables above measured. Files are organized into per-target folders and follow the naming convention `yolov5{size}-det-{precision}[-smart|-logical][-end2end]{extension}`.
314
+
315
+ Entries marked **2026 Q2** belong to rows carried from the 2026 Q2 edition: they download from the repository's `2026Q2` tag, the weights those rows were measured on. The same filename on `main` holds the current edition's artifact.
316
+
317
+ <details open>
318
+ <summary><strong>ONNX FP32</strong> — Any platform with ONNX Runtime.</summary>
319
+
320
+ | Size | File | Variant | Download |
321
+ |------|------|---------|----------|
322
+ | Nano | `onnx/yolov5n-det-fp16.onnx` | FP16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/onnx/yolov5n-det-fp16.onnx) |
323
+ | Nano | `onnx/yolov5n-det-fp16.onnx` | FP16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/onnx/yolov5n-det-fp16.onnx) |
324
+ | Nano | `onnx/yolov5n-det-fp32.onnx` | FP32 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/onnx/yolov5n-det-fp32.onnx) |
325
+ | Nano | `onnx/yolov5n-det-fp32.onnx` | FP32 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/onnx/yolov5n-det-fp32.onnx) |
326
+ | Small | `onnx/yolov5s-det-fp16.onnx` | FP16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/onnx/yolov5s-det-fp16.onnx) |
327
+ | Small | `onnx/yolov5s-det-fp16.onnx` | FP16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/onnx/yolov5s-det-fp16.onnx) |
328
+ | Small | `onnx/yolov5s-det-fp32.onnx` | FP32 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/onnx/yolov5s-det-fp32.onnx) |
329
+ | Small | `onnx/yolov5s-det-fp32.onnx` | FP32 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/onnx/yolov5s-det-fp32.onnx) |
330
+ | Medium | `onnx/yolov5m-det-fp16.onnx` | FP16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/onnx/yolov5m-det-fp16.onnx) |
331
+ | Medium | `onnx/yolov5m-det-fp16.onnx` | FP16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/onnx/yolov5m-det-fp16.onnx) |
332
+ | Medium | `onnx/yolov5m-det-fp32.onnx` | FP32 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/onnx/yolov5m-det-fp32.onnx) |
333
+ | Medium | `onnx/yolov5m-det-fp32.onnx` | FP32 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/onnx/yolov5m-det-fp32.onnx) |
334
+
335
+ </details>
336
+
337
+ <details>
338
+ <summary><strong>TFLite INT8</strong> — CPU or NPU via runtime delegate (NXP i.MX 8M Plus VX Delegate).</summary>
339
+
340
+ | Size | File | Variant | Download |
341
+ |------|------|---------|----------|
342
+ | Nano | `tflite/yolov5n-det-int8-smart.tflite` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/tflite/yolov5n-det-int8-smart.tflite) |
343
+ | Nano | `tflite/yolov5n-det-int8-smart.tflite` | Smart · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/tflite/yolov5n-det-int8-smart.tflite) |
344
+ | Nano | `tflite/yolov5n-det-int8.tflite` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/tflite/yolov5n-det-int8.tflite) |
345
+ | Small | `tflite/yolov5s-det-int8-smart.tflite` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/tflite/yolov5s-det-int8-smart.tflite) |
346
+ | Small | `tflite/yolov5s-det-int8-smart.tflite` | Smart · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/tflite/yolov5s-det-int8-smart.tflite) |
347
+ | Small | `tflite/yolov5s-det-int8.tflite` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/tflite/yolov5s-det-int8.tflite) |
348
+ | Medium | `tflite/yolov5m-det-int8-smart.tflite` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/tflite/yolov5m-det-int8-smart.tflite) |
349
+ | Medium | `tflite/yolov5m-det-int8-smart.tflite` | Smart · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/tflite/yolov5m-det-int8-smart.tflite) |
350
+ | Medium | `tflite/yolov5m-det-int8.tflite` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/tflite/yolov5m-det-int8.tflite) |
351
+
352
+ </details>
353
+
354
+ <details>
355
+ <summary><strong>NXP i.MX 95 (eIQ Neutron)</strong> — eIQ Neutron NPU optimized.</summary>
356
+
357
+ | Size | File | Variant | Download |
358
+ |------|------|---------|----------|
359
+ | Nano | `imx95/yolov5n-det-int8-smart.imx95.tflite` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/imx95/yolov5n-det-int8-smart.imx95.tflite) |
360
+ | Nano | `imx95/yolov5n-det-int8.imx95.tflite` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/imx95/yolov5n-det-int8.imx95.tflite) |
361
+ | Nano | `imx95/yolov5n-det-int8.imx95.tflite` | Logical · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/imx95/yolov5n-det-int8.imx95.tflite) |
362
+ | Small | `imx95/yolov5s-det-int8-smart.imx95.tflite` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/imx95/yolov5s-det-int8-smart.imx95.tflite) |
363
+ | Small | `imx95/yolov5s-det-int8.imx95.tflite` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/imx95/yolov5s-det-int8.imx95.tflite) |
364
+ | Small | `imx95/yolov5s-det-int8.imx95.tflite` | Logical · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/imx95/yolov5s-det-int8.imx95.tflite) |
365
+ | Medium | `imx95/yolov5m-det-int8-smart.imx95.tflite` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/imx95/yolov5m-det-int8-smart.imx95.tflite) |
366
+ | Medium | `imx95/yolov5m-det-int8.imx95.tflite` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/imx95/yolov5m-det-int8.imx95.tflite) |
367
+ | Medium | `imx95/yolov5m-det-int8.imx95.tflite` | Logical · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/imx95/yolov5m-det-int8.imx95.tflite) |
368
+
369
+ </details>
370
+
371
+ <details>
372
+ <summary><strong>NXP Ara240</strong> — Ara240 DNPU compiled model.</summary>
373
+
374
+ | Size | File | Variant | Download |
375
+ |------|------|---------|----------|
376
+ | Nano | `ara240/yolov5n-det-int16.dvm` | Smart · INT16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/ara240/yolov5n-det-int16.dvm) |
377
+ | Small | `ara240/yolov5s-det-int16.dvm` | Smart · INT16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/ara240/yolov5s-det-int16.dvm) |
378
+ | Medium | `ara240/yolov5m-det-int16.dvm` | Smart · INT16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/ara240/yolov5m-det-int16.dvm) |
379
+
380
+ </details>
381
+
382
+ <details>
383
+ <summary><strong>RPi5 + Hailo-8L (13 TOPS)</strong> — Hailo-8L 13 TOPS accelerator.</summary>
384
+
385
+ | Size | File | Variant | Download |
386
+ |------|------|---------|----------|
387
+ | Nano | `hailo/yolov5n-det-int8.hailo8l.hef` | INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/hailo/yolov5n-det-int8.hailo8l.hef) |
388
+ | Small | `hailo/yolov5s-det-int8.hailo8l.hef` | INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/hailo/yolov5s-det-int8.hailo8l.hef) |
389
+ | Medium | `hailo/yolov5m-det-int8.hailo8l.hef` | INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/hailo/yolov5m-det-int8.hailo8l.hef) |
390
+
391
+ </details>
392
+
393
+ <details>
394
+ <summary><strong>NVIDIA Jetson (TensorRT)</strong> — Jetson FP16 and INT8 engines.</summary>
395
+
396
+ | Size | File | Variant | Download |
397
+ |------|------|---------|----------|
398
+ | Nano | `jetson/yolov5n-det-fp16.engine` | FP16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/jetson/yolov5n-det-fp16.engine) |
399
+ | Nano | `jetson/yolov5n-det-int8.engine` | INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/jetson/yolov5n-det-int8.engine) |
400
+ | Small | `jetson/yolov5s-det-fp16.engine` | FP16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/jetson/yolov5s-det-fp16.engine) |
401
+ | Small | `jetson/yolov5s-det-int8.engine` | INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/jetson/yolov5s-det-int8.engine) |
402
+ | Medium | `jetson/yolov5m-det-fp16.engine` | FP16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/jetson/yolov5m-det-fp16.engine) |
403
+ | Medium | `jetson/yolov5m-det-int8.engine` | INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/jetson/yolov5m-det-int8.engine) |
404
+
405
+ </details>
406
+
407
+ <details>
408
+ <summary><strong>Qualcomm Snapdragon 8 Elite Gen 5 (Hexagon v81)</strong> — Offline-compiled Hexagon context binary, run through the ONNX Runtime QNN execution provider. Loads only on the Snapdragon 8 Elite Gen 5 (Hexagon v81).</summary>
409
+
410
+ | Size | File | Variant | Download |
411
+ |------|------|---------|----------|
412
+ | Nano | `qnn/yolov5n-det-int16-logical.htp-v81.qnn.onnx` | Logical · INT16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5n-det-int16-logical.htp-v81.qnn.onnx) |
413
+ | Nano | `qnn/yolov5n-det-int16-smart.htp-v81.qnn.onnx` | Smart · INT16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5n-det-int16-smart.htp-v81.qnn.onnx) |
414
+ | Nano | `qnn/yolov5n-det-int8-logical.htp-v81.qnn.onnx` | Logical · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5n-det-int8-logical.htp-v81.qnn.onnx) |
415
+ | Nano | `qnn/yolov5n-det-int8-smart.htp-v81.qnn.onnx` | Smart · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5n-det-int8-smart.htp-v81.qnn.onnx) |
416
+ | Small | `qnn/yolov5s-det-int16-logical.htp-v81.qnn.onnx` | Logical · INT16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5s-det-int16-logical.htp-v81.qnn.onnx) |
417
+ | Small | `qnn/yolov5s-det-int16-smart.htp-v81.qnn.onnx` | Smart · INT16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5s-det-int16-smart.htp-v81.qnn.onnx) |
418
+ | Small | `qnn/yolov5s-det-int8-logical.htp-v81.qnn.onnx` | Logical · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5s-det-int8-logical.htp-v81.qnn.onnx) |
419
+ | Small | `qnn/yolov5s-det-int8-smart.htp-v81.qnn.onnx` | Smart · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5s-det-int8-smart.htp-v81.qnn.onnx) |
420
+ | Medium | `qnn/yolov5m-det-int16-logical.htp-v81.qnn.onnx` | Logical · INT16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5m-det-int16-logical.htp-v81.qnn.onnx) |
421
+ | Medium | `qnn/yolov5m-det-int16-smart.htp-v81.qnn.onnx` | Smart · INT16 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5m-det-int16-smart.htp-v81.qnn.onnx) |
422
+ | Medium | `qnn/yolov5m-det-int8-logical.htp-v81.qnn.onnx` | Logical · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5m-det-int8-logical.htp-v81.qnn.onnx) |
423
+ | Medium | `qnn/yolov5m-det-int8-smart.htp-v81.qnn.onnx` | Smart · INT8 · 2026 Q2 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/2026Q2/qnn/yolov5m-det-int8-smart.htp-v81.qnn.onnx) |
424
+
425
+ </details>
426
+
427
+ <details>
428
+ <summary><strong>Qualcomm Dragonwing IQ-9075 (Hexagon v73)</strong> — Offline-compiled Hexagon context binary, run through the ONNX Runtime QNN execution provider. Loads only on the Dragonwing IQ-9075 (Hexagon v73).</summary>
429
+
430
+ | Size | File | Variant | Download |
431
+ |------|------|---------|----------|
432
+ | Nano | `qnn/yolov5n-det-int16-smart.iq9075.qnn.onnx` | Smart · INT16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5n-det-int16-smart.iq9075.qnn.onnx) |
433
+ | Nano | `qnn/yolov5n-det-int8-logical.iq9075.qnn.onnx` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5n-det-int8-logical.iq9075.qnn.onnx) |
434
+ | Nano | `qnn/yolov5n-det-int8-smart.iq9075.qnn.onnx` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5n-det-int8-smart.iq9075.qnn.onnx) |
435
+ | Small | `qnn/yolov5s-det-int16-smart.iq9075.qnn.onnx` | Smart · INT16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5s-det-int16-smart.iq9075.qnn.onnx) |
436
+ | Small | `qnn/yolov5s-det-int8-logical.iq9075.qnn.onnx` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5s-det-int8-logical.iq9075.qnn.onnx) |
437
+ | Small | `qnn/yolov5s-det-int8-smart.iq9075.qnn.onnx` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5s-det-int8-smart.iq9075.qnn.onnx) |
438
+ | Medium | `qnn/yolov5m-det-int16-smart.iq9075.qnn.onnx` | Smart · INT16 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5m-det-int16-smart.iq9075.qnn.onnx) |
439
+ | Medium | `qnn/yolov5m-det-int8-logical.iq9075.qnn.onnx` | Logical · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5m-det-int8-logical.iq9075.qnn.onnx) |
440
+ | Medium | `qnn/yolov5m-det-int8-smart.iq9075.qnn.onnx` | Smart · INT8 | [Download](https://huggingface.co/EdgeFirst/yolov5-det/resolve/main/qnn/yolov5m-det-int8-smart.iq9075.qnn.onnx) |
441
+
442
+ </details>
443
 
 
 
 
 
 
 
 
 
 
 
 
444
 
445
  ---
446
 
ara240/yolov5m-det-int16.dvm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d801a01ac2fc817a6d51efa18a9b9f0d5d12a77ea4c09fdc813b711ba508bc20
3
- size 35410263
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ba2904b81447ef02c5e070f7ed3f04387ca404b9a4a739973f335d6ee6209c3
3
+ size 35421392
ara240/yolov5n-det-int16.dvm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8b0330a2da01afd78ac6d6a735061bfe56ff2330fe4094c1493a5987855be2ef
3
- size 5055930
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f07791f9ca0c6e6b8b23797bc2f372392b39dd09d512c604939a630e214137e
3
+ size 5060880
ara240/yolov5s-det-int16.dvm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b7942711c064ac820be0a9349a6c5411187df73186d32ef0bb2b0cce0957915b
3
- size 14029777
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:521c392cd1b77bdf5d5191d717134c786df1c0915a19824f3551aeb911d0b934
3
+ size 14025930
hailo/yolov5m-det-int8.hailo8l.hef CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:df24bbb398fad3596d5d49d8c265427ffa18957aeb5243fb2360cf8abbb5ccbe
3
- size 49459356
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03ae40fc835b127e235d427d37cf31d6a29ccec5db0ed81ac37c3d06fb7af96b
3
+ size 49457212
hailo/yolov5n-det-int8.hailo8l.hef CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e40280630dec6b05479985e14a9fcbd37e3e035e228cd615642f219df889174
3
- size 10225287
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0e75505bf2bb4b4317bd7d4cf6f5c096d0f1c73b99f28ca5648c28dfa7f7e03
3
+ size 10222576
hailo/yolov5s-det-int8.hailo8l.hef CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08cf3b28b0d5694c7be9d381bd3563946bc02cddea985e8c3d292a7c8be4a409
3
- size 25564330
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96e70ab08af4eea06171eedda1af1c1495ad5682de1d1fe9cf861849dd84e217
3
+ size 25560001
imx95/yolov5m-det-int8-smart.imx95.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12a891050f8819f10cbfcc1674334b8c3df70fb4f888a4a9c2d25e1c70d8dadb
3
- size 23015432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96842609167cdebe78c898910c71595bcc69534d1f4b1de296fb538ce4db0c48
3
+ size 24888120
imx95/yolov5m-det-int8.imx95.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4afd66d3c260a6a4c8a00cec733586965894d77569d0c7ef2225ccde24ce7bf
3
- size 23081684
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d79bd80c7386c5cdafd8e77466293ae5c901622b068bc4f75125b25fbb3df95e
3
+ size 24955970
imx95/yolov5n-det-int8-smart.imx95.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bcdab8e383856b9b18ef364bc7a0fa0bf3c94b0254cb959b20a7d9b7f1dbabc
3
- size 2778160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fac10fbb2b773f87a6f52df0d8d1c6b131c9cb2de2380a4a0c22c6964d446e50
3
+ size 2794934
imx95/yolov5n-det-int8.imx95.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:35ae8ac5c5acf57c727ed85c62a552c2df8f8b6978f28ce514fa73cf6d79b708
3
- size 2839895
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:851cf816825cbc89df7f640a75e62c0db810ec0e43a055f3e8123ffbbd458c58
3
+ size 2862781
imx95/yolov5s-det-int8-smart.imx95.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7aa0809801b866975c02e2a447d364e0a5f6d0f7b262c4957ce3039fc586a997
3
- size 9229224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e3d409c4ddc217cab9ae9fdccd27e17f2d3cca4f5c1988858c8f5d01b33530b
3
+ size 9535274
imx95/yolov5s-det-int8.imx95.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a5d2fd29026af3762722886768bb297fdbfb394c33ed47a3cd927e2c3e1aa848
3
- size 9294390
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68697dca4a769b071b5c9177bdada6d1cbc3a8e969fef24d9c7cf11b9c4007a5
3
+ size 9603116
jetson/yolov5m-det-fp16.engine CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3742d3952282d9d917504ed86b8286f8585bc4826f9a2c8d3071281e3f58dd59
3
- size 53270753
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76991630b172ad30d062391a3c6928f5029af23043b7967bf848519f8a12f510
3
+ size 53305002
jetson/yolov5m-det-int8.engine ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e47ea229350063c9e7348c7f41a064cf997b6f46aa3294761b5ff394089c1e12
3
+ size 28049916
jetson/yolov5n-det-fp16.engine CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2cdb7fb81441d6af67cbf4d09177248cddc5443677b97db7f332d31655ed4a42
3
- size 8205862
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c6565e1d7dd1a22b8a99ed9fe7df583474104a22076b5426131ac2f41de65ee
3
+ size 8303471
jetson/yolov5n-det-int8.engine ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:672d5d8021d4a2d7394179ab63f242631f34671eb5d74e7ab1e9d51153a38578
3
+ size 5015241
jetson/yolov5s-det-fp16.engine CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e179657e6b31b97d466a56f0271be727030f3c4022b413910bdc01053814e5ea
3
- size 21601576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4f396db7ef12af830e6e0af2d4e5178b32e1d377cdac7170d323f91e8c497ac
3
+ size 21526457
jetson/yolov5s-det-int8.engine ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d746853b8ad74f8cc497f6e5682620ba5888f83ae9fc424b5a926c6c345ad39b
3
+ size 11408875
onnx/yolov5m-det-fp16.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08e2f34ca6ea01bb7e0d5c282da4c8ce48b71faddf59e128f4555b0c4c7a2674
3
- size 50393419
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82942feab7b5e92b395dac6a365e8b9c535d3fef53192ff40f89570d5d3a1a28
3
+ size 50393913
onnx/yolov5m-det-fp32.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:598df1cfec9a72a6aabfef066cc5e95084571961d4c682e4615212330d677877
3
- size 100656565
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a274c13b3a69416e780f26714cda3851f7060d87b008f11d285ee0ffec33d064
3
+ size 100656939
onnx/yolov5n-det-fp16.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fb2dccaa80a47a2d090b65c334288ca9c3171b16ea906d4ca7dc3387d1572059
3
- size 5484195
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:146b7fbdf096b85625d69773327bbdbafc3b2a6886466e5c56eb1843c6f2c2d9
3
+ size 5484689
onnx/yolov5n-det-fp32.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4300382027d6bb24e62c2eec291c53d780f346731b2914876f6d368e6aabd91d
3
- size 10867541
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8a31bd491e8e23a8ad1218902fe6b57449ab8cebb717c2fd0cbdeacaf48ddd7
3
+ size 10867915
onnx/yolov5s-det-fp16.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d3f861978e1d42dc7bae95c6d5d9b99cd112d50374aac39819bbebd62400a70
3
- size 18471098
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55a7f05df2603f7dd977268e21dae9612c7d9e7e77c805f9f54f5bbd207aee4e
3
+ size 18471592
onnx/yolov5s-det-fp32.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf9899ce4ff6aba4a4320a54423c22a09d7e410f1b8e03a8d138a109fc2b984b
3
- size 36840927
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21fb3d8b4dcf17aeb99462154e222b0e514b9671410d5a51b8ee3e1acf8721b2
3
+ size 36841301
qnn/yolov5m-det-int16-smart.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:923d85a6d528d6148a34368b61966347760278ac4e2818448fe6cd0e32e581fb
3
+ size 26394455
qnn/yolov5m-det-int8-logical.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b835edad7294890ac9ac7536e7e50ae4f339259725b293669881de6e1e0f5dca
3
+ size 25918308
qnn/yolov5m-det-int8-smart.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0241aea3aa262023ec0746a38cfcb4e1bb42750eb7ff050487c6885726c16307
3
+ size 25853825
qnn/yolov5n-det-int16-smart.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:807f84ff15fd020f21c6462b802da89b67e6daf4bc4802bb1440eaba96587ef7
3
+ size 3375219
qnn/yolov5n-det-int8-logical.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9ad127636c54c3c0db390949972caff338c548a28c652b7b20c70fcc072f1bb
3
+ size 3267714
qnn/yolov5n-det-int8-smart.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:608fcb34fdb652b1e8f0e4f6e370e4a429085c4043af5d67d983b39eb1b4aed3
3
+ size 3203220
qnn/yolov5s-det-int16-smart.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:442c5ff8b13f13d7e90f9f50de2fb81ebd62180592e6a43932a90a638099ce6b
3
+ size 9879671
qnn/yolov5s-det-int8-logical.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b843b528e99f45d6450a53e3e6a333e4528c9d3643a4402c10fc253ec989372
3
+ size 9694340
qnn/yolov5s-det-int8-smart.iq9075.qnn.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9166e251fcfc4581f92c9febd9e27be525565c5edd2a4690c7f68d6f043f744
3
+ size 9629848
tflite/yolov5m-det-int8-smart.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8b2a7aaaeff7aa9b98d19d4a548fffaeaf65b3802f0ec89af71d4647bde603ea
3
- size 25748348
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:587dce3031917964fa78899816775c721a5384b1f2d66beadbd4e05be7378967
3
+ size 25748787
tflite/yolov5m-det-int8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:feb5ca95a63134eec024d061fae67c87905886e5313e041c215f895dea5a63bf
3
- size 25796108
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34f77b36552f4ac8fcc34a75bf2c55a500d6386b1fa383ab52b8169119f8f287
3
+ size 25807956
tflite/yolov5n-det-int8-smart.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:07e84f1d27412563f25df16d7d6fd1e67b4773a4cd71ecac6b3998324dc0e6dd
3
- size 2896024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32a7b8132298a6174bd7b4ff45e7c361fd714a59a976fd599dd6b00aa16c3289
3
+ size 2896457
tflite/yolov5n-det-int8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f8c6e566fde600df9bc6e746bfc94d97fb4b3944a6b70792d935461dca96105
3
- size 2946370
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:326c652321ef7eb3de60e9fa15af86475e0484355494e286805c5261df4771c4
3
+ size 2955623
tflite/yolov5s-det-int8-smart.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5bc5abf58dd9eef8d4ee5a15e209f34416d3c8a2ff72c3e35d5051e63a4880ab
3
- size 9525395
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb5944f903833d7054f313cad6f74112d42590a3b2498ac8fcc248c0d51cc342
3
+ size 9526014
tflite/yolov5s-det-int8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e23dc88cfb37f78437781be309bc1b95f7fd4e00878c6cfca8a042686b5e08e
3
- size 9575748
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21e37c347174f19fce9017624b4b50a39a5b9afa295a0f6f1841cae16d301dd8
3
+ size 9585176