mlboydaisuke commited on
Commit
eff2b20
·
verified ·
1 Parent(s): 2216786

Card: add a measured Performance table (Pixel 8a, benchmark_model GPU+CPU), naming the runtime for each row

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -86,6 +86,20 @@ for y, x0 in zip(ys[order], xs[order]):
86
  print(f"{len(lines)} line segments (x0,y0,x1,y1 in 512-space)")
87
  ```
88
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
89
  ## License
90
 
91
  [Apache-2.0](https://github.com/navervision/mlsd/blob/main/LICENSE). Upstream:
 
86
  print(f"{len(lines)} line segments (x0,y0,x1,y1 in 512-space)")
87
  ```
88
 
89
+ ## Performance
90
+
91
+ Measured on a **Pixel 8a** (Tensor G3, Android 16) with the standard TFLite [`benchmark_model`](https://ai.google.dev/edge/litert/models/measurement) tool — 10 warm-up runs then 50 timed runs, reported as the tool's mean.
92
+
93
+ | Runtime | Backend | Graph on GPU | Latency |
94
+ |---|---|---|---|
95
+ | LiteRT `CompiledModel` (`LITERT_CL`) | GPU | 99 / 99 | ~2 ms |
96
+ | TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) | GPU (OpenCL) | 99 / 99 | 26.3 ms |
97
+ | TFLite `benchmark_model` | CPU (XNNPACK, 4 threads) | — | XNNPACK declined the graph |
98
+
99
+ **The two GPU rows are different runtimes, not a contradiction.** The `LITERT_CL` figure is the one recorded when this model shipped, taken through LiteRT's own `CompiledModel` accelerator — the path the Kotlin sample app and the LiteRT API use. The `TfLiteGpuDelegateV2` figure is the classic TFLite OpenCL delegate, measured with a tool anyone can download and re-run. They agree on how much of the graph the GPU takes; they disagree on speed, and the classic delegate is the slower of the two here. Read the `TfLiteGpuDelegateV2` row as a reproducible floor, not as this model's speed on LiteRT.
100
+
101
+ XNNPACK declines these fp16 graphs — it reports `failed to delegate DEPTHWISE_CONV_2D` and then fails to allocate tensors — so there is no usable CPU number. Disabling XNNPACK falls back to reference kernels, which measured about 20× slower than the GPU on models of this size and would not represent CPU inference anyone would ship.
102
+
103
  ## License
104
 
105
  [Apache-2.0](https://github.com/navervision/mlsd/blob/main/LICENSE). Upstream: