mlboydaisuke commited on
Commit
7f35d19
·
verified ·
1 Parent(s): d5a8dc3

Card: correct the GPU node counts — the previous figures added the XNNPACK fallback partition to the GPU delegate partition

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -129,14 +129,14 @@ Measured on a **Pixel 8a** (Tensor G3, Android 16) with the standard TFLite [`be
129
 
130
  | Runtime | Backend | Graph on GPU | Latency |
131
  |---|---|---|---|
132
- | TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) | GPU (OpenCL) | 440 / 840 | 53.0 ms |
133
  | TFLite `benchmark_model` | CPU (XNNPACK, 4 threads) | — | 9.8 ms |
134
 
135
  **Any on-device figure recorded when this model shipped came from a different runtime.** It was taken through LiteRT's own `CompiledModel` accelerator (logcat reports it as `LITERT_CL`), which is the path the Kotlin sample app and the LiteRT API use, and it appears elsewhere on this card. The rows above are the classic TFLite OpenCL delegate, measured with a tool anyone can download and re-run. The two are not comparable, so read the rows above as a reproducible floor rather than as this model's speed on LiteRT.
136
 
137
  On this delegate the CPU is the faster choice for (9.8 ms on CPU against 53.0 ms on GPU) — worth knowing before you reach for the GPU on a mid-range phone.
138
 
139
- Note that the GPU does not take the whole graph here (440 of 840); the remainder runs on the CPU and the split costs a per-partition round trip.
140
 
141
  ## License
142
 
 
129
 
130
  | Runtime | Backend | Graph on GPU | Latency |
131
  |---|---|---|---|
132
+ | TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) | GPU (OpenCL) | 71 / 455 | 53.0 ms |
133
  | TFLite `benchmark_model` | CPU (XNNPACK, 4 threads) | — | 9.8 ms |
134
 
135
  **Any on-device figure recorded when this model shipped came from a different runtime.** It was taken through LiteRT's own `CompiledModel` accelerator (logcat reports it as `LITERT_CL`), which is the path the Kotlin sample app and the LiteRT API use, and it appears elsewhere on this card. The rows above are the classic TFLite OpenCL delegate, measured with a tool anyone can download and re-run. The two are not comparable, so read the rows above as a reproducible floor rather than as this model's speed on LiteRT.
136
 
137
  On this delegate the CPU is the faster choice for (9.8 ms on CPU against 53.0 ms on GPU) — worth knowing before you reach for the GPU on a mid-range phone.
138
 
139
+ Note that the GPU does not take the whole graph here (71 / 455); the remainder runs on the CPU and the split costs a per-partition round trip.
140
 
141
  ## License
142