mlboydaisuke commited on
Commit
c632774
·
verified ·
1 Parent(s): 287aa3a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -96,9 +96,9 @@ iPhone 17 Pro, single 180-token prompt, cold start:
96
  | Backend | Prefill | Decode | TTFT | Peak memory |
97
  |---|---|---|---|---|
98
  | GPU (Metal) | 768–801 tok/s | 32.0 tok/s | 0.31 s | 1.7 GB |
99
- | CPU | 281 tok/s | 15.5 tok/s | 0.74 s | |
100
 
101
- The Metal row is a two-run retake on a cooled phone (both runs agreed to 0.1 tok/s). The CPU row was measured with the device already reporting a `serious` thermal state, so treat it as a floor.
102
 
103
  In practice a short dictation turn — one or two sentences in, one or two out — completes in about 3 seconds on a Pixel 8a CPU.
104
 
 
96
  | Backend | Prefill | Decode | TTFT | Peak memory |
97
  |---|---|---|---|---|
98
  | GPU (Metal) | 768–801 tok/s | 32.0 tok/s | 0.31 s | 1.7 GB |
99
+ | CPU | 281 tok/s | 15.5 tok/s | 0.74 s | 1.4 GB |
100
 
101
+ Every iPhone run above was recorded with the device reporting a `serious` thermal state, so read them as floors rather than peaks. The Metal row is the pair of runs that agreed (32.02 and 32.01 tok/s); an earlier Metal run of the same build read 30.2 tok/s.
102
 
103
  In practice a short dictation turn — one or two sentences in, one or two out — completes in about 3 seconds on a Pixel 8a CPU.
104