mlboydaisuke commited on
Commit
6cc454c
·
verified ·
1 Parent(s): 0d0685f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -7
README.md CHANGED
@@ -31,14 +31,17 @@ Getting it wrong does not throw; it returns vectors that look fine and rank wron
31
 
32
  ## Verification
33
 
34
- | build | file | size (MB) | Mac ms* | worst cosine vs eager | retrieval budget |
35
- |---|---|---|---|---|---|
36
- | fp32 | `embed_all_mpnet_xnnpack_fp32.pte` | 435.8 | 35.2 | 1.000000 | 0% |
37
- | fp16 | `embed_all_mpnet_xnnpack_fp16.pte` | 218.1 | 56.2 | 1.000000 | 11% |
38
- | Core ML (fp16, iOS) | `embed_all_mpnet_coreml_all.pte` | 220.2 | 6.2 | 0.999993 | 32% |
39
 
40
- \*Mac arm64, median of 10, one 256-token sequence a reference point for relative
41
- cost, not a device number. Torch eager fp32 on the same machine is
 
 
 
42
  37.0 ms.
43
 
44
  Cosine is measured against the model run in eager through its own pooling, over eight
 
31
 
32
  ## Verification
33
 
34
+ | build | file | size (MB) | Mac ms* | backend takes | worst cosine vs eager | retrieval budget |
35
+ |---|---|---|---|---|---|---|
36
+ | fp32 | `embed_all_mpnet_xnnpack_fp32.pte` | 435.8 | 35.2 | 75.5% | 1.000000 | 0% |
37
+ | fp16 | `embed_all_mpnet_xnnpack_fp16.pte` | 218.1 | 56.2 | 65.7% | 1.000000 | 11% |
38
+ | Core ML (fp16, iOS) | `embed_all_mpnet_coreml_all.pte` | 220.2 | 6.2 | 100.0% | 0.999993 | 32% |
39
 
40
+ \*Mac arm64, one 256-token sequence, **fastest of five medians of ten** — a reference
41
+ point for relative cost, not a device number. The host shares its cores with other work,
42
+ and a single median does not survive that: the same eager model here measured 19.6 ms and
43
+ 182.8 ms twenty minutes apart. Contention only ever adds time, so the fastest repetition is
44
+ the one that means something. Torch eager fp32, measured the same way, is
45
  37.0 ms.
46
 
47
  Cosine is measured against the model run in eager through its own pooling, over eight