Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -31,14 +31,17 @@ Getting it wrong does not throw; it returns vectors that look fine and rank wron
|
|
| 31 |
|
| 32 |
## Verification
|
| 33 |
|
| 34 |
-
| build | file | size (MB) | Mac ms* | worst cosine vs eager | retrieval budget |
|
| 35 |
-
|---|---|---|---|---|---|
|
| 36 |
-
| fp32 | `embed_all_mpnet_xnnpack_fp32.pte` | 435.8 | 35.2 | 1.000000 | 0% |
|
| 37 |
-
| fp16 | `embed_all_mpnet_xnnpack_fp16.pte` | 218.1 | 56.2 | 1.000000 | 11% |
|
| 38 |
-
| Core ML (fp16, iOS) | `embed_all_mpnet_coreml_all.pte` | 220.2 | 6.2 | 0.999993 | 32% |
|
| 39 |
|
| 40 |
-
\*Mac arm64,
|
| 41 |
-
cost, not a device number.
|
|
|
|
|
|
|
|
|
|
| 42 |
37.0 ms.
|
| 43 |
|
| 44 |
Cosine is measured against the model run in eager through its own pooling, over eight
|
|
|
|
| 31 |
|
| 32 |
## Verification
|
| 33 |
|
| 34 |
+
| build | file | size (MB) | Mac ms* | backend takes | worst cosine vs eager | retrieval budget |
|
| 35 |
+
|---|---|---|---|---|---|---|
|
| 36 |
+
| fp32 | `embed_all_mpnet_xnnpack_fp32.pte` | 435.8 | 35.2 | 75.5% | 1.000000 | 0% |
|
| 37 |
+
| fp16 | `embed_all_mpnet_xnnpack_fp16.pte` | 218.1 | 56.2 | 65.7% | 1.000000 | 11% |
|
| 38 |
+
| Core ML (fp16, iOS) | `embed_all_mpnet_coreml_all.pte` | 220.2 | 6.2 | 100.0% | 0.999993 | 32% |
|
| 39 |
|
| 40 |
+
\*Mac arm64, one 256-token sequence, **fastest of five medians of ten** — a reference
|
| 41 |
+
point for relative cost, not a device number. The host shares its cores with other work,
|
| 42 |
+
and a single median does not survive that: the same eager model here measured 19.6 ms and
|
| 43 |
+
182.8 ms twenty minutes apart. Contention only ever adds time, so the fastest repetition is
|
| 44 |
+
the one that means something. Torch eager fp32, measured the same way, is
|
| 45 |
37.0 ms.
|
| 46 |
|
| 47 |
Cosine is measured against the model run in eager through its own pooling, over eight
|