Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -40,13 +40,16 @@ retrieves worse.
|
|
| 40 |
|
| 41 |
| build | file | size (MB) | Mac ms* | backend takes | worst cosine vs eager | retrieval budget |
|
| 42 |
|---|---|---|---|---|---|---|
|
| 43 |
-
| fp32 | `embed_nomic_embed_text_v15_xnnpack_fp32.pte` | 547.2 | 45.
|
| 44 |
-
| fp16 | `embed_nomic_embed_text_v15_xnnpack_fp16.pte` | 273.8 |
|
| 45 |
-
| Core ML (fp16, iOS) | `embed_nomic_embed_text_v15_coreml_all.pte` | 274.8 | 8.
|
| 46 |
-
|
| 47 |
-
\*Mac arm64,
|
| 48 |
-
cost, not a device number.
|
| 49 |
-
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
Cosine is measured against the model run in eager through its own pooling, over eight
|
| 52 |
sentences. The last column is the one that decides: rank those eight against each
|
|
|
|
| 40 |
|
| 41 |
| build | file | size (MB) | Mac ms* | backend takes | worst cosine vs eager | retrieval budget |
|
| 42 |
|---|---|---|---|---|---|---|
|
| 43 |
+
| fp32 | `embed_nomic_embed_text_v15_xnnpack_fp32.pte` | 547.2 | 45.1 | 64.5% | 1.000000 | 0% |
|
| 44 |
+
| fp16 | `embed_nomic_embed_text_v15_xnnpack_fp16.pte` | 273.8 | 97.0 | 58.6% | 0.999999 | 7% |
|
| 45 |
+
| Core ML (fp16, iOS) | `embed_nomic_embed_text_v15_coreml_all.pte` | 274.8 | 8.1 | 100.0% | 0.999793 | 46% |
|
| 46 |
+
|
| 47 |
+
\*Mac arm64, one 256-token sequence, **fastest of five medians of ten** — a reference
|
| 48 |
+
point for relative cost, not a device number. The host shares its cores with other work,
|
| 49 |
+
and a single median does not survive that: the same eager model here measured 19.6 ms and
|
| 50 |
+
182.8 ms twenty minutes apart. Contention only ever adds time, so the fastest repetition is
|
| 51 |
+
the one that means something. Torch eager fp32, measured the same way, is
|
| 52 |
+
44.9 ms.
|
| 53 |
|
| 54 |
Cosine is measured against the model run in eager through its own pooling, over eight
|
| 55 |
sentences. The last column is the one that decides: rank those eight against each
|