Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -24,19 +24,21 @@ never leaves the device.
|
|
| 24 |
|
| 25 |
## Two parts of the recipe, and only one of them is in the graph
|
| 26 |
|
| 27 |
-
**The pooling is in.** sentence-transformers keeps it per model, and the
|
| 28 |
-
|
| 29 |
|
| 30 |
| | pooling | normalised |
|
| 31 |
|---|---|---|
|
| 32 |
-
|
|
| 33 |
-
| all-MiniLM-
|
| 34 |
| bge-small-en-v1.5 | **CLS** | yes |
|
|
|
|
|
|
|
| 35 |
| paraphrase-multilingual-L12 | mean | **no** |
|
| 36 |
|
| 37 |
Read off `modules.json` and `1_Pooling/config.json` rather than assumed from the family
|
| 38 |
-
name —
|
| 39 |
-
normalise.
|
| 40 |
|
| 41 |
**The prefix is not.** E5 is trained with `"query: "` in front of a search query and
|
| 42 |
`"passage: "` in front of a document, and it expects them at inference:
|
|
|
|
| 24 |
|
| 25 |
## Two parts of the recipe, and only one of them is in the graph
|
| 26 |
|
| 27 |
+
**The pooling is in.** sentence-transformers keeps it per model, and the six embedding
|
| 28 |
+
models on this shelf do not agree:
|
| 29 |
|
| 30 |
| | pooling | normalised |
|
| 31 |
|---|---|---|
|
| 32 |
+
| all-MiniLM-L6-v2 | mean | yes |
|
| 33 |
+
| all-MiniLM-L12-v2 | mean | yes |
|
| 34 |
| bge-small-en-v1.5 | **CLS** | yes |
|
| 35 |
+
| **multilingual-e5-base** | **mean** | **yes** |
|
| 36 |
+
| multilingual-e5-large | mean | yes |
|
| 37 |
| paraphrase-multilingual-L12 | mean | **no** |
|
| 38 |
|
| 39 |
Read off `modules.json` and `1_Pooling/config.json` rather than assumed from the family
|
| 40 |
+
name — paraphrase-multilingual is the same architecture family with the same pooling, and
|
| 41 |
+
it does *not* normalise.
|
| 42 |
|
| 43 |
**The prefix is not.** E5 is trained with `"query: "` in front of a search query and
|
| 44 |
`"passage: "` in front of a document, and it expects them at inference:
|