Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,8 @@
|
|
| 1 |
-
|
| 2 |
---
|
| 3 |
pipeline_tag: sentence-similarity
|
| 4 |
-
language:
|
|
|
|
|
|
|
| 5 |
license: apache-2.0
|
| 6 |
tags:
|
| 7 |
- passage-retrieval
|
|
@@ -14,11 +15,11 @@ base_model_relation: quantized
|
|
| 14 |
# 🇫🇷 french-gte-multilingual-base
|
| 15 |
|
| 16 |
This model is a 51.4% smaller version of [Alibaba-NLP/gte-multilingual-base](https://huggingface.co/Alibaba-NLP/gte-multilingual-base)
|
| 17 |
-
for the French language, created using the [mtem-pruner](https://huggingface.co/spaces/antoinelouis/mtem-pruner) space.
|
| 18 |
|
| 19 |
-
This pruned model should perform similarly to the original model for French language tasks with a much smaller
|
| 20 |
memory footprint. However, it may not perform well for other languages present in the original multilingual model as tokens not
|
| 21 |
-
commonly used in French were removed from the original multilingual model's vocabulary.
|
| 22 |
|
| 23 |
## Usage
|
| 24 |
|
|
@@ -27,7 +28,7 @@ You can use this model with the Transformers library:
|
|
| 27 |
```python
|
| 28 |
from transformers import AutoModel, AutoTokenizer
|
| 29 |
|
| 30 |
-
model_name = "ijohn07/french-gte-
|
| 31 |
model = AutoModel.from_pretrained(model_name, trust_remote_code=True)
|
| 32 |
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True, use_fast=True)
|
| 33 |
```
|
|
@@ -37,7 +38,7 @@ Or with the sentence-transformers library:
|
|
| 37 |
```python
|
| 38 |
from sentence_transformers import SentenceTransformer
|
| 39 |
|
| 40 |
-
model = SentenceTransformer("ijohn07/french-gte-
|
| 41 |
```
|
| 42 |
|
| 43 |
-
**Credits**: cc [@antoinelouis](https://huggingface.co/antoinelouis)
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
pipeline_tag: sentence-similarity
|
| 3 |
+
language:
|
| 4 |
+
- fr
|
| 5 |
+
- en
|
| 6 |
license: apache-2.0
|
| 7 |
tags:
|
| 8 |
- passage-retrieval
|
|
|
|
| 15 |
# 🇫🇷 french-gte-multilingual-base
|
| 16 |
|
| 17 |
This model is a 51.4% smaller version of [Alibaba-NLP/gte-multilingual-base](https://huggingface.co/Alibaba-NLP/gte-multilingual-base)
|
| 18 |
+
for the French and English language, created using the [mtem-pruner](https://huggingface.co/spaces/antoinelouis/mtem-pruner) space.
|
| 19 |
|
| 20 |
+
This pruned model should perform similarly to the original model for French and English language tasks with a much smaller
|
| 21 |
memory footprint. However, it may not perform well for other languages present in the original multilingual model as tokens not
|
| 22 |
+
commonly used in French and English were removed from the original multilingual model's vocabulary.
|
| 23 |
|
| 24 |
## Usage
|
| 25 |
|
|
|
|
| 28 |
```python
|
| 29 |
from transformers import AutoModel, AutoTokenizer
|
| 30 |
|
| 31 |
+
model_name = "ijohn07/french-english-gte-base"
|
| 32 |
model = AutoModel.from_pretrained(model_name, trust_remote_code=True)
|
| 33 |
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True, use_fast=True)
|
| 34 |
```
|
|
|
|
| 38 |
```python
|
| 39 |
from sentence_transformers import SentenceTransformer
|
| 40 |
|
| 41 |
+
model = SentenceTransformer("ijohn07/french-english-gte-base")
|
| 42 |
```
|
| 43 |
|
| 44 |
+
**Credits**: cc [@antoinelouis](https://huggingface.co/antoinelouis)
|