Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,7 @@ This is an optimized version of [LaBSE (Language-agnostic BERT Sentence Embeddin
|
|
| 19 |
|
| 20 |
# Benchmark
|
| 21 |
|
|
|
|
| 22 |
| STSBenchmark | biosses-sts | sickr-sts | sts12-sts | sts13-sts | sts15-sts | sts16-sts | Average Pearson | Model |
|
| 23 |
|--------------|-------------|-----------|-----------|-----------|-----------|-----------|-----------------|--------------------------------------|
|
| 24 |
| 0.7363 | 0.8148 | 0.7067 | 0.7050 | 0.6535 | 0.7514 | 0.7070 | 0.7250 | sentence-transformers/LaBSE |
|
|
@@ -29,15 +30,12 @@ This is an optimized version of [LaBSE (Language-agnostic BERT Sentence Embeddin
|
|
| 29 |
| 0.6960 | 0.8185 | 0.6950 | 0.6752 | 0.5899 | 0.7186 | 0.6790 | 0.6960 | intfloat/multilingual-e5-base |
|
| 30 |
| 0.7376 | 0.7917 | 0.7190 | 0.7441 | 0.6286 | 0.7461 | 0.7026 | 0.7242 | intfloat/multilingual-e5-small |
|
| 31 |
| 0.7927 | 0.6672 | 0.7758 | 0.8122 | 0.7312 | 0.7831 | 0.7416 | 0.7577 | BAAI/bge-m3 |
|
| 32 |
-
|
| 33 |
-
[STS-Benchmark](https://github.com/LocalDoc-Azerbaijan/STS-Benchmark)
|
| 34 |
|
| 35 |
|
|
|
|
| 36 |
|
| 37 |
-
# Memory Usage Comparison (GPU):
|
| 38 |
|
| 39 |
-
Original LaBSE: ~1.89-1.90 GB allocated
|
| 40 |
-
LaBSE-small-AZ: ~0.58 GB allocated
|
| 41 |
|
| 42 |
|
| 43 |
|
|
|
|
| 19 |
|
| 20 |
# Benchmark
|
| 21 |
|
| 22 |
+
```
|
| 23 |
| STSBenchmark | biosses-sts | sickr-sts | sts12-sts | sts13-sts | sts15-sts | sts16-sts | Average Pearson | Model |
|
| 24 |
|--------------|-------------|-----------|-----------|-----------|-----------|-----------|-----------------|--------------------------------------|
|
| 25 |
| 0.7363 | 0.8148 | 0.7067 | 0.7050 | 0.6535 | 0.7514 | 0.7070 | 0.7250 | sentence-transformers/LaBSE |
|
|
|
|
| 30 |
| 0.6960 | 0.8185 | 0.6950 | 0.6752 | 0.5899 | 0.7186 | 0.6790 | 0.6960 | intfloat/multilingual-e5-base |
|
| 31 |
| 0.7376 | 0.7917 | 0.7190 | 0.7441 | 0.6286 | 0.7461 | 0.7026 | 0.7242 | intfloat/multilingual-e5-small |
|
| 32 |
| 0.7927 | 0.6672 | 0.7758 | 0.8122 | 0.7312 | 0.7831 | 0.7416 | 0.7577 | BAAI/bge-m3 |
|
| 33 |
+
```
|
|
|
|
| 34 |
|
| 35 |
|
| 36 |
+
[STS-Benchmark](https://github.com/LocalDoc-Azerbaijan/STS-Benchmark)
|
| 37 |
|
|
|
|
| 38 |
|
|
|
|
|
|
|
| 39 |
|
| 40 |
|
| 41 |
|