Update README.md
Browse files
README.md
CHANGED
|
@@ -35,57 +35,6 @@ widget:
|
|
| 35 |
- 녹색 버스가 도로를 따라 내려간다.
|
| 36 |
pipeline_tag: sentence-similarity
|
| 37 |
library_name: sentence-transformers
|
| 38 |
-
metrics:
|
| 39 |
-
- pearson_cosine
|
| 40 |
-
- spearman_cosine
|
| 41 |
-
- pearson_euclidean
|
| 42 |
-
- spearman_euclidean
|
| 43 |
-
- pearson_manhattan
|
| 44 |
-
- spearman_manhattan
|
| 45 |
-
- pearson_dot
|
| 46 |
-
- spearman_dot
|
| 47 |
-
- pearson_max
|
| 48 |
-
- spearman_max
|
| 49 |
-
model-index:
|
| 50 |
-
- name: SentenceTransformer based on answerdotai/ModernBERT-base
|
| 51 |
-
results:
|
| 52 |
-
- task:
|
| 53 |
-
type: semantic-similarity
|
| 54 |
-
name: Semantic Similarity
|
| 55 |
-
dataset:
|
| 56 |
-
name: sts dev
|
| 57 |
-
type: sts_dev
|
| 58 |
-
metrics:
|
| 59 |
-
- type: pearson_cosine
|
| 60 |
-
value: 0.8273878707711191
|
| 61 |
-
name: Pearson Cosine
|
| 62 |
-
- type: spearman_cosine
|
| 63 |
-
value: 0.8298080691919564
|
| 64 |
-
name: Spearman Cosine
|
| 65 |
-
- type: pearson_euclidean
|
| 66 |
-
value: 0.8112987734110177
|
| 67 |
-
name: Pearson Euclidean
|
| 68 |
-
- type: spearman_euclidean
|
| 69 |
-
value: 0.8214596205940881
|
| 70 |
-
name: Spearman Euclidean
|
| 71 |
-
- type: pearson_manhattan
|
| 72 |
-
value: 0.8125188338482303
|
| 73 |
-
name: Pearson Manhattan
|
| 74 |
-
- type: spearman_manhattan
|
| 75 |
-
value: 0.8226861322419045
|
| 76 |
-
name: Spearman Manhattan
|
| 77 |
-
- type: pearson_dot
|
| 78 |
-
value: 0.7646820898603437
|
| 79 |
-
name: Pearson Dot
|
| 80 |
-
- type: spearman_dot
|
| 81 |
-
value: 0.7648333772102188
|
| 82 |
-
name: Spearman Dot
|
| 83 |
-
- type: pearson_max
|
| 84 |
-
value: 0.8273878707711191
|
| 85 |
-
name: Pearson Max
|
| 86 |
-
- type: spearman_max
|
| 87 |
-
value: 0.8298080691919564
|
| 88 |
-
name: Spearman Max
|
| 89 |
---
|
| 90 |
|
| 91 |
# SentenceTransformer based on answerdotai/ModernBERT-base
|
|
@@ -175,28 +124,6 @@ You can finetune this model on your own dataset.
|
|
| 175 |
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
| 176 |
-->
|
| 177 |
|
| 178 |
-
## Evaluation
|
| 179 |
-
|
| 180 |
-
### Metrics
|
| 181 |
-
|
| 182 |
-
#### Semantic Similarity
|
| 183 |
-
|
| 184 |
-
* Dataset: `sts_dev`
|
| 185 |
-
* Evaluated with [<code>EmbeddingSimilarityEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.EmbeddingSimilarityEvaluator)
|
| 186 |
-
|
| 187 |
-
| Metric | Value |
|
| 188 |
-
|:-------------------|:-----------|
|
| 189 |
-
| pearson_cosine | 0.8273 |
|
| 190 |
-
| spearman_cosine | 0.8298 |
|
| 191 |
-
| pearson_euclidean | 0.8112 |
|
| 192 |
-
| spearman_euclidean | 0.8214 |
|
| 193 |
-
| pearson_manhattan | 0.8125 |
|
| 194 |
-
| spearman_manhattan | 0.8226 |
|
| 195 |
-
| pearson_dot | 0.7648 |
|
| 196 |
-
| spearman_dot | 0.7648 |
|
| 197 |
-
| pearson_max | 0.8273 |
|
| 198 |
-
| **spearman_max** | **0.8298** |
|
| 199 |
-
|
| 200 |
<!--
|
| 201 |
## Bias, Risks and Limitations
|
| 202 |
|
|
|
|
| 35 |
- 녹색 버스가 도로를 따라 내려간다.
|
| 36 |
pipeline_tag: sentence-similarity
|
| 37 |
library_name: sentence-transformers
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
---
|
| 39 |
|
| 40 |
# SentenceTransformer based on answerdotai/ModernBERT-base
|
|
|
|
| 124 |
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
| 125 |
-->
|
| 126 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 127 |
<!--
|
| 128 |
## Bias, Risks and Limitations
|
| 129 |
|