Hugging Face's logo

dangvantuan
/
vietnamese-embedding

Sentence Similarity
sentence-transformers
ONNX
Safetensors
Transformers
Vietnamese
roberta
feature-extraction
phobert
vietnamese
sentence-embedding
Model card Files
xet
Community
8
dangvantuan commited on
Commit
3d7ae9e
·
verified ·
1 Parent(s): ad93a90

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -102,26 +102,26 @@ The performance is measured using Pearson and Spearman correlation:
102
  - On dev
103
  | Model | Pearson correlation | Spearman correlation | #params |
104
  | ------------- | ------------- | ------------- |------------- |
105
- | [dangvantuan/vietnamese-embedding](dangvantuan/vietnamese-embedding)| 88.33 |88.2 | 135|
106
- | [VoVanPhuc/sup-SimCSE-VietNamese-phobert-base](https://huggingface.co/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base) | 84.65|84.59 | 135 |
107
  | [keepitreal/vietnamese-sbert](https://huggingface.co/keepitreal/vietnamese-sbert) | 84.51 | 84.44|135M |
108
- | [bkai-foundation-models/vietnamese-bi-encoder](https://huggingface.co/bkai-foundation-models/vietnamese-bi-encoder) | 78.05 | 77.94|135 |
109
 
110
  ### Metric for all dataset of [Semantic Textual Similarity on STS Benchmark](https://huggingface.co/datasets/doanhieung/vi-stsbenchmark)
111
 
112
  **Pearson score**
113
- | Model | [STSB-vn] | [STS12-vn ]| [STS13-vn] | [STS14-vn] | [STS15-vn] | [STS16-vn] | [SICK-fr] | Mean |
114
  |-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
115
- | [dangvantuan/vietnamese-embedding](dangvantuan/vietnamese-embedding) |84.87 |87.23| 85.39| 82.94| 86.91| 79.39| 82.77| 84.21|
116
  | [VoVanPhuc/sup-SimCSE-VietNamese-phobert-base](https://huggingface.co/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base) |81.52| 85.02| 78.22| 75.94| 81.53| 75.39| 77.75| 79.33|
117
  | [keepitreal/vietnamese-sbert](https://huggingface.co/keepitreal/vietnamese-sbert) |80.54| 78.58| 80.75| 76.98| 82.57| 73.21| 80.16| 78.97|
118
  | [bkai-foundation-models/vietnamese-bi-encoder](https://huggingface.co/bkai-foundation-models/vietnamese-bi-encoder) |73.30| 67.84| 71.69| 69.80| 78.40| 74.29| 76.01| 73.04|
119
 
120
 
121
  **Spearman score**
122
- | Model | [STSB-vn] | [STS12-vn ]| [STS13-vn] | [STS14-vn] | [STS15-vn] | [STS16-vn] | [SICK-fr] | Mean |
123
  |-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
124
- | [dangvantuan/vietnamese-embedding](dangvantuan/vietnamese-embedding) |84.84| 79.04| 85.30| 81.38| 87.06| 79.95| 79.58| 82.45|
125
  | [VoVanPhuc/sup-SimCSE-VietNamese-phobert-base](https://huggingface.co/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base) |81.43| 76.51| 79.19| 74.91| 81.72| 76.57| 76.45| 78.11|
126
  | [keepitreal/vietnamese-sbert](https://huggingface.co/keepitreal/vietnamese-sbert) |80.16| 69.08| 80.99| 73.67| 82.81| 74.30| 73.40| 76.34|
127
  | [bkai-foundation-models/vietnamese-bi-encoder](https://huggingface.co/bkai-foundation-models/vietnamese-bi-encoder) |72.16| 63.86| 71.82| 66.20| 78.62| 74.24| 70.87| 71.11|
 
102
  - On dev
103
  | Model | Pearson correlation | Spearman correlation | #params |
104
  | ------------- | ------------- | ------------- |------------- |
105
+ | [dangvantuan/vietnamese-embedding](dangvantuan/vietnamese-embedding)| 88.33 |88.20 | 135M|
106
+ | [VoVanPhuc/sup-SimCSE-VietNamese-phobert-base](https://huggingface.co/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base) | 84.65|84.59 | 135M |
107
  | [keepitreal/vietnamese-sbert](https://huggingface.co/keepitreal/vietnamese-sbert) | 84.51 | 84.44|135M |
108
+ | [bkai-foundation-models/vietnamese-bi-encoder](https://huggingface.co/bkai-foundation-models/vietnamese-bi-encoder) | 78.05 | 77.94|135M |
109
 
110
  ### Metric for all dataset of [Semantic Textual Similarity on STS Benchmark](https://huggingface.co/datasets/doanhieung/vi-stsbenchmark)
111
 
112
  **Pearson score**
113
+ | Model | [STSB] | [STS12]| [STS13] | [STS14] | [STS15] | [STS16] | [SICK] | Mean |
114
  |-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
115
+ | [dangvantuan/vietnamese-embedding](dangvantuan/vietnamese-embedding) |**84.87** |**87.23**| **85.39**| **82.94**| **86.91**| **79.39**| **82.77**| **84.21**|
116
  | [VoVanPhuc/sup-SimCSE-VietNamese-phobert-base](https://huggingface.co/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base) |81.52| 85.02| 78.22| 75.94| 81.53| 75.39| 77.75| 79.33|
117
  | [keepitreal/vietnamese-sbert](https://huggingface.co/keepitreal/vietnamese-sbert) |80.54| 78.58| 80.75| 76.98| 82.57| 73.21| 80.16| 78.97|
118
  | [bkai-foundation-models/vietnamese-bi-encoder](https://huggingface.co/bkai-foundation-models/vietnamese-bi-encoder) |73.30| 67.84| 71.69| 69.80| 78.40| 74.29| 76.01| 73.04|
119
 
120
 
121
  **Spearman score**
122
+ | Model | [STSB] | [STS12]| [STS13] | [STS14] | [STS15] | [STS16] | [SICK] | Mean |
123
  |-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
124
+ | [dangvantuan/vietnamese-embedding](dangvantuan/vietnamese-embedding) |**84.84**| **79.04**| **85.30**| **81.38**| **87.06**| **79.95**| **79.58**| **82.45**|
125
  | [VoVanPhuc/sup-SimCSE-VietNamese-phobert-base](https://huggingface.co/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base) |81.43| 76.51| 79.19| 74.91| 81.72| 76.57| 76.45| 78.11|
126
  | [keepitreal/vietnamese-sbert](https://huggingface.co/keepitreal/vietnamese-sbert) |80.16| 69.08| 80.99| 73.67| 82.81| 74.30| 73.40| 76.34|
127
  | [bkai-foundation-models/vietnamese-bi-encoder](https://huggingface.co/bkai-foundation-models/vietnamese-bi-encoder) |72.16| 63.86| 71.82| 66.20| 78.62| 74.24| 70.87| 71.11|