Commit
·
2b6030e
1
Parent(s):
7569437
Update README.md
Browse files
README.md
CHANGED
|
@@ -85,21 +85,28 @@ test_evaluator(models, output_path="./")
|
|
| 85 |
```
|
| 86 |
**Test Result**:
|
| 87 |
The performance is measured using Pearson and Spearman correlation:
|
|
|
|
| 88 |
- On dev
|
|
|
|
| 89 |
| Model | Pearson correlation | Spearman correlation | #params |
|
| 90 |
| ------------- | ------------- | ------------- |------------- |
|
| 91 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.34 |90.15 | 336M |
|
| 92 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.11 |90.01 | 336M |
|
| 93 |
|
| 94 |
- On test:
|
|
|
|
|
|
|
| 95 |
**Pearson score**
|
| 96 |
-
|
|
|
|
| 97 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
| 98 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8863 | 0.9076 | 0.8824 | 0.9022 | 0.9223 | 0.8231 | 0.8461 |
|
| 99 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8816 | 0.9012 | 0.8836 | 0.8986 | 0.9204 | 0.8201 | 0.8423 |
|
| 100 |
|
| 101 |
**Spearman score**
|
| 102 |
-
|
|
|
|
|
|
|
| 103 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
| 104 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8803 | 0.8487 | 0.8788 | 0.8910 | 0.9216 | 0.8250 | 0.8078 |
|
| 105 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8757 | 0.8424 | 0.8801 | 0.8862 | 0.9199 | 0.8216 | 0.8038 |
|
|
|
|
| 85 |
```
|
| 86 |
**Test Result**:
|
| 87 |
The performance is measured using Pearson and Spearman correlation:
|
| 88 |
+
|
| 89 |
- On dev
|
| 90 |
+
|
| 91 |
| Model | Pearson correlation | Spearman correlation | #params |
|
| 92 |
| ------------- | ------------- | ------------- |------------- |
|
| 93 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.34 |90.15 | 336M |
|
| 94 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large)| 90.11 |90.01 | 336M |
|
| 95 |
|
| 96 |
- On test:
|
| 97 |
+
|
| 98 |
+
|
| 99 |
**Pearson score**
|
| 100 |
+
|
| 101 |
+
| Model | STS-B | STS12-fr | STS13-fr | STS14-fr | STS15-fr | STS16-fr | SICK-fr |
|
| 102 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
| 103 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8863 | 0.9076 | 0.8824 | 0.9022 | 0.9223 | 0.8231 | 0.8461 |
|
| 104 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8816 | 0.9012 | 0.8836 | 0.8986 | 0.9204 | 0.8201 | 0.8423 |
|
| 105 |
|
| 106 |
**Spearman score**
|
| 107 |
+
|
| 108 |
+
|
| 109 |
+
| Model | STS-B | STS12-fr | STS13-fr | STS14-fr | STS15-fr | STS16-fr | SICK-fr |
|
| 110 |
|---------------------------------------|--------|----------|----------|----------|----------|----------|---------|-----------|
|
| 111 |
| [Lajavaness/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8803 | 0.8487 | 0.8788 | 0.8910 | 0.9216 | 0.8250 | 0.8078 |
|
| 112 |
| [dangvantuan/CrossEncoder-camembert-large](https://huggingface.co/dangvantuan/CrossEncoder-camembert-large) | 0.8757 | 0.8424 | 0.8801 | 0.8862 | 0.9199 | 0.8216 | 0.8038 |
|