Update README.md
Browse files
README.md
CHANGED
|
@@ -114,6 +114,44 @@ Here are the results on 3 downstream tasks on Vietnamese social media texts, inc
|
|
| 114 |
</div>
|
| 115 |
</table>
|
| 116 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 117 |
<!-- ## Usage (HuggingFace Transformers)
|
| 118 |
|
| 119 |
Install `transformers` package:
|
|
@@ -157,4 +195,6 @@ We fine-tune `5CD-AI/visocial-T5-base` on 3 downstream tasks with `transformers`
|
|
| 157 |
|
| 158 |
[6] [ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processing](https://aclanthology.org/2023.emnlp-main.315/)
|
| 159 |
|
| 160 |
-
[7] [ViHateT5: Enhancing Hate Speech Detection in Vietnamese With A Unified Text-to-Text Transformer Model](https://arxiv.org/abs/2405.14141)
|
|
|
|
|
|
|
|
|
| 114 |
</div>
|
| 115 |
</table>
|
| 116 |
|
| 117 |
+
Visocial-T5-base versus other T5-based models in terms of Vietnamese HSD-related task performance with Macro F1-score:
|
| 118 |
+
|
| 119 |
+
<table border="1" cellspacing="0" cellpadding="5">
|
| 120 |
+
<tr align="center">
|
| 121 |
+
<td rowspan=2><b>Model</b></td>
|
| 122 |
+
<td colspan=3><b>MF1</b></td>
|
| 123 |
+
</tr>
|
| 124 |
+
<tr align="center">
|
| 125 |
+
<td><b>Hate Speech Detection</b></td>
|
| 126 |
+
<td><b>Toxic Speech Detection</b></td>
|
| 127 |
+
<td><b>Hate Spans Detection</b></td>
|
| 128 |
+
</tr>
|
| 129 |
+
<tr align="center">
|
| 130 |
+
<td align="left">mT5[1]</td>
|
| 131 |
+
<td>66.76</td>
|
| 132 |
+
<td>69.93</td>
|
| 133 |
+
<td>86.60</td>
|
| 134 |
+
</tr>
|
| 135 |
+
<tr align="center">
|
| 136 |
+
<td align="left">ViT5[8]</td>
|
| 137 |
+
<td>66.95</td>
|
| 138 |
+
<td>64.82</td>
|
| 139 |
+
<td>86.90</td>
|
| 140 |
+
</tr>
|
| 141 |
+
<tr align="center">
|
| 142 |
+
<td align="left">ViHateT5[7]</td>
|
| 143 |
+
<td>68.67</td>
|
| 144 |
+
<td>71.63</td>
|
| 145 |
+
<td>86.37</td>
|
| 146 |
+
</tr>
|
| 147 |
+
<tr align="center">
|
| 148 |
+
<td align="left"><b>visocial-T5-base(Ours)</td>
|
| 149 |
+
<td><b>71.90</td>
|
| 150 |
+
<td><b>73.81</td>
|
| 151 |
+
<td><b>89.04</td>
|
| 152 |
+
</tr>
|
| 153 |
+
</table>
|
| 154 |
+
|
| 155 |
<!-- ## Usage (HuggingFace Transformers)
|
| 156 |
|
| 157 |
Install `transformers` package:
|
|
|
|
| 195 |
|
| 196 |
[6] [ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processing](https://aclanthology.org/2023.emnlp-main.315/)
|
| 197 |
|
| 198 |
+
[7] [ViHateT5: Enhancing Hate Speech Detection in Vietnamese With A Unified Text-to-Text Transformer Model](https://arxiv.org/abs/2405.14141)
|
| 199 |
+
|
| 200 |
+
[8] [ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation](https://aclanthology.org/2022.naacl-srw.18/)
|