Abdellah EL MEKKI commited on
Commit ·
330dea7
1
Parent(s): e14a9e0
Update README.md
Browse files
README.md
CHANGED
|
@@ -111,6 +111,10 @@ This is a repo of the language model used for "AdaSL: An Unsupervised Domain Ada
|
|
| 111 |
|
| 112 |
### About the Dialectal-Arabic-XLM-R-Base model
|
| 113 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 114 |
We have built a 5 million Tweets corpus from Twitter. The crawled tweets cover the dialects of the four Arabic world regions (EGY, GLF, LEV, and MAG regions), as well as MSA. The collected corpus consists of one million (1M) tweets per Arabic variant. We did not perform any text pre-processing on the tweets, except by removing tweets that have a small length (tweets containing less than four words).
|
| 115 |
|
| 116 |
### Usage
|
|
|
|
| 111 |
|
| 112 |
### About the Dialectal-Arabic-XLM-R-Base model
|
| 113 |
|
| 114 |
+
This model is an trained as a further pre-trained of XLM-RoBERTa base using the Masked-language modeling on a dialectal Arabic corpus.
|
| 115 |
+
|
| 116 |
+
### About the Dialectal-Arabic-XLM-R-Base model training corpora
|
| 117 |
+
|
| 118 |
We have built a 5 million Tweets corpus from Twitter. The crawled tweets cover the dialects of the four Arabic world regions (EGY, GLF, LEV, and MAG regions), as well as MSA. The collected corpus consists of one million (1M) tweets per Arabic variant. We did not perform any text pre-processing on the tweets, except by removing tweets that have a small length (tweets containing less than four words).
|
| 119 |
|
| 120 |
### Usage
|