Update README.md
Browse files
README.md
CHANGED
|
@@ -46,7 +46,7 @@ language:
|
|
| 46 |
|
| 47 |
# Model Card for EntityCS-39-PEP_MS_MLM-xlmr-base
|
| 48 |
|
| 49 |
-
This model has been trained on the EntityCS corpus,
|
| 50 |
The corpus can be found in [https://huggingface.co/huawei-noah/entity_cs](https://huggingface.co/huawei-noah/entity_cs), check the link for more details.
|
| 51 |
|
| 52 |
Firstly, we employ the conventional 80-10-10 MLM objective, where 15% of sentence subwords are considered as masking candidates. From those, we replace subwords
|
|
|
|
| 46 |
|
| 47 |
# Model Card for EntityCS-39-PEP_MS_MLM-xlmr-base
|
| 48 |
|
| 49 |
+
This model has been trained on the EntityCS corpus, an English corpus from Wikipedia with replaced entities in different languages.
|
| 50 |
The corpus can be found in [https://huggingface.co/huawei-noah/entity_cs](https://huggingface.co/huawei-noah/entity_cs), check the link for more details.
|
| 51 |
|
| 52 |
Firstly, we employ the conventional 80-10-10 MLM objective, where 15% of sentence subwords are considered as masking candidates. From those, we replace subwords
|