Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,7 @@ license: mit
|
|
| 3 |
tag: text-classification
|
| 4 |
widget:
|
| 5 |
- text: "Sehent hoerent oder lesent daß div chint, div bechoment von frowen Chvnegvnde Heinriches des Losen"
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
# Xlm-roberta (based) language-detection model (modern and medieval)
|
|
@@ -13,14 +14,14 @@ This model is a fine-tuned version of xlm-roberta-base on the [monasterium.net](
|
|
| 13 |
On the top of this XLM-RoBERTa transformer model is a classification head. Please refer this model together with to the [XLM-RoBERTa (base-sized model)](https://huggingface.co/xlm-roberta-base) card or the paper [Unsupervised Cross-lingual Representation Learning at Scale by Conneau et al.](https://arxiv.org/abs/1911.02116) for additional information.
|
| 14 |
|
| 15 |
## Intended uses & limitations
|
| 16 |
-
You can directly use this model as a language detector, i.e. for sequence classification tasks. Currently, it supports the following 40 modern and medieval
|
| 17 |
|
| 18 |
Modern: Bulgarian (bg), Croatian (hr), Czech (cs), Danish (da), Dutch (nl), English (en), Estonian (et), Finnish (fi), French (fr), German (de), Greek (el), Hungarian (hu), Irish (ga), Italian (it), Latvian (lv), Lithuanian (lt), Maltese (mt), Polish (pl), Portuguese (pt), Romanian (ro), Slovak (sk), Slovenian (sl), Spanish (es), Swedish (sv), Russian (ru), Turkish (tr), Basque (eu), Catalan (ca), Albanian (sq), Serbian (se), Ukrainian (uk), Norwegian (no), Arabic (ar), Chinese (zh), Hebrew (he)
|
| 19 |
|
| 20 |
Medieval: Middle High German (mhd), Latin (la), Middle Low German (gml), Old French (fro), Old Chruch Slavonic (chu), Early New High German (fnhd)
|
| 21 |
|
| 22 |
## Training and evaluation data
|
| 23 |
-
The model was fine-tuned
|
| 24 |
|
| 25 |
## Training procedure
|
| 26 |
Fine-tuning was done via the Trainer API with WeightedLossTrainer.
|
|
|
|
| 3 |
tag: text-classification
|
| 4 |
widget:
|
| 5 |
- text: "Sehent hoerent oder lesent daß div chint, div bechoment von frowen Chvnegvnde Heinriches des Losen"
|
| 6 |
+
- text: "Sehent hoerent oder lesent daß div chint, div bechoment von frowen Chvnegvnde Heinriches 3 Losen"
|
| 7 |
---
|
| 8 |
|
| 9 |
# Xlm-roberta (based) language-detection model (modern and medieval)
|
|
|
|
| 14 |
On the top of this XLM-RoBERTa transformer model is a classification head. Please refer this model together with to the [XLM-RoBERTa (base-sized model)](https://huggingface.co/xlm-roberta-base) card or the paper [Unsupervised Cross-lingual Representation Learning at Scale by Conneau et al.](https://arxiv.org/abs/1911.02116) for additional information.
|
| 15 |
|
| 16 |
## Intended uses & limitations
|
| 17 |
+
You can directly use this model as a language detector, i.e. for sequence classification tasks. Currently, it supports the following 40 languages, modern and medieval:
|
| 18 |
|
| 19 |
Modern: Bulgarian (bg), Croatian (hr), Czech (cs), Danish (da), Dutch (nl), English (en), Estonian (et), Finnish (fi), French (fr), German (de), Greek (el), Hungarian (hu), Irish (ga), Italian (it), Latvian (lv), Lithuanian (lt), Maltese (mt), Polish (pl), Portuguese (pt), Romanian (ro), Slovak (sk), Slovenian (sl), Spanish (es), Swedish (sv), Russian (ru), Turkish (tr), Basque (eu), Catalan (ca), Albanian (sq), Serbian (se), Ukrainian (uk), Norwegian (no), Arabic (ar), Chinese (zh), Hebrew (he)
|
| 20 |
|
| 21 |
Medieval: Middle High German (mhd), Latin (la), Middle Low German (gml), Old French (fro), Old Chruch Slavonic (chu), Early New High German (fnhd)
|
| 22 |
|
| 23 |
## Training and evaluation data
|
| 24 |
+
The model was fine-tuned using the Monasterium and Wikipedia datasets, which consist of text sequences in 40 languages. The training set contains 80k samples, while the validation and test sets contain 16k. The average accuracy on the test set is 99.59% (this matches the average macro/weighted F1-score, the test set being perfectly balanced).
|
| 25 |
|
| 26 |
## Training procedure
|
| 27 |
Fine-tuning was done via the Trainer API with WeightedLossTrainer.
|