Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
## BERT Medium for Luxembourgish
|
| 2 |
+
|
| 3 |
+
Created from a dataset with 1M Luxembourgish sentences from Wikipedia. Corpus has approx. 16M words.
|
| 4 |
+
MLM objective was trained.
|
| 5 |
+
The BERT model has parameters `L=8` and `H=512`.
|
| 6 |
+
Vocabulary has 70K word pieces.
|