Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ We trained the model using the architecture and [https://github.com/xplip/pixel]
|
|
| 16 |
This model has been used in the paper Evaluating Pixel Language Models on Non-Standardized Languages, accepted at COLING 2025.
|
| 17 |
|
| 18 |
## Model description
|
| 19 |
-
*Description from [https://huggingface.co/Team-PIXEL/pixel-base]()*
|
| 20 |
|
| 21 |
PIXEL consists of three major components: a text renderer, which draws text as an image; an encoder, which encodes the unmasked regions of the rendered image; and a decoder, which reconstructs the masked regions at the pixel level. It is built on ViT-MAE.
|
| 22 |
|
|
@@ -29,7 +29,7 @@ For more details on how PIXEL works, please check the paper and the codebase lin
|
|
| 29 |
|
| 30 |
## Training and evaluation data
|
| 31 |
|
| 32 |
-
This model has been trained renderized German text from [https://huggingface.co/
|
| 33 |
|
| 34 |
### Training hyperparameters
|
| 35 |
|
|
|
|
| 16 |
This model has been used in the paper Evaluating Pixel Language Models on Non-Standardized Languages, accepted at COLING 2025.
|
| 17 |
|
| 18 |
## Model description
|
| 19 |
+
*Description from [https://huggingface.co/Team-PIXEL/pixel-base](https://huggingface.co/Team-PIXEL/pixel-base)*
|
| 20 |
|
| 21 |
PIXEL consists of three major components: a text renderer, which draws text as an image; an encoder, which encodes the unmasked regions of the rendered image; and a decoder, which reconstructs the masked regions at the pixel level. It is built on ViT-MAE.
|
| 22 |
|
|
|
|
| 29 |
|
| 30 |
## Training and evaluation data
|
| 31 |
|
| 32 |
+
This model has been trained renderized German text from [https://huggingface.co/datasets/stefan-it/german-dbmdz-bert-corpus](https://huggingface.co/datasets/stefan-it/german-dbmdz-bert-corpus).
|
| 33 |
|
| 34 |
### Training hyperparameters
|
| 35 |
|