Fill-Mask
Transformers
Safetensors
Albanian
xlm-roberta
albanian
albanian-nlp
masked-language-model
social-media
social-media-nlp
informal-text
noisy-text
low-resource-nlp
domain-adaptive-pretraining
text-classification
sentiment-analysis
hate-speech-detection
dialect-detection
Instructions to use Endrit/AlbaSocialXLM-R with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Endrit/AlbaSocialXLM-R with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="Endrit/AlbaSocialXLM-R")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("Endrit/AlbaSocialXLM-R") model = AutoModelForMaskedLM.from_pretrained("Endrit/AlbaSocialXLM-R", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ tags:
|
|
| 24 |
|
| 25 |
# AlbaSocialXLM-R
|
| 26 |
|
| 27 |
-
**AlbaSocialXLM-R** is a social-media-adapted XLM-RoBERTa model for Albanian. It is based on `FacebookAI/xlm-roberta-base` and was further adapted with continued masked language model pretraining on more than **
|
| 28 |
|
| 29 |
The model is mainly intended as a reusable encoder for Albanian **social-media classification tasks**, especially when the text is informal, noisy, dialectal, written without diacritics, or shaped by online communication style.
|
| 30 |
|
|
|
|
| 24 |
|
| 25 |
# AlbaSocialXLM-R
|
| 26 |
|
| 27 |
+
**AlbaSocialXLM-R** is a social-media-adapted XLM-RoBERTa model for Albanian. It is based on `FacebookAI/xlm-roberta-base` and was further adapted with continued masked language model pretraining on more than **500,000 Albanian social-media comments**, including original and controlled synthetic social-media variants.
|
| 28 |
|
| 29 |
The model is mainly intended as a reusable encoder for Albanian **social-media classification tasks**, especially when the text is informal, noisy, dialectal, written without diacritics, or shaped by online communication style.
|
| 30 |
|