metadata
language:
- ar
- fr
- en
license: mit
base_model: xlm-roberta-base
tags:
- text-classification
- comment-moderation
- darija
- code-switching
- nlp
metrics:
- accuracy
Relevant / Irrelevant Comment Classifier
A fine-tuned xlm-roberta-base model that classifies social media comments as relevant or irrelevant to the topic they were posted under.
Trained on real-world telecom customer comments (French, Darija, and Arabic), where "irrelevant" covers off-topic chatter, spam, or unrelated remarks mixed in with genuine customer feedback.
Usage
from transformers import pipeline
classifier = pipeline("text-classification", model="Chaima-KHENAFIF/relevant-comment-detector")
classifier("la connexion est très lente")
Training
Fine-tuned on ~2,000 labeled comments scraped from telecom operator social media pages, covering French, Darija (Latin and Arabic script), and Arabic.
Training results
| Epoch | Train Loss | Val Loss | Val Accuracy |
|---|---|---|---|
| 1 | 0.5005 | 0.2117 | 93.56% |
| 2 | 0.2171 | 0.1577 | 95.05% |
| 3 | 0.1743 | 0.1530 | 94.06% |
| 4 | 0.1322 | 0.1546 | 93.56% |
Best validation accuracy of 95.05% reached at epoch 2.
Links
- Full code and training pipeline: GitHub repo