messalti commited on
Commit
bae22bf
·
verified ·
1 Parent(s): 3ff9e3f

Create NumidiaNLP organization card

Browse files
Files changed (1) hide show
  1. README.md +160 -10
README.md CHANGED
@@ -1,10 +1,160 @@
1
- ---
2
- title: README
3
- emoji: 📚
4
- colorFrom: pink
5
- colorTo: yellow
6
- sdk: static
7
- pinned: false
8
- ---
9
-
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: NumidiaNLP
3
+ emoji: 🌍
4
+ colorFrom: blue
5
+ colorTo: green
6
+ sdk: static
7
+ pinned: false
8
+ ---
9
+
10
+ <div align="center">
11
+
12
+ # NumidiaNLP
13
+
14
+ ### Natural Language Processing for Maghrebi Arabic
15
+
16
+ **Models · Datasets · Evaluation · Reproducible Research**
17
+
18
+ </div>
19
+
20
+ ---
21
+
22
+ ## About NumidiaNLP
23
+
24
+ **NumidiaNLP** is a research initiative focused on Natural Language Processing
25
+ for **Maghrebi Arabic and North African social-media language**.
26
+
27
+ Our work investigates computational representations of the linguistic
28
+ variation observed across **Algeria, Morocco, and Tunisia**, including
29
+ dialectal Arabic, non-standard orthography, Arabizi, and multilingual
30
+ code-switching.
31
+
32
+ The objective is to develop and evaluate reusable language resources that
33
+ support rigorous and reproducible research on underrepresented Maghrebi
34
+ language varieties.
35
+
36
+ ---
37
+
38
+ ## Research Areas
39
+
40
+ Our current research focuses on:
41
+
42
+ - Maghrebi Arabic language modeling
43
+ - Regional language-model adaptation
44
+ - Hate and offensive language detection
45
+ - Sentiment analysis
46
+ - Arabizi and Latin-script Maghrebi Arabic
47
+ - Arabic–French and multilingual code-switching
48
+ - Maghrebi dialect identification
49
+ - Corpus construction and annotation
50
+ - Robust and reproducible NLP evaluation
51
+
52
+ ---
53
+
54
+ ## MagharibiBERT
55
+
56
+ ### A Regionally Adapted Language Model for Maghrebi Arabic
57
+
58
+ [**MagharibiBERT**](https://huggingface.co/NumidiaNLP/MagharibiBERT)
59
+ is a regional language model developed to provide reusable contextual
60
+ representations for heterogeneous Maghrebi Arabic.
61
+
62
+ The model follows a continued-pretraining strategy over a large and diverse
63
+ collection of Maghrebi text covering Algerian, Moroccan, and Tunisian
64
+ linguistic variation.
65
+
66
+ Its training data preserve important characteristics of real-world Maghrebi
67
+ communication, including:
68
+
69
+ - dialectal Arabic;
70
+ - spelling variation;
71
+ - Arabizi;
72
+ - Arabic–French/English code-switching;
73
+ - informal social-media language.
74
+
75
+ The objective is not to replace country-specific models, but to investigate
76
+ whether **regional continued pretraining can provide transferable
77
+ representations across Maghrebi countries and NLP tasks**.
78
+
79
+ ➡️ **Model:** https://huggingface.co/NumidiaNLP/MagharibiBERT
80
+
81
+ ---
82
+
83
+ ## Evaluation Philosophy
84
+
85
+ NumidiaNLP promotes evaluation practices that go beyond reporting a single
86
+ best score.
87
+
88
+ Our experiments emphasize:
89
+
90
+ - fixed train/validation/test partitions;
91
+ - multiple random seeds;
92
+ - Macro-F1 as a primary metric for imbalanced classification tasks;
93
+ - validation-based model selection;
94
+ - comparisons with regional and general Arabic language models;
95
+ - statistical analysis where appropriate;
96
+ - computational-cost reporting;
97
+ - transparent reporting of limitations and negative results.
98
+
99
+ We consider cross-country robustness and stability important criteria when
100
+ evaluating regional Maghrebi language models.
101
+
102
+ ---
103
+
104
+ ## Regional Perspective
105
+
106
+ Maghrebi Arabic is characterized by substantial variation across countries,
107
+ communities, writing systems, and communication contexts.
108
+
109
+ For this reason, NumidiaNLP studies the Maghreb not as a single homogeneous
110
+ dialect, but as a **linguistically diverse regional continuum**.
111
+
112
+ Our research aims to understand when regional representations are beneficial,
113
+ when country-specific models remain preferable, and how both approaches can
114
+ complement each other.
115
+
116
+ ---
117
+
118
+ ## Open and Reproducible Research
119
+
120
+ Where licensing, ethical requirements, and publication policies permit,
121
+ NumidiaNLP aims to provide:
122
+
123
+ - pretrained models;
124
+ - evaluation code;
125
+ - benchmark configurations;
126
+ - dataset documentation;
127
+ - reproducible experimental protocols.
128
+
129
+ Research artifacts are released with appropriate documentation describing
130
+ their intended use and limitations.
131
+
132
+ ---
133
+
134
+ ## Resources
135
+
136
+ | Resource | Description |
137
+ |---|---|
138
+ | 🤗 [MagharibiBERT](https://huggingface.co/NumidiaNLP/MagharibiBERT) | Regional language model for Maghrebi Arabic |
139
+ | 📚 Models | Pretrained and task-adapted Maghrebi NLP models |
140
+ | 📊 Benchmarks | Reproducible evaluation across Maghrebi NLP tasks |
141
+ | 🗂️ Datasets | Documented linguistic resources released when permitted |
142
+
143
+ ---
144
+
145
+ ## Citation
146
+
147
+ Scientific publications and corresponding citation information will be linked
148
+ to each released model and dataset through their individual repository cards.
149
+
150
+ ---
151
+
152
+ <div align="center">
153
+
154
+ ### NumidiaNLP
155
+
156
+ **Advancing reproducible NLP research for the linguistic diversity of the Maghreb.**
157
+
158
+ Algeria · Morocco · Tunisia
159
+
160
+ </div>