messalti commited on
Commit
4bd61c3
ยท
verified ยท
1 Parent(s): d29b81d

Update NumidiaNLP organization card

Browse files
Files changed (1) hide show
  1. README.md +145 -160
README.md CHANGED
@@ -1,160 +1,145 @@
1
- ---
2
- title: NumidiaNLP
3
- emoji: ๐ŸŒ
4
- colorFrom: blue
5
- colorTo: green
6
- sdk: static
7
- pinned: false
8
- ---
9
-
10
- <div align="center">
11
-
12
- # NumidiaNLP
13
-
14
- ### Natural Language Processing for Maghrebi Arabic
15
-
16
- **Models ยท Datasets ยท Evaluation ยท Reproducible Research**
17
-
18
- </div>
19
-
20
- ---
21
-
22
- ## About NumidiaNLP
23
-
24
- **NumidiaNLP** is a research initiative focused on Natural Language Processing
25
- for **Maghrebi Arabic and North African social-media language**.
26
-
27
- Our work investigates computational representations of the linguistic
28
- variation observed across **Algeria, Morocco, and Tunisia**, including
29
- dialectal Arabic, non-standard orthography, Arabizi, and multilingual
30
- code-switching.
31
-
32
- The objective is to develop and evaluate reusable language resources that
33
- support rigorous and reproducible research on underrepresented Maghrebi
34
- language varieties.
35
-
36
- ---
37
-
38
- ## Research Areas
39
-
40
- Our current research focuses on:
41
-
42
- - Maghrebi Arabic language modeling
43
- - Regional language-model adaptation
44
- - Hate and offensive language detection
45
- - Sentiment analysis
46
- - Arabizi and Latin-script Maghrebi Arabic
47
- - Arabicโ€“French and multilingual code-switching
48
- - Maghrebi dialect identification
49
- - Corpus construction and annotation
50
- - Robust and reproducible NLP evaluation
51
-
52
- ---
53
-
54
- ## MagharibiBERT
55
-
56
- ### A Regionally Adapted Language Model for Maghrebi Arabic
57
-
58
- [**MagharibiBERT**](https://huggingface.co/NumidiaNLP/MagharibiBERT)
59
- is a regional language model developed to provide reusable contextual
60
- representations for heterogeneous Maghrebi Arabic.
61
-
62
- The model follows a continued-pretraining strategy over a large and diverse
63
- collection of Maghrebi text covering Algerian, Moroccan, and Tunisian
64
- linguistic variation.
65
-
66
- Its training data preserve important characteristics of real-world Maghrebi
67
- communication, including:
68
-
69
- - dialectal Arabic;
70
- - spelling variation;
71
- - Arabizi;
72
- - Arabicโ€“French/English code-switching;
73
- - informal social-media language.
74
-
75
- The objective is not to replace country-specific models, but to investigate
76
- whether **regional continued pretraining can provide transferable
77
- representations across Maghrebi countries and NLP tasks**.
78
-
79
- โžก๏ธ **Model:** https://huggingface.co/NumidiaNLP/MagharibiBERT
80
-
81
- ---
82
-
83
- ## Evaluation Philosophy
84
-
85
- NumidiaNLP promotes evaluation practices that go beyond reporting a single
86
- best score.
87
-
88
- Our experiments emphasize:
89
-
90
- - fixed train/validation/test partitions;
91
- - multiple random seeds;
92
- - Macro-F1 as a primary metric for imbalanced classification tasks;
93
- - validation-based model selection;
94
- - comparisons with regional and general Arabic language models;
95
- - statistical analysis where appropriate;
96
- - computational-cost reporting;
97
- - transparent reporting of limitations and negative results.
98
-
99
- We consider cross-country robustness and stability important criteria when
100
- evaluating regional Maghrebi language models.
101
-
102
- ---
103
-
104
- ## Regional Perspective
105
-
106
- Maghrebi Arabic is characterized by substantial variation across countries,
107
- communities, writing systems, and communication contexts.
108
-
109
- For this reason, NumidiaNLP studies the Maghreb not as a single homogeneous
110
- dialect, but as a **linguistically diverse regional continuum**.
111
-
112
- Our research aims to understand when regional representations are beneficial,
113
- when country-specific models remain preferable, and how both approaches can
114
- complement each other.
115
-
116
- ---
117
-
118
- ## Open and Reproducible Research
119
-
120
- Where licensing, ethical requirements, and publication policies permit,
121
- NumidiaNLP aims to provide:
122
-
123
- - pretrained models;
124
- - evaluation code;
125
- - benchmark configurations;
126
- - dataset documentation;
127
- - reproducible experimental protocols.
128
-
129
- Research artifacts are released with appropriate documentation describing
130
- their intended use and limitations.
131
-
132
- ---
133
-
134
- ## Resources
135
-
136
- | Resource | Description |
137
- |---|---|
138
- | ๐Ÿค— [MagharibiBERT](https://huggingface.co/NumidiaNLP/MagharibiBERT) | Regional language model for Maghrebi Arabic |
139
- | ๐Ÿ“š Models | Pretrained and task-adapted Maghrebi NLP models |
140
- | ๐Ÿ“Š Benchmarks | Reproducible evaluation across Maghrebi NLP tasks |
141
- | ๐Ÿ—‚๏ธ Datasets | Documented linguistic resources released when permitted |
142
-
143
- ---
144
-
145
- ## Citation
146
-
147
- Scientific publications and corresponding citation information will be linked
148
- to each released model and dataset through their individual repository cards.
149
-
150
- ---
151
-
152
- <div align="center">
153
-
154
- ### NumidiaNLP
155
-
156
- **Advancing reproducible NLP research for the linguistic diversity of the Maghreb.**
157
-
158
- Algeria ยท Morocco ยท Tunisia
159
-
160
- </div>
 
1
+ ---
2
+ title: NumidiaNLP
3
+ emoji: ๐ŸŒ
4
+ colorFrom: red
5
+ colorTo: yellow
6
+ sdk: static
7
+ pinned: false
8
+ ---
9
+
10
+ <div align="center">
11
+
12
+ # NumidiaNLP
13
+
14
+ ### Natural Language Processing for Maghrebi Arabic
15
+
16
+ **Language Models ยท Resources ยท Evaluation ยท Reproducible Research**
17
+
18
+ </div>
19
+
20
+ ---
21
+
22
+ ## About
23
+
24
+ **NumidiaNLP** is a research initiative dedicated to Natural Language
25
+ Processing for **Maghrebi Arabic and North African digital language**.
26
+
27
+ Our research focuses on the linguistic diversity observed across
28
+ **Algeria, Morocco, and Tunisia**, including dialectal Arabic,
29
+ non-standard orthography, **Arabizi**, and multilingual
30
+ **code-switching**.
31
+
32
+ The broader objective is to develop reusable language models, datasets,
33
+ and evaluation resources for underrepresented Maghrebi language varieties.
34
+
35
+ ---
36
+
37
+ ## Research Focus
38
+
39
+ - Maghrebi Arabic language modeling
40
+ - Regional continued pretraining
41
+ - Algerian, Moroccan, and Tunisian Arabic
42
+ - Arabizi and Latin-script Maghrebi Arabic
43
+ - Arabicโ€“French and multilingual code-switching
44
+ - Hate and offensive language detection
45
+ - Sentiment analysis
46
+ - Dialect identification
47
+ - Corpus construction and annotation
48
+ - Robust and reproducible NLP evaluation
49
+
50
+ ---
51
+
52
+ ## ๐ŸŒ MagharibiBERT
53
+
54
+ ### A Regionally Adapted Language Model for Maghrebi Arabic
55
+
56
+ **MagharibiBERT** is a regional language model developed to provide
57
+ reusable contextual representations for heterogeneous Maghrebi Arabic.
58
+
59
+ It is adapted through large-scale continued pretraining over diverse
60
+ Maghrebi text representing linguistic variation from Algeria, Morocco,
61
+ and Tunisia.
62
+
63
+ The training resources preserve important characteristics of real-world
64
+ Maghrebi communication, including dialectal variation, non-standard
65
+ orthography, Arabizi, and multilingual code-switching.
66
+
67
+ The central research question is:
68
+
69
+ > **Can regional continued pretraining provide transferable language
70
+ > representations across Maghrebi countries and NLP tasks?**
71
+
72
+ ๐Ÿค— **Model:**
73
+ https://huggingface.co/NumidiaNLP/MagharibiBERT
74
+
75
+ ---
76
+
77
+ ## Regional Perspective
78
+
79
+ Maghrebi Arabic is not treated as a single homogeneous dialect.
80
+
81
+ Instead, we consider it a **linguistically diverse regional continuum**
82
+ with substantial variation across countries, communities, scripts,
83
+ platforms, and communication contexts.
84
+
85
+ Our research therefore investigates both:
86
+
87
+ - the value of **shared regional representations**, and
88
+ - the complementary strengths of **country-specific models**.
89
+
90
+ ---
91
+
92
+ ## Evaluation Principles
93
+
94
+ Our experimental methodology emphasizes:
95
+
96
+ - fixed train/validation/test partitions;
97
+ - multiple random seeds;
98
+ - validation-based checkpoint selection;
99
+ - Macro-F1 for imbalanced classification tasks;
100
+ - comparisons with general Arabic and regional language models;
101
+ - statistical analysis where appropriate;
102
+ - reporting of computational requirements;
103
+ - transparent reporting of limitations and negative results.
104
+
105
+ The objective is not merely to obtain the highest score on one dataset,
106
+ but to study **cross-country robustness, stability, and transferability**.
107
+
108
+ ---
109
+
110
+ ## Resources
111
+
112
+ | Resource | Description |
113
+ |---|---|
114
+ | ๐Ÿค— **MagharibiBERT** | Regional language model for Maghrebi Arabic |
115
+ | ๐Ÿ“š **Models** | Maghrebi and task-adapted NLP models |
116
+ | ๐Ÿ“Š **Benchmarks** | Cross-country and cross-task evaluation |
117
+ | ๐Ÿ—‚๏ธ **Datasets** | Documented Maghrebi NLP resources when licensing permits |
118
+
119
+ ---
120
+
121
+ ## Reproducible Research
122
+
123
+ Where publication, licensing, and ethical requirements permit,
124
+ NumidiaNLP aims to release:
125
+
126
+ - pretrained models;
127
+ - evaluation code;
128
+ - benchmark configurations;
129
+ - dataset documentation;
130
+ - reproducible experimental protocols.
131
+
132
+ Each released resource is accompanied by documentation describing its
133
+ provenance, intended use, evaluation setting, and limitations.
134
+
135
+ ---
136
+
137
+ <div align="center">
138
+
139
+ ### NumidiaNLP
140
+
141
+ **Advancing NLP research for the linguistic diversity of the Maghreb**
142
+
143
+ ๐Ÿ‡ฉ๐Ÿ‡ฟ Algeria ยท ๐Ÿ‡ฒ๐Ÿ‡ฆ Morocco ยท ๐Ÿ‡น๐Ÿ‡ณ Tunisia
144
+
145
+ </div>