Text Classification
Transformers
Safetensors
bert
pruthwik commited on
Commit
4d25dfe
·
verified ·
1 Parent(s): 82c1671
Files changed (1) hide show
  1. README.md +25 -27
README.md CHANGED
@@ -7,7 +7,7 @@ tags: []
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
 
10
-
11
 
12
  ## Model Details
13
 
@@ -17,48 +17,43 @@ tags: []
17
 
18
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
 
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
  - **Shared by [optional]:** [More Information Needed]
23
  - **Model type:** [More Information Needed]
24
  - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
 
28
  ### Model Sources [optional]
29
 
30
  <!-- Provide the basic links for the model. -->
31
 
32
- - **Repository:** [More Information Needed]
33
- - **Paper [optional]:** [More Information Needed]
34
  - **Demo [optional]:** [More Information Needed]
35
 
36
  ## Uses
37
 
38
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
-
40
  ### Direct Use
41
 
42
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
 
46
  ### Downstream Use [optional]
47
 
48
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
 
50
  [More Information Needed]
51
 
52
  ### Out-of-Scope Use
53
 
54
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
-
56
  [More Information Needed]
57
 
58
  ## Bias, Risks, and Limitations
59
 
60
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
-
62
  [More Information Needed]
63
 
64
  ### Recommendations
@@ -96,14 +91,12 @@ Use the code below to get started with the model.
96
 
97
  #### Speeds, Sizes, Times [optional]
98
 
99
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
-
101
  [More Information Needed]
102
 
103
  ## Evaluation
104
 
105
- <!-- This section describes the evaluation protocols and provides the results. -->
106
-
107
  ### Testing Data, Factors & Metrics
108
 
109
  #### Testing Data
@@ -120,14 +113,12 @@ Use the code below to get started with the model.
120
 
121
  #### Metrics
122
 
123
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
-
125
  [More Information Needed]
126
 
127
  ### Results
128
 
129
- [More Information Needed]
130
-
131
  #### Summary
132
 
133
 
@@ -174,8 +165,15 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
174
 
175
  **BibTeX:**
176
 
177
- [More Information Needed]
178
-
 
 
 
 
 
 
 
179
  **APA:**
180
 
181
  [More Information Needed]
 
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
 
10
+ The model is a MuRIL based finetuned model on the language identification task. The model can identify English and all 22 official Indian languaages.
11
 
12
  ## Model Details
13
 
 
17
 
18
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
 
20
+ - **Developed by:** Pruthwik Mishra, Yash Ingle
21
+ - **Funded by [optional]:** SVNIT, Surat
22
  - **Shared by [optional]:** [More Information Needed]
23
  - **Model type:** [More Information Needed]
24
  - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** MIT
26
+ - **Finetuned from model [optional]:** google/muril-base-cased
27
 
28
  ### Model Sources [optional]
29
 
30
  <!-- Provide the basic links for the model. -->
31
 
32
+ - **Repository:** [https://github.com/yashingle-ai/TextLangDetect]
33
+ - **Paper [optional]:** [https://arxiv.org/abs/2507.11832]
34
  - **Demo [optional]:** [More Information Needed]
35
 
36
  ## Uses
37
 
38
+ The model can be directly used for English and Indian language identification.
 
39
  ### Direct Use
40
 
41
+ The model can be directly used for English and Indian language identification.
 
 
42
 
43
  ### Downstream Use [optional]
44
 
45
+ Can be integrated into any pipeline that requires language identification for the concerned languages.
46
 
47
  [More Information Needed]
48
 
49
  ### Out-of-Scope Use
50
 
51
+ The model may not work for languages other than English and Indian languages.
 
52
  [More Information Needed]
53
 
54
  ## Bias, Risks, and Limitations
55
 
56
+ The model may not perform well on very resource poor languages such as Manipuri (in Meitei script), Sindhi, Maithili.
 
57
  [More Information Needed]
58
 
59
  ### Recommendations
 
91
 
92
  #### Speeds, Sizes, Times [optional]
93
 
94
+ 250K Dataset named ILID (Indian Language Identification Dataset)
 
95
  [More Information Needed]
96
 
97
  ## Evaluation
98
 
99
+ The models are evaluated on the created corpora and the Bhasha-Abhijnaanam benchmark.
 
100
  ### Testing Data, Factors & Metrics
101
 
102
  #### Testing Data
 
113
 
114
  #### Metrics
115
 
116
+ F1-score
 
117
  [More Information Needed]
118
 
119
  ### Results
120
 
121
+ 0.96 F1 on an average
 
122
  #### Summary
123
 
124
 
 
165
 
166
  **BibTeX:**
167
 
168
+ @misc{ingle2025ilidnativescriptlanguage,
169
+ title={ILID: Native Script Language Identification for Indian Languages},
170
+ author={Yash Ingle and Pruthwik Mishra},
171
+ year={2025},
172
+ eprint={2507.11832},
173
+ archivePrefix={arXiv},
174
+ primaryClass={cs.CL},
175
+ url={https://arxiv.org/abs/2507.11832},
176
+ }
177
  **APA:**
178
 
179
  [More Information Needed]