HCSCRheuma commited on
Commit
4c2b47c
·
1 Parent(s): f82a166

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +227 -1
README.md CHANGED
@@ -2,4 +2,230 @@
2
  license: cc-by-4.0
3
  language:
4
  - es
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: cc-by-4.0
3
  language:
4
  - es
5
+ pipeline_tag: token-classification
6
+ ---
7
+
8
+ # Model Card for Model ID
9
+
10
+ <!-- Provide a quick summary of what the model is/does. -->
11
+ This model aims to recognise occupation mentions (NER) in Spanish clinical notes and to whom the occupation belongs.
12
+
13
+ ## Model Details
14
+
15
+ <style type="text/css">
16
+ .tg {border-collapse:collapse;border-spacing:0;}
17
+ .tg td{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;
18
+ overflow:hidden;padding:10px 5px;word-break:normal;}
19
+ .tg th{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;
20
+ font-weight:normal;overflow:hidden;padding:10px 5px;word-break:normal;}
21
+ .tg .tg-c3ow{border-color:inherit;text-align:center;vertical-align:top}
22
+ </style>
23
+ <table class="tg">
24
+ <thead>
25
+ <tr>
26
+ <th class="tg-c3ow">PLM Model</th>
27
+ <th class="tg-c3ow">Learning<br>rate</th>
28
+ <th class="tg-c3ow">Batch size</th>
29
+ <th class="tg-c3ow">Epochs</th>
30
+ <th class="tg-c3ow">Max<br>length</th>
31
+ <th class="tg-c3ow">Optimizer</th>
32
+ <th class="tg-c3ow">Max clip<br>grad norm</th>
33
+ <th class="tg-c3ow">Epsilon</th>
34
+ </tr>
35
+ </thead>
36
+ <tbody>
37
+ <tr>
38
+ <td class="tg-c3ow">PlanTL-GOB-ES/<br>roberta-base-biomedical-es<br></td>
39
+ <td class="tg-c3ow">2e-05</td>
40
+ <td class="tg-c3ow">8</td>
41
+ <td class="tg-c3ow">10</td>
42
+ <td class="tg-c3ow">510</td>
43
+ <td class="tg-c3ow">AdamW</td>
44
+ <td class="tg-c3ow">1</td>
45
+ <td class="tg-c3ow">1e-08</td>
46
+ </tr>
47
+ </tbody>
48
+ </table>
49
+
50
+ ### Model Description
51
+
52
+ PlanTL-GOB-ES/roberta-base-biomedical-es model was fine-tuned using MEDDOPROF corpus (Salvador Lima-López, Eulàlia Farré-Maduell, Antonio Miranda-Escalada, Vicent Briva-Iglesias, & Martin Krallinger. (2022). MEDDOPROF corpus: complete gold standard annotations for occupation detection in medical documents in Spanish [Data set]. Zenodo. https://doi.org/10.5281/zenodo.7116201)
53
+
54
+ Two models were built: A model for occupation recognition and a model to detect to whom the profession belongs.
55
+ More details about this can be found in MEDDOPROF shared task:
56
+ Lima-López, S., Farré-Maduell, E., Miranda-Escalada, A., Brivá-Iglesias, V., & Krallinger, M. (2021). Nlp applied to occupational health: Meddoprof shared task at iberlef 2021 on automatic recognition, classification and normalization of professions and occupations from medical texts. Procesamiento del Lenguaje Natural, 67, 243-256.
57
+
58
+
59
+ - **Developed by:** Alfredo Madrid
60
+ - **Language(s) (NLP):** Spanish
61
+ - **License:** CC4.0
62
+ - **Finetuned from model [optional]:** PlanTL-GOB-ES/roberta-base-biomedical-es
63
+
64
+ ### Model Sources
65
+
66
+ <!-- Provide the basic links for the model. -->
67
+
68
+ - **Repository:** https://huggingface.co/HCSCRheuma/Occupations
69
+ - **Paper [optional]:** Madrid García, A. (2023). Recognition of professions in medical documentation.
70
+
71
+ ## Uses
72
+
73
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
74
+
75
+
76
+ [More Information Needed]
77
+
78
+ ### Downstream Use [optional]
79
+
80
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Out-of-Scope Use
85
+
86
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
87
+
88
+ [More Information Needed]
89
+
90
+ ## Bias, Risks, and Limitations
91
+
92
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
93
+
94
+ [More Information Needed]
95
+
96
+ ### Recommendations
97
+
98
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
99
+
100
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
101
+
102
+ ## How to Get Started with the Model
103
+
104
+ Use the code below to get started with the model.
105
+
106
+ [More Information Needed]
107
+
108
+ ## Training Details
109
+
110
+ ### Training Data
111
+
112
+ <!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
113
+
114
+ [More Information Needed]
115
+
116
+ ### Training Procedure
117
+
118
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
119
+
120
+ #### Preprocessing [optional]
121
+
122
+ [More Information Needed]
123
+
124
+
125
+ #### Training Hyperparameters
126
+
127
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
128
+
129
+ #### Speeds, Sizes, Times [optional]
130
+
131
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
132
+
133
+ [More Information Needed]
134
+
135
+ ## Evaluation
136
+
137
+ <!-- This section describes the evaluation protocols and provides the results. -->
138
+
139
+ ### Testing Data, Factors & Metrics
140
+
141
+ #### Testing Data
142
+
143
+ <!-- This should link to a Data Card if possible. -->
144
+
145
+ [More Information Needed]
146
+
147
+ #### Factors
148
+
149
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
150
+
151
+ [More Information Needed]
152
+
153
+ #### Metrics
154
+
155
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
156
+
157
+ [More Information Needed]
158
+
159
+ ### Results
160
+
161
+ [More Information Needed]
162
+
163
+ #### Summary
164
+
165
+
166
+
167
+ ## Model Examination [optional]
168
+
169
+ <!-- Relevant interpretability work for the model goes here -->
170
+
171
+ [More Information Needed]
172
+
173
+ ## Environmental Impact
174
+
175
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
176
+
177
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
178
+
179
+ - **Hardware Type:** [More Information Needed]
180
+ - **Hours used:** [More Information Needed]
181
+ - **Cloud Provider:** [More Information Needed]
182
+ - **Compute Region:** [More Information Needed]
183
+ - **Carbon Emitted:** [More Information Needed]
184
+
185
+ ## Technical Specifications [optional]
186
+
187
+ ### Model Architecture and Objective
188
+
189
+ [More Information Needed]
190
+
191
+ ### Compute Infrastructure
192
+
193
+ [More Information Needed]
194
+
195
+ #### Hardware
196
+
197
+ [More Information Needed]
198
+
199
+ #### Software
200
+
201
+ [More Information Needed]
202
+
203
+ ## Citation [optional]
204
+
205
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
206
+
207
+ **BibTeX:**
208
+
209
+ [More Information Needed]
210
+
211
+ **APA:**
212
+
213
+ [More Information Needed]
214
+
215
+ ## Glossary [optional]
216
+
217
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
218
+
219
+ [More Information Needed]
220
+
221
+ ## More Information [optional]
222
+
223
+ [More Information Needed]
224
+
225
+ ## Model Card Authors [optional]
226
+
227
+ [More Information Needed]
228
+
229
+ ## Model Card Contact
230
+
231
+ [More Information Needed]