Update README.md
Browse files
README.md
CHANGED
|
@@ -21,18 +21,20 @@ tags:
|
|
| 21 |
<p align="center">
|
| 22 |
<br>
|
| 23 |
<img src="http://www.ixa.eus/sites/default/files/anitdote.png" style="height: 250px;">
|
| 24 |
-
<h2 align="center">
|
| 25 |
-
for
|
| 26 |
<br>
|
| 27 |
|
| 28 |
|
| 29 |
# Model Card for MedMT5-large
|
| 30 |
|
| 31 |
<p align="justify">
|
| 32 |
-
We present
|
|
|
|
|
|
|
| 33 |
</p>
|
| 34 |
|
| 35 |
-
- 📖 Paper:
|
| 36 |
- 🌐 Project Website: [https://univ-cotedazur.eu/antidote](https://univ-cotedazur.eu/antidote)
|
| 37 |
|
| 38 |
|
|
@@ -41,8 +43,8 @@ We present MedMT5, the first open-source text-to-text multilingual model for the
|
|
| 41 |
<thead>
|
| 42 |
<tr>
|
| 43 |
<th></th>
|
| 44 |
-
<th>
|
| 45 |
-
<th>
|
| 46 |
</tr>
|
| 47 |
</thead>
|
| 48 |
<tbody>
|
|
@@ -114,7 +116,7 @@ We present MedMT5, the first open-source text-to-text multilingual model for the
|
|
| 114 |
- **Model type**: text2text-generation
|
| 115 |
- **Language(s) (NLP)**: English, Spanish, French, Italian
|
| 116 |
- **License**: apache-2.0
|
| 117 |
-
- **Finetuned from model**:
|
| 118 |
|
| 119 |
## How to Get Started with the Model
|
| 120 |
|
|
@@ -134,9 +136,9 @@ The model has been trained using the T5 masked language modeling tasks. You need
|
|
| 134 |
<img src="https://miro.medium.com/v2/0*yeXSc6Qs-SGKDzZP.png" style="height: 250px;">
|
| 135 |
<br>
|
| 136 |
|
| 137 |
-
###
|
| 138 |
|
| 139 |
-
If you want to use
|
| 140 |
|
| 141 |
## Training Data
|
| 142 |
|
|
@@ -292,7 +294,15 @@ If you want to use MedMT5 for Sequence Labeling, we recommend you use this code:
|
|
| 292 |
|
| 293 |
## Ethical Statement
|
| 294 |
<p align="justify">
|
| 295 |
-
Our research in developing
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 296 |
</p>
|
| 297 |
|
| 298 |
## Citation
|
|
@@ -300,10 +310,10 @@ Our research in developing MedMT5, a multilingual text-to-text model for the med
|
|
| 300 |
We will soon release a paper, but, for now, you can use:
|
| 301 |
|
| 302 |
```bibtext
|
| 303 |
-
@
|
| 304 |
-
title = "{
|
| 305 |
author = "{Iker García-Ferrero and Rodrigo Agerri and Aitziber Atutxa Salazar and Elena Cabrio and Iker de la Iglesia and Alberto Lavelli and Bernardo Magnini and Benjamin Molinet and Johana Ramirez-Romero and German Rigau and Jose Maria Villa-Gonzalez and Serena Villata and Andrea Zaninello}",
|
| 306 |
-
|
| 307 |
-
year =
|
| 308 |
|
| 309 |
```
|
|
|
|
| 21 |
<p align="center">
|
| 22 |
<br>
|
| 23 |
<img src="http://www.ixa.eus/sites/default/files/anitdote.png" style="height: 250px;">
|
| 24 |
+
<h2 align="center">Medical mT5: An Open-Source Multilingual Text-to-Text LLM
|
| 25 |
+
for the Medical Domain</h2>
|
| 26 |
<br>
|
| 27 |
|
| 28 |
|
| 29 |
# Model Card for MedMT5-large
|
| 30 |
|
| 31 |
<p align="justify">
|
| 32 |
+
We present Medical mT5, the first open-source text-to-text multilingual model for the medical domain.
|
| 33 |
+
Medical mT5 is an encoder-decoder model developed by continuing the training of publicly available mT5 checkpoints on
|
| 34 |
+
medical domain data for English, Spanish, French, and Italian.
|
| 35 |
</p>
|
| 36 |
|
| 37 |
+
- 📖 Paper: [Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain]()
|
| 38 |
- 🌐 Project Website: [https://univ-cotedazur.eu/antidote](https://univ-cotedazur.eu/antidote)
|
| 39 |
|
| 40 |
|
|
|
|
| 43 |
<thead>
|
| 44 |
<tr>
|
| 45 |
<th></th>
|
| 46 |
+
<th>Medical mT5-Large (<a href="https://huggingface.co/HiTZ/Medical-mT5-large">HiTZ/Medical-mT5-large</a>)</th>
|
| 47 |
+
<th>Medical mT5-XL (<a href="https://huggingface.co/HiTZ/Medical-mT5-xl">HiTZ/Medical-mT5-xl</a>)</th>
|
| 48 |
</tr>
|
| 49 |
</thead>
|
| 50 |
<tbody>
|
|
|
|
| 116 |
- **Model type**: text2text-generation
|
| 117 |
- **Language(s) (NLP)**: English, Spanish, French, Italian
|
| 118 |
- **License**: apache-2.0
|
| 119 |
+
- **Finetuned from model**: mT5
|
| 120 |
|
| 121 |
## How to Get Started with the Model
|
| 122 |
|
|
|
|
| 136 |
<img src="https://miro.medium.com/v2/0*yeXSc6Qs-SGKDzZP.png" style="height: 250px;">
|
| 137 |
<br>
|
| 138 |
|
| 139 |
+
### Medical mT5 for Sequence Labelling
|
| 140 |
|
| 141 |
+
If you want to use Medical mT5 for Sequence Labeling, we recommend you use this code: https://github.com/ikergarcia1996/Sequence-Labeling-LLMs
|
| 142 |
|
| 143 |
## Training Data
|
| 144 |
|
|
|
|
| 294 |
|
| 295 |
## Ethical Statement
|
| 296 |
<p align="justify">
|
| 297 |
+
Our research in developing Medical mT5, a multilingual text-to-text model for the medical domain, has ethical implications that we acknowledge.
|
| 298 |
+
Firstly, the broader impact of this work lies in its potential to improve medical communication and understanding across languages, which
|
| 299 |
+
can enhance healthcare access and quality for diverse linguistic communities. However, it also raises ethical considerations related to privacy and data security.
|
| 300 |
+
To create our multilingual corpus, we have taken measures to anonymize and protect sensitive patient information, adhering to
|
| 301 |
+
data protection regulations in each language's jurisdiction or deriving our data from sources that explicitly address this issue in line with
|
| 302 |
+
privacy and safety regulations and guidelines. Furthermore, we are committed to transparency and fairness in our model's development and evaluation.
|
| 303 |
+
We have worked to ensure that our benchmarks are representative and unbiased, and we will continue to monitor and address any potential biases in the future.
|
| 304 |
+
Finally, we emphasize our commitment to open source by making our data, code, and models publicly available, with the aim of promoting collaboration within
|
| 305 |
+
the research community.
|
| 306 |
</p>
|
| 307 |
|
| 308 |
## Citation
|
|
|
|
| 310 |
We will soon release a paper, but, for now, you can use:
|
| 311 |
|
| 312 |
```bibtext
|
| 313 |
+
@inproceedings{medical-mt5,
|
| 314 |
+
title = "{{Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain}}",
|
| 315 |
author = "{Iker García-Ferrero and Rodrigo Agerri and Aitziber Atutxa Salazar and Elena Cabrio and Iker de la Iglesia and Alberto Lavelli and Bernardo Magnini and Benjamin Molinet and Johana Ramirez-Romero and German Rigau and Jose Maria Villa-Gonzalez and Serena Villata and Andrea Zaninello}",
|
| 316 |
+
publisher = "Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING)",
|
| 317 |
+
year = 2024 }
|
| 318 |
|
| 319 |
```
|