Fill-Mask
Transformers
PyTorch
TensorFlow
JAX
Portuguese
bert
biomedical
clinical
portuguese
masked-language-modeling
Instructions to use pucpr/biobertpt-all with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use pucpr/biobertpt-all with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="pucpr/biobertpt-all")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("pucpr/biobertpt-all") model = AutoModelForMaskedLM.from_pretrained("pucpr/biobertpt-all", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
#8
by lisaterumi - opened
README.md
CHANGED
|
@@ -1,14 +1,23 @@
|
|
| 1 |
---
|
| 2 |
-
language:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
widget:
|
| 4 |
-
- text: "O paciente recebeu [MASK] do hospital."
|
| 5 |
-
- text: "O médico receitou a medicação para controlar a [MASK]."
|
| 6 |
-
- text: "O principal [MASK] da COVID-19 é tosse seca."
|
| 7 |
-
- text: "O vírus da gripe apresenta um [MASK] constituído por segmentos de ácido ribonucleico."
|
| 8 |
-
|
| 9 |
-
thumbnail: "https://raw.githubusercontent.com/HAILab-PUCPR/BioBERTpt/master/images/logo-biobertpr1.png"
|
| 10 |
---
|
| 11 |
|
|
|
|
| 12 |
<img src="https://raw.githubusercontent.com/HAILab-PUCPR/BioBERTpt/master/images/logo-biobertpr1.png" alt="Logo BioBERTpt">
|
| 13 |
|
| 14 |
# BioBERTpt - Portuguese Clinical and Biomedical BERT
|
|
@@ -30,12 +39,30 @@ model = AutoModel.from_pretrained("pucpr/biobertpt-all")
|
|
| 30 |
|
| 31 |
Refer to the original paper, [BioBERTpt - A Portuguese Neural Language Model for Clinical Named Entity Recognition](https://www.aclweb.org/anthology/2020.clinicalnlp-1.7/) for additional details and performance on Portuguese NER tasks.
|
| 32 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
## Acknowledgements
|
| 34 |
|
| 35 |
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.
|
| 36 |
|
| 37 |
## Citation
|
| 38 |
|
|
|
|
|
|
|
| 39 |
```
|
| 40 |
@inproceedings{schneider-etal-2020-biobertpt,
|
| 41 |
title = "{B}io{BERT}pt - A {P}ortuguese Neural Language Model for Clinical Named Entity Recognition",
|
|
|
|
| 1 |
---
|
| 2 |
+
language: pt
|
| 3 |
+
license: cc-by-nc-4.0
|
| 4 |
+
license_link: https://creativecommons.org/licenses/by-nc/4.0/
|
| 5 |
+
base_model: google-bert/bert-base-multilingual-cased
|
| 6 |
+
tags:
|
| 7 |
+
- biomedical
|
| 8 |
+
- clinical
|
| 9 |
+
- portuguese
|
| 10 |
+
- bert
|
| 11 |
+
- masked-language-modeling
|
| 12 |
widget:
|
| 13 |
+
- text: "O paciente recebeu [MASK] do hospital."
|
| 14 |
+
- text: "O médico receitou a medicação para controlar a [MASK]."
|
| 15 |
+
- text: "O principal [MASK] da COVID-19 é tosse seca."
|
| 16 |
+
- text: "O vírus da gripe apresenta um [MASK] constituído por segmentos de ácido ribonucleico."
|
| 17 |
+
thumbnail: https://raw.githubusercontent.com/HAILab-PUCPR/BioBERTpt/master/images/logo-biobertpr1.png
|
|
|
|
| 18 |
---
|
| 19 |
|
| 20 |
+
|
| 21 |
<img src="https://raw.githubusercontent.com/HAILab-PUCPR/BioBERTpt/master/images/logo-biobertpr1.png" alt="Logo BioBERTpt">
|
| 22 |
|
| 23 |
# BioBERTpt - Portuguese Clinical and Biomedical BERT
|
|
|
|
| 39 |
|
| 40 |
Refer to the original paper, [BioBERTpt - A Portuguese Neural Language Model for Clinical Named Entity Recognition](https://www.aclweb.org/anthology/2020.clinicalnlp-1.7/) for additional details and performance on Portuguese NER tasks.
|
| 41 |
|
| 42 |
+
|
| 43 |
+
## License
|
| 44 |
+
|
| 45 |
+
The BioBERTpt(all) model weights are released under the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.
|
| 46 |
+
|
| 47 |
+
The model weights may be used, shared, and adapted for research, educational, and other non-commercial purposes, provided that appropriate attribution is given.
|
| 48 |
+
|
| 49 |
+
Commercial use requires separate authorization from the relevant rights holders.
|
| 50 |
+
|
| 51 |
+
BioBERTpt was developed by researchers from the Pontifical Catholic University of Paraná (PUCPR), Brazil, and the University of Applied Sciences and Arts of Western Switzerland (HES-SO).
|
| 52 |
+
|
| 53 |
+
The model was initialized from Google's BERT-base-multilingual-cased, which is licensed under Apache 2.0. The original licensing and attribution requirements remain applicable.
|
| 54 |
+
|
| 55 |
+
License details: https://creativecommons.org/licenses/by-nc/4.0/
|
| 56 |
+
|
| 57 |
+
|
| 58 |
## Acknowledgements
|
| 59 |
|
| 60 |
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.
|
| 61 |
|
| 62 |
## Citation
|
| 63 |
|
| 64 |
+
If you use BioBERTpt in your research, please cite the original publication:
|
| 65 |
+
|
| 66 |
```
|
| 67 |
@inproceedings{schneider-etal-2020-biobertpt,
|
| 68 |
title = "{B}io{BERT}pt - A {P}ortuguese Neural Language Model for Clinical Named Entity Recognition",
|