File size: 1,258 Bytes
69c617a 3f6205e bfda9c0 3f6205e e3c7fb6 aa353ac | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 | ---
language:
- en
- es
- fr
- nl
- de
- fi
- ru
- tr
- ko
- zh
- ja
- th
- pt
- it
- sv
- hu
- pl
- et
- hr
- uk
- el
- da
- he
tags:
- biomedical
- bionlp
- entity linking
- embedding
- bert
---
A multilingual **BERGAMOT**: **B**iomedical **E**ntity **R**epresentation with **G**raph-**A**ugmented **M**ulti-**O**bjective **T**ransformer model with pre-trained on UMLS (version 2020AB) using a Graph Attention Network (GAT) encoder.
For technical details see our [NAACL 2024 paper](https://aclanthology.org/2024.findings-naacl.288).
[Here is the poster](https://github.com/Andoree/BERGAMOT/blob/main/BERGAMOT_poster_naacl.jpg) of our paper.
For pretraining code see our github: [https://github.com/Andoree/BERGAMOT](https://github.com/Andoree/BERGAMOT).
## Citation
```bibtex
@inproceedings{sakhovskiy-et-al-2024-bergamot,
title = "Biomedical Entity Representation with Graph-Augmented Multi-Objective Transformer",
author = "Sakhovskiy, Andrey and Semenova, Natalia and Kadurin, Artur and Tutubalina, Elena",
booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024",
month = jun,
year = "2024",
address = "Mexico City, Mexico",
publisher = "Association for Computational Linguistics",
}
```
|