| | --- |
| | widget: |
| | - text: "low lung volumes, [MASK] pulmonary vascularity." |
| | tags: |
| | - fill-mask |
| | - pytorch |
| | - transformers |
| | - bert |
| | - biobert |
| | - radbert |
| | - language-model |
| | - uncased |
| | - radiology |
| | - biomedical |
| | datasets: |
| | - wikipedia |
| | - bookscorpus |
| | - pubmed |
| | - radreports |
| | language: |
| | - en |
| | license: mit |
| | --- |
| | |
| | RadBERT was continuously pre-trained on radiology reports from a BioBERT initialization. |
| |
|
| | ## Citation |
| |
|
| | ```bibtex |
| | @article{chambon_cook_langlotz_2022, |
| | title={Improved fine-tuning of in-domain transformer model for inferring COVID-19 presence in multi-institutional radiology reports}, |
| | DOI={10.1007/s10278-022-00714-8}, journal={Journal of Digital Imaging}, |
| | author={Chambon, Pierre and Cook, Tessa S. and Langlotz, Curtis P.}, |
| | year={2022} |
| | } |
| | ``` |
