| {} | |
| # HeavyBERTa | |
| HeavyBERTa is a specialized protein language model built on the [RoBERTa](https://arxiv.org/abs/1907.11692) architecture, pre-trained on unpaired heavy chain antibody sequences from the [OAS](https://opig.stats.ox.ac.uk/webapps/oas/) (Observed Antibody Space) database. | |
| For further details and access to the code, visit our [GitHub repository](https://github.com/ibmm-unibe-ch/Heavy2Light.git). | |