---
{}
---
# HeavyBERTa
HeavyBERTa is a specialized protein language model built on the [RoBERTa](https://arxiv.org/abs/1907.11692) architecture, pre-trained on unpaired heavy chain antibody sequences from the [OAS](https://opig.stats.ox.ac.uk/webapps/oas/) (Observed Antibody Space) database.  
For further details and access to the code, visit our [GitHub repository](https://github.com/ibmm-unibe-ch/Heavy2Light.git).