| {} | |
| # LightGPT | |
| LightGPT is a generative language model based on the [GPT-2](https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf) architecture, pre-trained on unpaired light chain antibody sequence data from the [OAS](https://opig.stats.ox.ac.uk/webapps/oas/) database. | |
| More information can be found on our [Github repo](https://github.com/ibmm-unibe-ch/Heavy2Light). | |