---
pipeline_tag: feature-extraction
library_name: transformers
license: mit
---

This repository contains a RoFormerForMaskedLM model for protein feature extraction, as described in [VenusFactory: A Unified Platform for Protein Engineering Data Retrieval and Language Model Fine-Tuning](https://huggingface.co/papers/2503.15438).

Code: https://github.com/tyang816/VenusFactory

This model is intended for feature extraction tasks related to protein language modeling. Refer to the GitHub repository for details on usage.