How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="AI4Protein/deep_bpe_3200")
# Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("AI4Protein/deep_bpe_3200")
model = AutoModelForMaskedLM.from_pretrained("AI4Protein/deep_bpe_3200")
Quick Links

This repository contains a RoFormerForMaskedLM model for protein feature extraction, as described in VenusFactory: A Unified Platform for Protein Engineering Data Retrieval and Language Model Fine-Tuning.

Code: https://github.com/tyang816/VenusFactory

This model is intended for feature extraction tasks related to protein language modeling. Refer to the GitHub repository for details on usage.

Downloads last month
14
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for AI4Protein/deep_bpe_3200