How to use AIRI-Institute/gena-lm-bigbird-base-sparse with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("AIRI-Institute/gena-lm-bigbird-base-sparse", trust_remote_code=True) model = AutoModelForPreTraining.from_pretrained("AIRI-Institute/gena-lm-bigbird-base-sparse", trust_remote_code=True)
What is a pickle import?
