Transformers How to use GleghornLab/sci_moe_all with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, MoEBertForSentenceSimilarity
tokenizer = AutoTokenizer.from_pretrained("GleghornLab/sci_moe_all")
model = MoEBertForSentenceSimilarity.from_pretrained("GleghornLab/sci_moe_all", device_map="auto") 
