How to use mohammadmahdinouri/moa-adapter-checkpoints with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="mohammadmahdinouri/moa-adapter-checkpoints")
# Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("mohammadmahdinouri/moa-adapter-checkpoints", dtype="auto")