How to use mohammadmahdinouri/moa-pre-norm-init with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="mohammadmahdinouri/moa-pre-norm-init")
# Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("mohammadmahdinouri/moa-pre-norm-init", dtype="auto")
The community tab is the place to discuss and collaborate with the HF community!
