How to use entropy25/moe_en with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("facebook/nllb-200-distilled-600M") model = PeftModel.from_pretrained(base_model, "entropy25/moe_en")
How to use entropy25/moe_en with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("entropy25/moe_en", device_map="auto")
a1b94df
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:d8fa9cddbd9714dbd655974672fbe1989126a063d79abf089aa0c32e4589e833 size 6161
