How to use entropy25/moe_nl with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("facebook/nllb-200-distilled-600M") model = PeftModel.from_pretrained(base_model, "entropy25/moe_nl")
How to use entropy25/moe_nl with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("entropy25/moe_nl", device_map="auto")
ddb5d6d
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:a6e2f17e355f6f70ee30cd4523310dcc278f48764adc5891c7735706370c104c size 6161
