How to use maxbsdv/leo-nllb-1.3b with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("facebook/nllb-200-distilled-1.3B") model = PeftModel.from_pretrained(base_model, "maxbsdv/leo-nllb-1.3b")
How to use maxbsdv/leo-nllb-1.3b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("maxbsdv/leo-nllb-1.3b", device_map="auto")
maxbsdv commited on 