How to use peft-internal-testing/tiny-T5ForConditionalGeneration with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("peft-internal-testing/tiny-T5ForConditionalGeneration") model = AutoModelForSeq2SeqLM.from_pretrained("peft-internal-testing/tiny-T5ForConditionalGeneration", device_map="auto")
PEFT copy of trl-internal-testing/tiny-T5ForConditionalGeneration, minimal model built for unit tests.
Files info
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("peft-internal-testing/tiny-T5ForConditionalGeneration") model = AutoModelForSeq2SeqLM.from_pretrained("peft-internal-testing/tiny-T5ForConditionalGeneration", device_map="auto")