How to use trl-internal-testing/tiny-PeftModel-2 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trl-internal-testing/tiny-PeftModel-2", device_map="auto")
albertvillanova