How to use BehradG/pythia-410m-lora with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("BehradG/pythia-410m-lora", device_map="auto")
This is a pythia-410m model with LoRA, fine-tuned on CPU using a question-answer dataset for 30 epochs. It was a test to assess fine-tuning with and witout LoRA.
-
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("BehradG/pythia-410m-lora", device_map="auto")