How to use sravanthib/s with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct") model = PeftModel.from_pretrained(base_model, "sravanthib/s")
51b9eb1 b44d7fa 4b0fee7 5097103 51b9eb1
1
2
3
4
5
6
7
8
{ "epoch": 0.2, "total_flos": 1.7426360578342912e+16, "train_loss": 4.486104583740234, "train_runtime": 141.8169, "train_samples_per_second": 1.41, "train_steps_per_second": 0.071 }
