How to use sravanthib/single-node-single-gpu-qwen-custom-sft with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-3B") model = PeftModel.from_pretrained(base_model, "sravanthib/single-node-single-gpu-qwen-custom-sft")
70d9f51 07d95cb 70d9f51
1
2
3
4
5
6
7
8
{ "epoch": 0.5, "total_flos": 6.856066495152128e+17, "train_loss": 0.07727908698283135, "train_runtime": 9003.3191, "train_samples_per_second": 1.111, "train_steps_per_second": 0.056 }
