u-10bei/structured_data_with_cot_dataset_512_v2
Viewer • Updated • 3.93k • 64 • 1
How to use tanutarou/qwen3-lora-seqlen768 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "tanutarou/qwen3-lora-seqlen768")qwen3-4b-structured-output-lora
This repository provides a LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (4-bit, Unsloth).
This repository contains LoRA adapter weights only. The base model must be loaded separately.
Base model
Qwen/Qwen3-4B-Instruct-2507