Upload LoRA adapter (README written by author)

README.md

@@ -1,7 +1,7 @@
 ---
-base_model: unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit
+base_model: Qwen/Qwen3-4B-Instruct-2507
 datasets:
-- daichira/structured-5k-mix-sft
+- u-10bei/structured_data_with_cot_dataset_512_v2
 language:
 - en
 license: apache-2.0
@@ -13,10 +13,10 @@ tags:
 - structured-output
 ---
 
-Qwen3-4b-Structured-with-QLoRA
+Qwen3-4b-structured-SFT
 
 This repository provides a **LoRA adapter** fine-tuned from
-**unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit** using **QLoRA (4-bit, Unsloth)**.
+**Qwen/Qwen3-4B-Instruct-2507** using **QLoRA (4-bit, Unsloth)**.
 
 This repository contains **LoRA adapter weights only**.
 The base model must be loaded separately.
@@ -31,10 +31,10 @@ while intermediate reasoning (Chain-of-Thought) is masked.
 
 ## Training Configuration
 
-- Base model: unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit
+- Base model: Qwen/Qwen3-4B-Instruct-2507
 - Method: QLoRA (4-bit)
-- Max sequence length: 1024
-- Epochs: 1
+- Max sequence length: 512
+- Epochs: 2
 - Learning rate: 1e-04
 - LoRA: r=64, alpha=128
 
@@ -45,7 +45,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 from peft import PeftModel
 import torch
 
-base = "unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit"
+base = "Qwen/Qwen3-4B-Instruct-2507"
 adapter = "your_id/your-repo"
 
 tokenizer = AutoTokenizer.from_pretrained(base)
@@ -59,7 +59,7 @@ model = PeftModel.from_pretrained(model, adapter)
 
 ## Sources & Terms (IMPORTANT)
 
-Training data: daichira/structured-5k-mix-sft
+Training data: u-10bei/structured_data_with_cot_dataset_512_v2
 
 Dataset License: MIT License. This dataset is used and distributed under the terms of the MIT License.
 Compliance: Users must comply with the MIT license (including copyright notice) and the base model's original terms of use.

adapter_config.json

@@ -33,13 +33,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "o_proj",
+    "v_proj",
+    "up_proj",
     "k_proj",
     "q_proj",
     "gate_proj",
-    "v_proj",
-    "up_proj",
-    "down_proj"
+    "down_proj",
+    "o_proj"
   ],
   "target_parameters": null,
   "task_type": "CAUSAL_LM",

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8515af5547e5049c49557be7b7d72cdf709b8f7e5549e1a189ac228c7a8b0ad0
+oid sha256:c3696f3d1b2152b443b93a205ab84291ac80a96ddfb47a4863623fa77391071c
 size 528550256