| base_model: Qwen/Qwen3-4B-Instruct-2507 | |
| datasets: | |
| - u-10bei/structured_data_with_cot_dataset_v2 | |
| language: | |
| - en | |
| license: cc-by-4.0 | |
| library_name: peft | |
| pipeline_tag: text-generation | |
| tags: | |
| - qlora | |
| - lora | |
| - structured-output | |
| # HyperParam Tuning LoRA (max_seq_len=2048) | |
| LoRA adapter fine-tuned from **Qwen/Qwen3-4B-Instruct-2507** using QLoRA (4-bit, Unsloth). | |
| ## Training Configuration | |
| - Base model: Qwen/Qwen3-4B-Instruct-2507 | |
| - Dataset: u-10bei/structured_data_with_cot_dataset_v2 | |
| - Method: QLoRA (4-bit) | |
| - Max sequence length: 2048 | |
| - Epochs: 3 | |
| - Learning rate: 0.0001 | |
| - LoRA: r=64, alpha=128 | |
| ## Sources & License | |
| - Training Data: u-10bei/structured_data_with_cot_dataset_v2 | |
| - Dataset License: CC-BY-4.0. This dataset is used and can be redistributed under the terms of the CC-BY-4.0 license. | |
| - Compliance: Users must comply with both the dataset attribution requirements and the base model original terms of use. | |