Text Generation
PEFT
Safetensors
English
qlora
lora
structured-output
supervised-finetuning
assistant-only-loss
Instructions to use TSUTAYA/qwen3-4b-struct-lora-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use TSUTAYA/qwen3-4b-struct-lora-1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit") model = PeftModel.from_pretrained(base_model, "TSUTAYA/qwen3-4b-struct-lora-1") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,12 +15,10 @@ tags:
|
|
| 15 |
- assistant-only-loss
|
| 16 |
---
|
| 17 |
|
| 18 |
-
<【課題】ここは自分で記入して下さい>
|
| 19 |
-
|
| 20 |
This repository provides a **LoRA adapter** fine-tuned from
|
| 21 |
**Qwen/Qwen3-4B-Instruct-2507** using **QLoRA (4-bit, Unsloth)**.
|
| 22 |
|
| 23 |
-
|
| 24 |
The base model must be loaded separately.
|
| 25 |
|
| 26 |
---
|
|
|
|
| 15 |
- assistant-only-loss
|
| 16 |
---
|
| 17 |
|
|
|
|
|
|
|
| 18 |
This repository provides a **LoRA adapter** fine-tuned from
|
| 19 |
**Qwen/Qwen3-4B-Instruct-2507** using **QLoRA (4-bit, Unsloth)**.
|
| 20 |
|
| 21 |
+
This repository contains **LoRA adapter weights only**.
|
| 22 |
The base model must be loaded separately.
|
| 23 |
|
| 24 |
---
|