metadata
base_model: unsloth/Qwen2.5-3B-bnb-4bit
library_name: peft
pipeline_tag: text-generation
tags:
- lora
- qlora
- vietnamese
- lab21
license: apache-2.0
Lab 21 — Qwen2.5-3B Vietnamese LoRA (r=16)
LoRA adapter fine-tuned on 5CD-AI/Vietnamese-alpaca-gpt4-gg-translated (200 samples).
| Setting | Value |
|---|---|
| Base model | unsloth/Qwen2.5-3B-bnb-4bit |
| Rank / alpha | r=16, alpha=32 |
| Target modules | q_proj, v_proj |
| Eval perplexity | 4.55 |
| Student | Vũ Văn Học — 2A202600653 |
Usage
from peft import PeftModel
from unsloth import FastLanguageModel
base, tokenizer = FastLanguageModel.from_pretrained(
"unsloth/Qwen2.5-3B-bnb-4bit", load_in_4bit=True
)
model = PeftModel.from_pretrained(base, "2vhoc/lab21")