---
language:
- en
license: apache-2.0
tags:
- chat
- qwen
- instruct
- lora
- fine-tuned
- transformers
pipeline_tag: text-generation
library_name: transformers
---

# LoRA Fine-Tuned Qwen2.5-1.5B-Instruct

This model is a **LoRA fine-tuned version** of [Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct), optimized for instruction-following tasks.

- **Base model:** `Qwen/Qwen2.5-1.5B-Instruct`  
- **Method:** Parameter-efficient fine-tuning with [PEFT (LoRA)](https://huggingface.co/docs/peft)  
- **Framework:** 🤗 Transformers + PEFT  
- **Use case:** Conversational AI, instruction following, Q&A  

---

## 🚀 Usage

### Install dependencies
```bash
pip install transformers accelerate peft