|
|
--- |
|
|
language: |
|
|
- en |
|
|
license: apache-2.0 |
|
|
tags: |
|
|
- chat |
|
|
- qwen |
|
|
- instruct |
|
|
- lora |
|
|
- fine-tuned |
|
|
- transformers |
|
|
pipeline_tag: text-generation |
|
|
library_name: transformers |
|
|
--- |
|
|
|
|
|
# LoRA Fine-Tuned Qwen2.5-1.5B-Instruct |
|
|
|
|
|
This model is a **LoRA fine-tuned version** of [Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct), optimized for instruction-following tasks. |
|
|
|
|
|
- **Base model:** `Qwen/Qwen2.5-1.5B-Instruct` |
|
|
- **Method:** Parameter-efficient fine-tuning with [PEFT (LoRA)](https://huggingface.co/docs/peft) |
|
|
- **Framework:** 🤗 Transformers + PEFT |
|
|
- **Use case:** Conversational AI, instruction following, Q&A |
|
|
|
|
|
--- |
|
|
|
|
|
## 🚀 Usage |
|
|
|
|
|
### Install dependencies |
|
|
```bash |
|
|
pip install transformers accelerate peft |
|
|
|
