metadata
language:
- en
license: apache-2.0
tags:
- chat
- qwen
- instruct
- lora
- fine-tuned
- transformers
pipeline_tag: text-generation
library_name: transformers
LoRA Fine-Tuned Qwen2.5-1.5B-Instruct
This model is a LoRA fine-tuned version of Qwen2.5-1.5B-Instruct, optimized for instruction-following tasks.
- Base model:
Qwen/Qwen2.5-1.5B-Instruct - Method: Parameter-efficient fine-tuning with PEFT (LoRA)
- Framework: ๐ค Transformers + PEFT
- Use case: Conversational AI, instruction following, Q&A
๐ Usage
Install dependencies
pip install transformers accelerate peft