convAI / README.md
sinhapiyush86's picture
Upload README.md
09a364e verified
metadata
language:
  - en
license: apache-2.0
tags:
  - chat
  - qwen
  - instruct
  - lora
  - fine-tuned
  - transformers
pipeline_tag: text-generation
library_name: transformers

LoRA Fine-Tuned Qwen2.5-1.5B-Instruct

This model is a LoRA fine-tuned version of Qwen2.5-1.5B-Instruct, optimized for instruction-following tasks.

  • Base model: Qwen/Qwen2.5-1.5B-Instruct
  • Method: Parameter-efficient fine-tuning with PEFT (LoRA)
  • Framework: ๐Ÿค— Transformers + PEFT
  • Use case: Conversational AI, instruction following, Q&A

๐Ÿš€ Usage

Install dependencies

pip install transformers accelerate peft