metadata
library_name: peft
base_model: Qwen/Qwen2.5-72B-Instruct
tags:
- peft
- lora
- adapter
- qwen
- arabic
model_type: adapter
Arabic LoRA Adapter for Qwen2.5-72B-Instruct
This repository contains a LoRA adapter only, not a full model.
Base Model
- Qwen/Qwen2.5-72B-Instruct
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model = AutoModelForCausalLM.from_pretrained(
"Qwen/Qwen2.5-72B-Instruct",
torch_dtype="auto",
device_map="auto",
trust_remote_code=True
)
model = PeftModel.from_pretrained(
base_model,
"Lina-Z/qwen_arabic_ft"
)