Add model card

README.md

@@ -7,16 +7,16 @@ tags:
 - code-generation
 - opencodeinstruct
 license: apache-2.0
-base_model: Qwen/Qwen2-0.5B
+base_model: Qwen/Qwen2-0.5B-Instruct
 ---
 
 # Qwen2-0.5b LoRA Fine-tuned on OpenCodeInstruct
 
-This model is a LoRA fine-tuned version of Qwen/Qwen2-0.5B on the OpenCodeInstruct dataset.
+This model is a LoRA fine-tuned version of Qwen/Qwen2-0.5B-Instruct on the OpenCodeInstruct dataset.
 
 ## Model Details
 
-- **Base Model**: Qwen/Qwen2-0.5B
+- **Base Model**: Qwen/Qwen2-0.5B-Instruct
 - **Fine-tuning Dataset**: OpenCodeInstruct (300 samples)
 - **Fine-tuning Method**: LoRA (Low-Rank Adaptation)
 - **LoRA Rank**: 16
@@ -29,7 +29,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 from peft import PeftModel
 
 # Load base model
-base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2-0.5B")
+base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2-0.5B-Instruct")
 
 # Load LoRA adapters
 model = PeftModel.from_pretrained(base_model, "alpayH/qwen2-0.5b-lora-opencodeinstruct")