metadata
base_model: Qwen/Qwen2.5-14B-Instruct
library_name: peft
pipeline_tag: text-generation
tags:
- qwen
- grpo
- lora
- peft
- multiple-choice
DL HW3 GRPO LoRA Adapter
This repository contains the final LoRA adapter for DL HW3: Reasoning LLM Step 3 with GRPO.
Base Model
Qwen/Qwen2.5-14B-Instruct
Method
The model was initialized from my Step2 SFT LoRA adapter and further optimized using GRPO.
Final Adapter
outputs/grpo_hw2best_balanced_30steps_lr2e8
Training Data
The final GRPO run used a balanced version of HW2_.csv:
- A: 261
- B: 261
- C: 261
- D: 261
Inference
Final inference uses score-only A/B/C/D log-softmax scoring.
Public Leaderboard
Public LB score: around 0.71