---
language:
- en
- zh
tags:
- game24
- qwen2.5
- sft
- grpo
- lora
- reasoning
library_name: transformers
base_model: Qwen/Qwen2.5-1.5B-Instruct
---

# game24-rl

This repository contains two checkpoints from the `game24-rl` course project:

- `sft-final/`: full fine-tuned `Qwen/Qwen2.5-1.5B-Instruct` checkpoint for 24-game reasoning.
- `grpo-lora-final/`: LoRA adapter trained from the SFT checkpoint with GRPO.

Code and experiment documentation:
https://github.com/ElysiaFollower/game24-rl

## Training Route

`Qwen2.5-1.5B-Instruct -> full SFT final -> GRPO LoRA adapter -> decoding/eval`

## Notes

The project focuses on standard 24-point game solving. The model is expected to produce reasoning and a final answer expression that can be checked by the repository verifier.

The GRPO artifact is a PEFT LoRA adapter, not a standalone full model. Load the SFT checkpoint first, then apply the adapter.

## Reported Repo-Local Results

Under the repo-local train/validation/test split documented in the GitHub repository:

- Base model full-data direct eval: `16/1362 = 1.17%`
- SFT final, validation, 1024 token budget: `110/136 = 80.88%`
- GRPO LoRA, validation, 1024 token budget: `116/136 = 85.29%`
- SFT final, validation, 4096 token budget: `123/136 = 90.44%`
- SFT final, test, 4096 token budget: `128/137 = 93.43%`
- GRPO LoRA, validation, 4096 token budget: `126/136 = 92.65%`
- GRPO LoRA, test, 4096 token budget: `129/137 = 94.16%`

See the GitHub handoff and experiment docs for split details, verifier details, decoding settings, and caveats.