File size: 1,564 Bytes
f195f1d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 | ---
language:
- en
- zh
tags:
- game24
- qwen2.5
- sft
- grpo
- lora
- reasoning
library_name: transformers
base_model: Qwen/Qwen2.5-1.5B-Instruct
---
# game24-rl
This repository contains two checkpoints from the `game24-rl` course project:
- `sft-final/`: full fine-tuned `Qwen/Qwen2.5-1.5B-Instruct` checkpoint for 24-game reasoning.
- `grpo-lora-final/`: LoRA adapter trained from the SFT checkpoint with GRPO.
Code and experiment documentation:
https://github.com/ElysiaFollower/game24-rl
## Training Route
`Qwen2.5-1.5B-Instruct -> full SFT final -> GRPO LoRA adapter -> decoding/eval`
## Notes
The project focuses on standard 24-point game solving. The model is expected to produce reasoning and a final answer expression that can be checked by the repository verifier.
The GRPO artifact is a PEFT LoRA adapter, not a standalone full model. Load the SFT checkpoint first, then apply the adapter.
## Reported Repo-Local Results
Under the repo-local train/validation/test split documented in the GitHub repository:
- Base model full-data direct eval: `16/1362 = 1.17%`
- SFT final, validation, 1024 token budget: `110/136 = 80.88%`
- GRPO LoRA, validation, 1024 token budget: `116/136 = 85.29%`
- SFT final, validation, 4096 token budget: `123/136 = 90.44%`
- SFT final, test, 4096 token budget: `128/137 = 93.43%`
- GRPO LoRA, validation, 4096 token budget: `126/136 = 92.65%`
- GRPO LoRA, test, 4096 token budget: `129/137 = 94.16%`
See the GitHub handoff and experiment docs for split details, verifier details, decoding settings, and caveats.
|