Prometheus17 commited on
Commit
f195f1d
·
verified ·
1 Parent(s): ad48315

Add model card

Browse files
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - zh
5
+ tags:
6
+ - game24
7
+ - qwen2.5
8
+ - sft
9
+ - grpo
10
+ - lora
11
+ - reasoning
12
+ library_name: transformers
13
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
14
+ ---
15
+
16
+ # game24-rl
17
+
18
+ This repository contains two checkpoints from the `game24-rl` course project:
19
+
20
+ - `sft-final/`: full fine-tuned `Qwen/Qwen2.5-1.5B-Instruct` checkpoint for 24-game reasoning.
21
+ - `grpo-lora-final/`: LoRA adapter trained from the SFT checkpoint with GRPO.
22
+
23
+ Code and experiment documentation:
24
+ https://github.com/ElysiaFollower/game24-rl
25
+
26
+ ## Training Route
27
+
28
+ `Qwen2.5-1.5B-Instruct -> full SFT final -> GRPO LoRA adapter -> decoding/eval`
29
+
30
+ ## Notes
31
+
32
+ The project focuses on standard 24-point game solving. The model is expected to produce reasoning and a final answer expression that can be checked by the repository verifier.
33
+
34
+ The GRPO artifact is a PEFT LoRA adapter, not a standalone full model. Load the SFT checkpoint first, then apply the adapter.
35
+
36
+ ## Reported Repo-Local Results
37
+
38
+ Under the repo-local train/validation/test split documented in the GitHub repository:
39
+
40
+ - Base model full-data direct eval: `16/1362 = 1.17%`
41
+ - SFT final, validation, 1024 token budget: `110/136 = 80.88%`
42
+ - GRPO LoRA, validation, 1024 token budget: `116/136 = 85.29%`
43
+ - SFT final, validation, 4096 token budget: `123/136 = 90.44%`
44
+ - SFT final, test, 4096 token budget: `128/137 = 93.43%`
45
+ - GRPO LoRA, validation, 4096 token budget: `126/136 = 92.65%`
46
+ - GRPO LoRA, test, 4096 token budget: `129/137 = 94.16%`
47
+
48
+ See the GitHub handoff and experiment docs for split details, verifier details, decoding settings, and caveats.