metadata
base_model: Qwen/Qwen3-1.7B
library_name: peft
license: apache-2.0
tags:
- grpo
- reinforcement-learning
- countdown
- llm-controller
- qwen3
LLM-Zero-Lite Experiments
A controlled comparison of continuous GRPO, fixed staged GRPO, and an
LLM-controlled staged GRPO schedule on three-number Countdown using
Qwen/Qwen3-1.7B with LoRA.
Final 1,000-step results
| Method | Greedy accuracy | Sampled pass@1 | Sampled pass@4 |
|---|---|---|---|
| Continuous GRPO | 26.5% | 31.0% | 35.5% |
| Fixed staged GRPO | 34.5% | 34.5% | 39.5% |
| LLM controller | 36.5% | 37.5% | 40.5% |
The runs/ directory contains metrics, evaluation samples, configuration
history, controller decisions, logs, plots, and all saved LoRA checkpoints.