---
base_model: Qwen/Qwen3-1.7B
library_name: peft
license: apache-2.0
tags:
- grpo
- reinforcement-learning
- countdown
- llm-controller
- qwen3
---

# LLM-Zero-Lite Experiments

A controlled comparison of continuous GRPO, fixed staged GRPO, and an
LLM-controlled staged GRPO schedule on three-number Countdown using
`Qwen/Qwen3-1.7B` with LoRA.

## Final 1,000-step results

| Method | Greedy accuracy | Sampled pass@1 | Sampled pass@4 |
|---|---:|---:|---:|
| Continuous GRPO | 26.5% | 31.0% | 35.5% |
| Fixed staged GRPO | 34.5% | 34.5% | 39.5% |
| LLM controller | **36.5%** | **37.5%** | **40.5%** |

The `runs/` directory contains metrics, evaluation samples, configuration
history, controller decisions, logs, plots, and all saved LoRA checkpoints.