Spaces:
Sleeping
Sleeping
Commit History
fix(grpo): eliminate zero-advantage collapse from stale rewards 38457df
Merge remote-tracking branch 'hf/main' into train/v1 1b68f93
fix(training): fix GRPO reward bugs + add v3 notebook with SFT warmup 703b668
fix(reward): harsh -1.0 for zero JSON output, -0.30 for zero task completion 5bcbe7f
Aditya Guntur commited on
fix(rollout): safe model unwrapping for accelerate/PEFT/DDP in _generate_no_vllm 606e517
Aditya Guntur commited on
fix(rollout): replace generate_rollout_completions (vLLM-only) with direct model.generate() 5d330b7
Aditya Guntur commited on