penfever's picture
Upload README.md with huggingface_hub
a8c25c6 verified
|
Raw
History Blame Contribute Delete
1.62 kB
metadata
base_model: >-
  laion/GLM-4_7-swesmith-sandboxes-with_tests-oracle_verified_120s-maxeps-131k-fixthink
tags:
  - rl
  - skyrl
  - agentic
  - swe
library_name: transformers

ablation-pymethods2test-shaped-45-8B

RL (SkyRL GRPO) checkpoint from the shaped-reward ablation of the a3-successor study. Reward = shaped pass-ratio (fraction of tests passing, reward_shaper=pass_ratio), as opposed to the binary all-tests-pass reward of the a3 series.

The rl_config.json in this repo is the exact launch config used for reproducibility.

Training Traces

Training-time Daytona/Harbor rollouts for this run are uploaded as a companion dataset: penfever/ablation-pymethods2test-shaped

The dataset contains the last episode of each trial (per make_and_upload_trace_dataset --episodes last) — the same rollouts the policy was trained on after rollback / truncation.