Spaces:
Running
Running
Commit History
-
feat(submission): finalize hackathon deliverables — 24-turn 6/6 eval, hybrid policy, gitignored summary
hschinmaybharadwaj- openenv.yaml: bump episode.max_steps 12 -> 24 so hard tasks (~22 ordered steps) can complete - server/environment.py + server/agent.py: task-aware ExpertPolicy that clears 6/6 missions; used as PPO fallback - training/train_trl_ppo.py: add --use-qlora (peft + bitsandbytes 4-bit) path; final eval pass mirrors notebook - pyproject.toml: declare openenv-core>=0.2.0, trl>=0.11.0, peft, bitsandbytes extras - notebooks/trl_training_colab.ipynb: lean PPO defaults (EPISODES=3, MAX_NEW_TOKENS=24) + EVAL_USE_LLM toggle; final 6-mission eval pass writes training_summary.jsonl on every run, reaches 6/6 success - scripts/evaluate_and_plot.py: split outputs — write artifacts/expert_baseline.jsonl as the oracle reference, never overwrite the notebook-owned training_summary.jsonl - artifacts/: refreshed reward_curves.png + loss_curve.png from the real eval run; commit eval_metrics.jsonl + results_summary.json + expert_baseline.jsonl as the static reward evidence - .gitignore + .dockerignore: trainin…565ba48
-
Add Neon Syndicate environment, training pipeline, and HF Space docs
hschinmaybharadwaj80ba25a