Commit History

  1. Add simulation disclaimer banner

    Verified signature
    d056af3
  2. Full-screen UI + OpenEnv API tab (reset/step/state/stop)

    Verified signature
    e019ca1
  3. Redesigned UI: dark theme, Plotly charts, 4 tabs, professional layout

    Verified signature
    644149b
  4. Fix: simulate action effects on next state so AI wins on latency reduction

    Verified signature
    fb4bf5a
  5. Deploy interactive simulation demo (Gradio, free CPU)

    Verified signature
    1489940

  1. Fix merge: fall back to warm-start adapter from HF when GRPO skipped

    Verified signature
    03140d1
  2. Skip GRPO: merge warm-start and push to HF

    Verified signature
    7f52093
  3. Fix: batch_size=4 so num_generations=4 divides evenly

    Verified signature
    278a0ec
  4. Fix: max_length -> max_seq_length for trl 0.15.2 (verified all configs locally)

    Verified signature
    beef760
  5. Fix: trl==0.15.2 (has GRPO, no vllm/FSDP dep)

    Verified signature
    e191204
  6. Fix: pin trl==0.12.2, verify imports during build

    Verified signature
    9ff82e1
  7. Fix: pin trl<0.17 for FSDP compat, skip world model (already done)

    Verified signature
    f4c4a2c
  8. Install CUDA PyTorch in slim image for A100 GPU

    Verified signature
    b3f08a7
  9. Revert to python:3.10-slim (was working) + health server prevents timeout

    Verified signature
    2e20db1
  10. Fix: install PyTorch with CUDA 12.1 support

    Verified signature
    36344b2
  11. Fix: use CUDA base image for GPU support

    Verified signature
    9894974
  12. Fix: add health server on port 7860 to prevent timeout

    Verified signature
    cfd9219
  13. Fix: batch_size=16, 10K samples, unbuffered output, 2 epochs

    Verified signature
    1572306
  14. Fix: set HOME/USER/TORCH env vars for uid 1000

    Verified signature
    0d9e780
  15. Fix all: writable /tmp cache, no login(), proper permissions

    Verified signature
    8b8863d
  16. Fix: set HF_HOME to writable directory

    Verified signature
    74820e1
  17. Fix Dockerfile: read HF_TOKEN from env correctly

    Verified signature
    3b0341d
  18. Use HF_TOKEN secret in Dockerfile

    Verified signature
    6205146
  19. Add Dockerfile and training script

    Verified signature
    97cae42
  20. initial commit

    Verified signature
    92b614c