safe-autonomous-systems/ppo-CylinderRot2D-medium-v0

PPO on CylinderRot2D-medium-v0 (FluidGym)

This repository is part of the FluidGym benchmark results. It contains trained Stable Baselines3 agents for the specialized CylinderRot2D-medium-v0 environment.

Evaluation Results

Global Performance (Aggregated across 5 seeds)

Mean Reward: 0.31 ± 0.03

Per-Seed Statistics

Run	Mean Reward	Std Dev
Seed 0	0.31	0.64
Seed 1	0.29	0.66
Seed 2	0.26	0.55
Seed 3	0.30	0.66
Seed 4	0.36	0.63

About FluidGym

FluidGym is a benchmark for reinforcement learning in active flow control.

Usage

Each seed is contained in its own subdirectory. You can load a model using:

from stable_baselines3 import PPO
model = PPO.load("0/ckpt_latest.zip")

References

• Plug-and-Play Benchmarking of Reinforcement Learning Algorithms for Large-Scale Flow Control
• FluidGym GitHub Repository