safe-autonomous-systems/sac-CylinderRot2D-medium-v0

SAC on CylinderRot2D-medium-v0 (FluidGym)

This repository is part of the FluidGym benchmark results. It contains trained Stable Baselines3 agents for the specialized CylinderRot2D-medium-v0 environment.

Evaluation Results

Global Performance (Aggregated across 5 seeds)

Mean Reward: 0.34 ± 0.04

Per-Seed Statistics

Run	Mean Reward	Std Dev
Seed 0	0.40	0.63
Seed 1	0.29	0.67
Seed 2	0.36	0.69
Seed 3	0.32	0.66
Seed 4	0.34	0.65

About FluidGym

FluidGym is a benchmark for reinforcement learning in active flow control.

Usage

Each seed is contained in its own subdirectory. You can load a model using:

from stable_baselines3 import SAC
model = SAC.load("0/ckpt_latest.zip")

**Important:** The models were trained using ```fluidgym==0.0.2```. In order to use
them with newer versions of FluidGym, you need to wrap the environment with a
`FlattenObservation` wrapper as shown below:
```python
import fluidgym
from fluidgym.wrappers import FlattenObservation
from stable_baselines3 import SAC

env = fluidgym.make("CylinderRot2D-medium-v0")
env = FlattenObservation(env)
model = SAC.load("path_to_model/ckpt_latest.zip")

obs, info = env.reset(seed=42)

action, _ = model.predict(obs, deterministic=True)
obs, reward, terminated, truncated, info = env.step(action)

References

• Plug-and-Play Benchmarking of Reinforcement Learning Algorithms for Large-Scale Flow Control
• FluidGym GitHub Repository