Reinforcement Learning
stable-baselines3
InvertedDoublePendulum-v5
deep-reinforcement-learning
gymnasium
ppo
Eval Results (legacy)
Instructions to use FmyzA/ppo-InvertedDoublePendulum-v5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- stable-baselines3
How to use FmyzA/ppo-InvertedDoublePendulum-v5 with stable-baselines3:
from huggingface_sb3 import load_from_hub checkpoint = load_from_hub( repo_id="FmyzA/ppo-InvertedDoublePendulum-v5", filename="{MODEL FILENAME}.zip", ) - Notebooks
- Google Colab
- Kaggle
File size: 1,903 Bytes
0f8b335 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 | ---
library_name: stable-baselines3
tags:
- InvertedDoublePendulum-v5
- deep-reinforcement-learning
- reinforcement-learning
- stable-baselines3
- gymnasium
- ppo
model-index:
- name: ppo-InvertedDoublePendulum-v5
results:
- task:
type: reinforcement-learning
name: reinforcement-learning
dataset:
name: InvertedDoublePendulum-v5
type: InvertedDoublePendulum-v5
metrics:
- type: mean_reward
value: 9358.13 +/- 0.39
name: mean_reward
verified: false
---
# **ppo-InvertedDoublePendulum-v5** Agent playing **InvertedDoublePendulum-v5**
This is a trained model of a **PPO** agent playing **InvertedDoublePendulum-v5**
using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3)
and [gymnasium](https://gymnasium.farama.org/).
## Evaluation
| metric | value |
|---|---|
| mean_reward | **9358.13** |
| std_reward | 0.39 |
| mean - std | 9357.74 |
| episodes | 10 |
## Usage (with Stable-Baselines3)
```python
import gymnasium as gym
from stable_baselines3 import PPO
from huggingface_sb3 import load_from_hub
repo_id = "ppo-InvertedDoublePendulum-v5" # or <your-user>/<repo-name>
filename = "ppo-InvertedDoublePendulum-v5.zip"
checkpoint = load_from_hub(repo_id, filename)
model = PPO.load(checkpoint)
env = gym.make("InvertedDoublePendulum-v5", render_mode="rgb_array")
obs, _ = env.reset()
for _ in range(1000):
action, _ = model.predict(obs, deterministic=True)
obs, reward, terminated, truncated, info = env.step(action)
if terminated or truncated:
obs, _ = env.reset()
env.close()
```
## Files
- `ppo-InvertedDoublePendulum-v5.zip` - the trained policy
- `replay.mp4` - a deterministic replay of one episode
- `results.json` - raw evaluation numbers
- `config.json` - the constructor arguments stored inside the checkpoint
|