File size: 1,630 Bytes
06b5963 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 |
---
tags:
- deep-reinforcement-learning
- reinforcement-learning
- stable-baselines3
- BipedalWalker-v3
- PPO
- SAC
library_name: stable-baselines3
model_name: ppo
---
# 🤖 PPO/SAC Agent for BipedalWalker-v3
This is a trained agent that learned to walk on two legs from scratch!
## Model Description
- **Algorithm**: PPO or SAC (Soft Actor-Critic)
- **Environment**: BipedalWalker-v3
- **Framework**: Stable-Baselines3
- **Training Steps**: 500,000 steps
## Performance
- **Walking Success**: Consistent bipedal locomotion
- **Average Reward**: 200+ (successful walking)
- **Coordination**: Learned proper leg coordination and balance
## Usage
```python
from stable_baselines3 import PPO
import gymnasium as gym
# Load the trained model
model = PPO.load("bipedal_walker_ppo_model")
# Create environment
env = gym.make('BipedalWalker-v3', render_mode='human')
# Watch it walk!
obs, _ = env.reset()
for _ in range(2000):
action, _ = model.predict(obs, deterministic=True)
obs, reward, terminated, truncated, info = env.step(action)
if terminated or truncated:
obs, _ = env.reset()
env.close()
```
## Training Details
The agent learned to coordinate:
- 4 continuous joint controls (hip + knee for each leg)
- Balance and momentum management
- Forward locomotion
- Obstacle navigation
## What Makes This Impressive
- **24-dimensional state space** - Complex sensory input
- **Continuous control** - Smooth joint movements
- **Physics simulation** - Realistic walking dynamics
- **From scratch learning** - No pre-programmed walking patterns
Amazing to watch a robot learn to walk! 🚶♂️
|