File size: 1,342 Bytes
6d924ec | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
license: apache-2.0
tags:
- reinforcement-learning
- stable-baselines3
- ppo
- game
- gymnasium
- pygame
library_name: stable-baselines3
task: reinforcement-learning
---
# PixelCopter RL Agent
## Overview
PixelCopter is a side-scrolling reinforcement learning environment inspired by the classic helicopter game. The agent:
- Controls a **pixel copter** navigating through a scrolling cavern.
- Avoids colliding with walls that move from right to left.
- Gains positive rewards for surviving timesteps; receives negative rewards on collision.
This repository contains:
- `train_pixelcopter.py` – Training script
- `test_pixelcopter.py` – Test script with Pygame visualization
- `ppo_pixelcopter_cert.zip` – Pre-trained PPO agent
---
## Environment Details
- **Observation Space:** `[copter_y, wall_gap_positions...]`
- **Action Space:**
- `0`: Do nothing (gravity pulls the copter down)
- `1`: Apply lift (move upwards)
- **Rewards:**
- +1 for surviving a timestep
- -5 for collision
- **Medium Difficulty Settings:**
- Gap size: 6
- Gravity: 0.25
- Max timesteps per episode: 500
---
## Installation
```bash
pip install stable-baselines3 gymnasium pygame numpy
|