|
|
|
|
|
--- |
|
|
tags: |
|
|
- unity-ml-agents |
|
|
- ml-agents |
|
|
- deep-reinforcement-learning |
|
|
- reinforcement-learning |
|
|
- ML-Agents-Pyramids |
|
|
library_name: ml-agents |
|
|
--- |
|
|
|
|
|
# **ppo** Agent playing **Pyramids** |
|
|
This is a trained model of a **ppo** agent playing **Pyramids** using the [Unity ML-Agents Library](https://github.com/Unity-Technologies/ml-agents). |
|
|
|
|
|
## Usage (with ML-Agents) |
|
|
The Documentation: https://github.com/huggingface/ml-agents#get-started |
|
|
We wrote a complete tutorial to learn to train your first agent using ML-Agents and publish it to the Hub: |
|
|
|
|
|
|
|
|
### Resume the training |
|
|
``` |
|
|
mlagents-learn ./config/ppo/PyramidsRND.yaml --run-id="Pyramids-Training" --resume |
|
|
``` |
|
|
### Training hyperparameters |
|
|
```python |
|
|
behaviors: |
|
|
Pyramids: |
|
|
trainer_type: ppo |
|
|
hyperparameters: |
|
|
batch_size: 128 |
|
|
buffer_size: 4096 |
|
|
learning_rate: 0.0003 |
|
|
beta: 0.01 |
|
|
epsilon: 0.2 |
|
|
lambd: 0.95 |
|
|
num_epoch: 3 |
|
|
learning_rate_schedule: linear |
|
|
network_settings: |
|
|
normalize: false |
|
|
hidden_units: 512 |
|
|
num_layers: 3 |
|
|
vis_encode_type: simple |
|
|
reward_signals: |
|
|
extrinsic: |
|
|
gamma: 0.99 |
|
|
strength: 1.0 |
|
|
rnd: |
|
|
gamma: 0.99 |
|
|
strength: 0.01 |
|
|
network_settings: |
|
|
hidden_units: 128 |
|
|
num_layers: 3 |
|
|
learning_rate: 0.0001 |
|
|
keep_checkpoints: 5 |
|
|
max_steps: 900000 |
|
|
time_horizon: 256 |
|
|
summary_freq: 30000 |
|
|
``` |
|
|
|
|
|
### Watch your Agent play |
|
|
You can watch your agent **playing directly in your browser:**. |
|
|
|
|
|
1. Go to https://huggingface.co/spaces/unity/ML-Agents-Pyramids |
|
|
2. Step 1: Write your model_id: kinkpunk/PPO-PyramidsRND |
|
|
3. Step 2: Select your *.nn /*.onnx file |
|
|
4. Click on Watch the agent play 👀 |
|
|
|
