---
      tags:
      - unity-ml-agents
      - ml-agents
      - deep-reinforcement-learning
      - reinforcement-learning
      - ML-Agents-Pyramids
      library_name: ml-agents
---
    
  # **ppo** Agent playing **Pyramids**
  This is a trained model of a **ppo** agent playing **Pyramids** using the [Unity ML-Agents Library](https://github.com/Unity-Technologies/ml-agents).
  
  ## Usage (with ML-Agents)
  The Documentation: https://github.com/huggingface/ml-agents#get-started
  We wrote a complete tutorial to learn to train your first agent using ML-Agents and publish it to the Hub:


  ### Resume the training
  ```
  mlagents-learn ./config/ppo/PyramidsRND.yaml --run-id="Pyramids-Training" --resume
  ```
  ### Training hyperparameters
  ```python
  behaviors:
  Pyramids:
    trainer_type: ppo
    hyperparameters:
      batch_size: 128
      buffer_size: 4096
      learning_rate: 0.0003
      beta: 0.01
      epsilon: 0.2
      lambd: 0.95
      num_epoch: 3
      learning_rate_schedule: linear
    network_settings:
      normalize: false
      hidden_units: 512
      num_layers: 3
      vis_encode_type: simple
    reward_signals:
      extrinsic:
        gamma: 0.99
        strength: 1.0
      rnd:
        gamma: 0.99
        strength: 0.01
        network_settings:
          hidden_units: 128
          num_layers: 3
        learning_rate: 0.0001
    keep_checkpoints: 5
    max_steps: 900000
    time_horizon: 256
    summary_freq: 30000
  ```

  ### Watch your Agent play
  You can watch your agent **playing directly in your browser:**.
  
  1. Go to https://huggingface.co/spaces/unity/ML-Agents-Pyramids
  2. Step 1: Write your model_id: kinkpunk/PPO-PyramidsRND
  3. Step 2: Select your *.nn /*.onnx file
  4. Click on Watch the agent play 👀