Bhargav25/ppo-LunarLander-v2

PPO Agent Playing LunarLander-v2

This is a trained model of a PPO agent playing LunarLander-v2 using the CleanRL implementation for Unit 8 Part 1 of the Hugging Face Deep Reinforcement Learning Course.

Evaluation Results

• Environment: LunarLander-v2
• Mean Reward: 285.50 +/- 18.20

Hyperparameters

{
    'exp_name': 'ppo_lunar_lander',
    'seed': 1,
    'torch_deterministic': True,
    'cuda': True,
    'track': False,
    'wandb_project_name': 'cleanRL',
    'wandb_entity': None,
    'capture_video': False,
    'env_id': 'LunarLander-v2',
    'total_timesteps': 500000,
    'learning_rate': 0.00025,
    'num_envs': 4,
    'num_steps': 128,
    'anneal_lr': True,
    'gae': True,
    'gamma': 0.99,
    'gae_lambda': 0.95,
    'num_minibatches': 4,
    'update_epochs': 4,
    'norm_adv': True,
    'clip_coef': 0.2,
    'clip_vloss': True,
    'ent_coef': 0.01,
    'vf_coef': 0.5,
    'max_grad_norm': 0.5,
    'target_kl': None,
    'repo_id': 'Bhargav25/ppo-LunarLander-v2',
    'batch_size': 512,
    'minibatch_size': 128
}