Upload PPO LunarLander-v2 trained agent

README.md

@@ -16,7 +16,7 @@ model-index:
       type: LunarLander-v2
     metrics:
     - type: mean_reward
-      value: -193.25 +/- 78.07
+      value: 268.42 +/- 18.31
       name: mean_reward
       verified: false
 ---
@@ -25,35 +25,13 @@ model-index:
 This is a trained model of a **PPO** agent playing **LunarLander-v2**
 using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3).
 
-
-# CHECK COLAB: 
-https://colab.research.google.com/github/huggingface/deep-rl-class/blob/master/notebooks/unit1/unit1.ipynb
+## Usage (with Stable-baselines3)
+TODO: Add your code
 
 
 ```python
-!pip install shimmy
-
+from stable_baselines3 import ...
 from huggingface_sb3 import load_from_hub
-repo_id = "shunnaidder/ppo-LunarLander-v2" # The repo_id
-filename = "ppo-LunarLander-v2-small.zip" # The model filename.zip
-
-# When the model was trained on Python 3.8 the pickle protocol is 5
-# But Python 3.6, 3.7 use protocol 4
-# In order to get compatibility we need to:
-# 1. Install pickle5 (we done it at the beginning of the colab)
-# 2. Create a custom empty object we pass as parameter to PPO.load()
-custom_objects = {
-            "learning_rate": 0.0,
-            "lr_schedule": lambda _: 0.0,
-            "clip_range": lambda _: 0.0,
-}
-
-checkpoint = load_from_hub(repo_id, filename)
-model = PPO.load(checkpoint, custom_objects=custom_objects, print_system_info=True)
 
-#@title
-eval_env = Monitor(gym.make("LunarLander-v2"))
-mean_reward, std_reward = evaluate_policy(model, eval_env, n_eval_episodes=10, deterministic=True)
-print(f"mean_reward={mean_reward:.2f} +/- {std_reward}")
 ...
 ```

config.json

@@ -1 +1 @@
-{"policy_class": {":type:": "<class 'abc.ABCMeta'>", ":serialized:": "gAWVOwAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMEUFjdG9yQ3JpdGljUG9saWN5lJOULg==", "__module__": "stable_baselines3.common.policies", "__doc__": "\n    Policy class for actor-critic algorithms (has both policy and value prediction).\n    Used by A2C, PPO and the likes.\n\n    :param observation_space: Observation space\n    :param action_space: Action space\n    :param lr_schedule: Learning rate schedule (could be constant)\n    :param net_arch: The specification of the policy and value networks.\n    :param activation_fn: Activation function\n    :param ortho_init: Whether to use or not orthogonal initialization\n    :param use_sde: Whether to use State Dependent Exploration or not\n    :param log_std_init: Initial value for the log standard deviation\n    :param full_std: Whether to use (n_features x n_actions) parameters\n        for the std instead of only (n_features,) when using gSDE\n    :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n        a positive standard deviation (cf paper). It allows to keep variance\n        above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n    :param squash_output: Whether to squash the output using a tanh function,\n        this allows to ensure boundaries when using gSDE.\n    :param features_extractor_class: Features extractor to use.\n    :param features_extractor_kwargs: Keyword arguments\n        to pass to the features extractor.\n    :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n    :param normalize_images: Whether to normalize images or not,\n         dividing by 255.0 (True by default)\n    :param optimizer_class: The optimizer to use,\n        ``th.optim.Adam`` by default\n    :param optimizer_kwargs: Additional keyword arguments,\n        excluding the learning rate, to pass to the optimizer\n    ", "__init__": "<function ActorCriticPolicy.__init__ at 0x7d41f1e03ac0>", "_get_constructor_parameters": "<function ActorCriticPolicy._get_constructor_parameters at 0x7d41f1e03b50>", "reset_noise": "<function ActorCriticPolicy.reset_noise at 0x7d41f1e03be0>", "_build_mlp_extractor": "<function ActorCriticPolicy._build_mlp_extractor at 0x7d41f1e03c70>", "_build": "<function ActorCriticPolicy._build at 0x7d41f1e03d00>", "forward": "<function ActorCriticPolicy.forward at 0x7d41f1e03d90>", "extract_features": "<function ActorCriticPolicy.extract_features at 0x7d41f1e03e20>", "_get_action_dist_from_latent": "<function ActorCriticPolicy._get_action_dist_from_latent at 0x7d41f1e03eb0>", "_predict": "<function ActorCriticPolicy._predict at 0x7d41f1e03f40>", "evaluate_actions": "<function ActorCriticPolicy.evaluate_actions at 0x7d41f1e10040>", "get_distribution": "<function ActorCriticPolicy.get_distribution at 0x7d41f1e100d0>", "predict_values": "<function ActorCriticPolicy.predict_values at 0x7d41f1e10160>", "__abstractmethods__": "frozenset()", "_abc_impl": "<_abc._abc_data object at 0x7d41f1e0c340>"}, "verbose": 1, "policy_kwargs": {}, "num_timesteps": 16384, "_total_timesteps": 10000, "_num_timesteps_at_start": 0, "seed": null, "action_noise": null, "start_time": 1698152231293926457, "learning_rate": 0.0003, "tensorboard_log": null, "_last_obs": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWVdQIAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYAAgAAAAAAAEb+xb5rmkk/+wZuPr9tlr/AtoW/WAbyvgAAAAAAAAAAwEnZvmRckj8WeYG/uz4av+Dz5z68zhI+AAAAAAAAAABmJjY7ShWdP3j4yztP3y+/17zhvGCH4bwAAAAAAAAAAADE1r2XTbs/ANwXvwo6Hj0P/A8+qkOoPQAAAAAAAAAAMyS3PKOOsD/f1j4/sxb9vkJEv7zyFf69AAAAAAAAAAAm45I9PpmjPx5JKT/QCRi/CCowvfYsbLwAAAAAAAAAAGaSPD1t4xc/UnjNPcZlnr+Wg0Y9WkcGPgAAAAAAAAAAgHQAPUApuj/Yp5Y+wlzePTOrib2P9iq+AAAAAAAAAACmDru+EMEgP4bubb/qjIK/XfnHPogxaj4AAAAAAAAAAMAsxL3rl6I/wod7vqaT2b737/O9dHIYvgAAAAAAAAAATYKJPbe3nT+J26I+kU0Rv14WFr7OgqO9AAAAAAAAAAAzUP282aqmPwvTqL79ph+/PwsPvNqp2b0AAAAAAAAAANUk8L7kgX8/an9hv6/yZ7/qxQM/zkQ+PgAAAAAAAAAA1q2gPviSmT+dJ20/gZQMv4n7Qr9DqKq+AAAAAAAAAAAzUCO/SYoJP4RCvb+ls56/8uvPP+9zRT8AAAAAAAAAAENKy75isjU+oMEuv41Ivb+guA6+ojzlvQAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksQSwiGlIwBQ5R0lFKULg=="}, "_last_episode_starts": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWVgwAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACUjAVudW1weZSMBWR0eXBllJOUjAJiMZSJiIeUUpQoSwOMAXyUTk5OSv////9K/////0sAdJRiSxCFlIwBQ5R0lFKULg=="}, "_last_original_obs": null, "_episode_num": 0, "use_sde": false, "sde_sample_freq": -1, "_current_progress_remaining": -0.6384000000000001, "_stats_window_size": 100, "ep_info_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWV4AsAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpRHwHNKoecQRPKMAWyUS2eMAXSUR0CIwoMYMvytdX2UKGgGR8Bfex3A2ycDaAdLXGgIR0CIwpU96kZadX2UKGgGR8B4dI/A0sOHaAdLkWgIR0CIwqsd1dPddX2UKGgGR8BYSXnhbW3CaAdLP2gIR0CIwv876pHadX2UKGgGR8ByA6WAwwj/aAdLa2gIR0CIwxv2oNutdX2UKGgGR8BTPwGW2PT5aAdLRWgIR0CIw18IAwPAdX2UKGgGR8BabwwTM7lraAdLZ2gIR0CIw1VjqfOEdX2UKGgGR8BsAXwAlv61aAdLYWgIR0CIw5dcB2fTdX2UKGgGR8B4PxajesPraAdLX2gIR0CIxCjB2wFDdX2UKGgGR8B3nLpgTh5xaAdLXmgIR0CIxIRLbpNcdX2UKGgGR8Blg3nnuAqeaAdLYWgIR0CIxRBMSK3vdX2UKGgGR8BpNTofSx7iaAdLP2gIR0CIxdIAfdRBdX2UKGgGR0AycaFVT72taAdLT2gIR0CIxrjn3cpLdX2UKGgGR8BlnpKjBVMmaAdLUGgIR0CIxxZ5iVjadX2UKGgGR8Bmbhv1lGwzaAdLRGgIR0CIxxO9FnZkdX2UKGgGR8B+gpTwUg0TaAdLemgIR0CIxyYrJ8v3dX2UKGgGR8BDiVvl2eQNaAdLUmgIR0CIxyYfnwG4dX2UKGgGR8BdWqFM7EHdaAdLhWgIR0CIxz+FUQ05dX2UKGgGR8BwZK8dxQzlaAdLUmgIR0CIx99GZuyedX2UKGgGR8BlF6jN6gM+aAdLaGgIR0CIx9003wTedX2UKGgGR8BxP1y2hIvraAdLYGgIR0CIx9Up/gBLdX2UKGgGR8BhPf8hs67vaAdLWmgIR0CIx/HQQcxTdX2UKGgGR8BRbATmGM4taAdLRmgIR0CIx/4mkWRBdX2UKGgGR8Br/OfbsWweaAdLS2gIR0CIyQ4n4O+adX2UKGgGR8BhMZs2vStvaAdLV2gIR0CIySR6nivQdX2UKGgGR8B2yh+5OJtSaAdLc2gIR0CIybW7OE/TdX2UKGgGR8BWJHK4hEBsaAdLO2gIR0CIyiOtnwocdX2UKGgGR8BfKZOJtSAIaAdLQWgIR0CIymutfXwtdX2UKGgGR8Byzxet0V8DaAdLi2gIR0CIyoSPEKmbdX2UKGgGR8B6f1g2Ifr9aAdLR2gIR0CIyt1CgK4QdX2UKGgGR8BYl2WyC4BnaAdLaGgIR0CIyzgccU/OdX2UKGgGR8BXKrSApazNaAdLVWgIR0CIy0zu4PPLdX2UKGgGR8BMx114gRseaAdLR2gIR0CIy2clw97odX2UKGgGR8BetbVvuPV/aAdLY2gIR0CIy5D63y7PdX2UKGgGR8B5WjD7655JaAdLcGgIR0CIzDUBnzxxdX2UKGgGR8BYs6LS/j82aAdLQWgIR0CIzFobn5i3dX2UKGgGR8BiIglMRHwxaAdLamgIR0CIzIE12q1gdX2UKGgGR8CDBpYywfQsaAdLbWgIR0CIzKad+XqrdX2UKGgGR8BeCAzHjp9raAdLWWgIR0CIzNiqhlDndX2UKGgGR8BpiDpkf9xZaAdLdGgIR0CIzONPP9k0dX2UKGgGR8BhOvizcAR1aAdLfGgIR0CIzSSIP9UCdX2UKGgGR8BYVB/7SApbaAdLOmgIR0CIzTnoPkJbdX2UKGgGR8BxrtY8uBczaAdLT2gIR0CIzUr+YMOPdX2UKGgGR8BJcqVhTfixaAdLRWgIR0CIzYHt4RmLdX2UKGgGR8Bextj0+TvBaAdLXmgIR0CIzZcKPXCkdX2UKGgGR8BX80zfrKNiaAdLQmgIR0CIzbu/k/8mdX2UKGgGR8Bjm8vysjmkaAdLXGgIR0CIzfhm5DqodX2UKGgGR8B57JTyauwHaAdLhWgIR0CIzirwOOKgdX2UKGgGR8BgRcpAlfJFaAdLbGgIR0CIzkUfPompdX2UKGgGR8BCu0Sh8IAwaAdLQmgIR0CIzmF8G9pRdX2UKGgGR8Bq3RkTYdyUaAdLQWgIR0CIzpMBZIQOdX2UKGgGR8BqOqjQAuIzaAdLZWgIR0CIzrVvuPV/dX2UKGgGR8BTHS31BdD6aAdLQ2gIR0CIzwEeQuEmdX2UKGgGR8BcCwJ5VwPzaAdLUWgIR0CIzwR9w3o+dX2UKGgGR8BShNaIN3GGaAdLTWgIR0CIz5nA6+36dX2UKGgGR8BWovsZ5zHTaAdLTWgIR0CIz7Pa+N96dX2UKGgGR8B6IUcBEKE4aAdLXGgIR0CIz9XXiBGydX2UKGgGR8Bk6HGjsUqQaAdLZWgIR0CIz+Lb5/LDdX2UKGgGR8BURrUwztTlaAdLQGgIR0CI0AwQDmr9dX2UKGgGR8Bc6lFtsN2DaAdLVWgIR0CI0Afms/6gdX2UKGgGR8Bm5IcvM8oyaAdLVmgIR0CI0HvitJWedX2UKGgGR8B0b/aN+9amaAdLYmgIR0CI0KWdmQKbdX2UKGgGR8BqOutfXwsoaAdLcWgIR0CI0T1OCXhPdX2UKGgGR8BpW/NiYsunaAdLXGgIR0CI0T3qzJIUdX2UKGgGR8BiLZ6rvLHNaAdLW2gIR0CI0VUBnzxxdX2UKGgGR8BBakb5uZTiaAdLTGgIR0CI0XSR8twrdX2UKGgGR8A3oGvfTCtSaAdLTWgIR0CI0YCCjDbbdX2UKGgGR8BzvNWQwK0EaAdLaGgIR0CI0YtSydFwdX2UKGgGR8B9bdVo6CDmaAdLX2gIR0CI0cUX531SdX2UKGgGR8BkmQ0dilSCaAdLUGgIR0CI0kMx46fbdX2UKGgGR8BK3cqnWJ7+aAdLVGgIR0CI0o938n/ldX2UKGgGR8BsbvmLcbiqaAdLUGgIR0CI0pRZU1htdX2UKGgGR8ByL1ooNNJwaAdLfWgIR0CI0pVea8YidX2UKGgGR8BecDmfXf65aAdLQWgIR0CI0pXmvGIbdX2UKGgGR8ByS2Pp6hQFaAdLYmgIR0CI0sG8mKIjdX2UKGgGR8BfMaaG5+YuaAdLaWgIR0CI0y2xY7q6dX2UKGgGR8Bb5donKGL2aAdLUWgIR0CI0zsdDIBBdX2UKGgGR8BWuBqfvnbJaAdLQGgIR0CI03MRHww1dX2UKGgGR8BmI48KXv6TaAdLRWgIR0CI04HARChOdX2UKGgGR8BuS/KbKA8TaAdLcmgIR0CI06/C66J7dX2UKGgGR8BdMF2/zreJaAdLTWgIR0CI066OHWSVdX2UKGgGR8BlMAf+0gKXaAdLQmgIR0CI09lo11nvdX2UKGgGR8BfbI2sJY1YaAdLXmgIR0CI1GiCaqjrdX2UKGgGR8BV2Y+0PYnOaAdLXGgIR0CI1GU0Nz8xdX2UKGgGR8BgLunVG0/oaAdLQWgIR0CI1JxqfvnbdX2UKGgGR8Bha+UMXrMUaAdLRWgIR0CI1MenQ6ZIdX2UKGgGR8B0qYS7GvOhaAdLXWgIR0CI1TjgAIY4dX2UKGgGR8BxnOA+Y+jeaAdLW2gIR0CI1XjENvwWdX2UKGgGR8BYqUsBhhH9aAdLRmgIR0CI1bLkCFK1dX2UKGgGR8BrL20ojOcEaAdLjmgIR0CI1cK+i8FqdX2UKGgGR8BY8fP5YYBOaAdLUGgIR0CI1c3HaN+9dX2UKGgGR0A3U/8EV32VaAdLSGgIR0CI1dC+lCTmdX2UKGgGR8Bh1x7gKnejaAdLTGgIR0CI1hr2QGOddX2UKGgGR8BqLBAnlXA/aAdLdmgIR0CI1oJC0F8pdX2UKGgGR8BiCTKxLTQWaAdLQGgIR0CI1qy0KJEZdX2UKGgGR8Byh+aPS2H+aAdLYWgIR0CI1slWwNb1dX2UKGgGR8BkD4UahpQDaAdLh2gIR0CI1uTUy57PdX2UKGgGR8BzOjD63y7PaAdLTGgIR0CI1uNjLB9DdX2UKGgGR8BUt9VR1oxpaAdLYGgIR0CI1vBRhttRdX2UKGgGR8BugAHqu8sdaAdLVGgIR0CI1ywlByCGdWUu"}, "ep_success_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWVIAAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKULg=="}, "_n_updates": 4, "observation_space": {":type:": "<class 'gymnasium.spaces.box.Box'>", ":serialized:": "gAWVcAIAAAAAAACMFGd5bW5hc2l1bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lGgFk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMDWJvdW5kZWRfYmVsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWCAAAAAAAAAABAQEBAQEBAZRoB4wCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksIhZSMAUOUdJRSlIwNYm91bmRlZF9hYm92ZZRoECiWCAAAAAAAAAABAQEBAQEBAZRoFEsIhZRoGHSUUpSMBl9zaGFwZZRLCIWUjANsb3eUaBAoliAAAAAAAAAAAAC0wgAAtMIAAKDAAACgwNsPScAAAKDAAAAAgAAAAICUaApLCIWUaBh0lFKUjARoaWdolGgQKJYgAAAAAAAAAAAAtEIAALRCAACgQAAAoEDbD0lAAACgQAAAgD8AAIA/lGgKSwiFlGgYdJRSlIwIbG93X3JlcHKUjFtbLTkwLiAgICAgICAgLTkwLiAgICAgICAgIC01LiAgICAgICAgIC01LiAgICAgICAgIC0zLjE0MTU5MjcgIC01LgogIC0wLiAgICAgICAgIC0wLiAgICAgICBdlIwJaGlnaF9yZXBylIxTWzkwLiAgICAgICAgOTAuICAgICAgICAgNS4gICAgICAgICA1LiAgICAgICAgIDMuMTQxNTkyNyAgNS4KICAxLiAgICAgICAgIDEuICAgICAgIF2UjApfbnBfcmFuZG9tlE51Yi4=", "dtype": "float32", "bounded_below": "[ True  True  True  True  True  True  True  True]", "bounded_above": "[ True  True  True  True  True  True  True  True]", "_shape": [8], "low": "[-90.        -90.         -5.         -5.         -3.1415927  -5.\n  -0.         -0.       ]", "high": "[90.        90.         5.         5.         3.1415927  5.\n  1.         1.       ]", "low_repr": "[-90.        -90.         -5.         -5.         -3.1415927  -5.\n  -0.         -0.       ]", "high_repr": "[90.        90.         5.         5.         3.1415927  5.\n  1.         1.       ]", "_np_random": null}, "action_space": {":type:": "<class 'gymnasium.spaces.discrete.Discrete'>", ":serialized:": "gAWV1QAAAAAAAACMGWd5bW5hc2l1bS5zcGFjZXMuZGlzY3JldGWUjAhEaXNjcmV0ZZSTlCmBlH2UKIwBbpSMFW51bXB5LmNvcmUubXVsdGlhcnJheZSMBnNjYWxhcpSTlIwFbnVtcHmUjAVkdHlwZZSTlIwCaTiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYkMIBAAAAAAAAACUhpRSlIwFc3RhcnSUaAhoDkMIAAAAAAAAAACUhpRSlIwGX3NoYXBllCloCmgOjApfbnBfcmFuZG9tlE51Yi4=", "n": "4", "start": "0", "_shape": [], "dtype": "int64", "_np_random": null}, "n_envs": 16, "n_steps": 1024, "gamma": 0.999, "gae_lambda": 0.98, "ent_coef": 0.01, "vf_coef": 0.5, "max_grad_norm": 0.5, "batch_size": 64, "n_epochs": 4, "clip_range": {":type:": "<class 'function'>", ":serialized:": "gAWVxQIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSS91c3IvbG9jYWwvbGliL3B5dGhvbjMuMTAvZGlzdC1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjARmdW5jlEuEQwIEAZSMA3ZhbJSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjEkvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgAjBBfbWFrZV9lbXB0eV9jZWxslJOUKVKUhZR0lFKUjBxjbG91ZHBpY2tsZS5jbG91ZHBpY2tsZV9mYXN0lIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaB99lH2UKGgWaA2MDF9fcXVhbG5hbWVfX5SMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZSMDl9fa3dkZWZhdWx0c19flE6MDF9fZGVmYXVsdHNfX5ROjApfX21vZHVsZV9flGgXjAdfX2RvY19flE6MC19fY2xvc3VyZV9flGgAjApfbWFrZV9jZWxslJOURz/JmZmZmZmahZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjAu"}, "clip_range_vf": null, "normalize_advantage": true, "target_kl": null, "lr_schedule": {":type:": "<class 'function'>", ":serialized:": "gAWVxQIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSS91c3IvbG9jYWwvbGliL3B5dGhvbjMuMTAvZGlzdC1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjARmdW5jlEuEQwIEAZSMA3ZhbJSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjEkvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgAjBBfbWFrZV9lbXB0eV9jZWxslJOUKVKUhZR0lFKUjBxjbG91ZHBpY2tsZS5jbG91ZHBpY2tsZV9mYXN0lIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaB99lH2UKGgWaA2MDF9fcXVhbG5hbWVfX5SMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZSMDl9fa3dkZWZhdWx0c19flE6MDF9fZGVmYXVsdHNfX5ROjApfX21vZHVsZV9flGgXjAdfX2RvY19flE6MC19fY2xvc3VyZV9flGgAjApfbWFrZV9jZWxslJOURz8zqSowVTJhhZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjAu"}, "system_info": {"OS": "Linux-5.15.120+-x86_64-with-glibc2.35 # 1 SMP Wed Aug 30 11:19:59 UTC 2023", "Python": "3.10.12", "Stable-Baselines3": "2.0.0a5", "PyTorch": "2.1.0+cu118", "GPU Enabled": "True", "Numpy": "1.23.5", "Cloudpickle": "2.2.1", "Gymnasium": "0.28.1", "OpenAI Gym": "0.25.2"}}
+{"policy_class": {":type:": "<class 'abc.ABCMeta'>", ":serialized:": "gAWVOwAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMEUFjdG9yQ3JpdGljUG9saWN5lJOULg==", "__module__": "stable_baselines3.common.policies", "__doc__": "\n    Policy class for actor-critic algorithms (has both policy and value prediction).\n    Used by A2C, PPO and the likes.\n\n    :param observation_space: Observation space\n    :param action_space: Action space\n    :param lr_schedule: Learning rate schedule (could be constant)\n    :param net_arch: The specification of the policy and value networks.\n    :param activation_fn: Activation function\n    :param ortho_init: Whether to use or not orthogonal initialization\n    :param use_sde: Whether to use State Dependent Exploration or not\n    :param log_std_init: Initial value for the log standard deviation\n    :param full_std: Whether to use (n_features x n_actions) parameters\n        for the std instead of only (n_features,) when using gSDE\n    :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n        a positive standard deviation (cf paper). It allows to keep variance\n        above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n    :param squash_output: Whether to squash the output using a tanh function,\n        this allows to ensure boundaries when using gSDE.\n    :param features_extractor_class: Features extractor to use.\n    :param features_extractor_kwargs: Keyword arguments\n        to pass to the features extractor.\n    :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n    :param normalize_images: Whether to normalize images or not,\n         dividing by 255.0 (True by default)\n    :param optimizer_class: The optimizer to use,\n        ``th.optim.Adam`` by default\n    :param optimizer_kwargs: Additional keyword arguments,\n        excluding the learning rate, to pass to the optimizer\n    ", "__init__": "<function ActorCriticPolicy.__init__ at 0x7d29a4f08f70>", "_get_constructor_parameters": "<function ActorCriticPolicy._get_constructor_parameters at 0x7d29a4f09000>", "reset_noise": "<function ActorCriticPolicy.reset_noise at 0x7d29a4f09090>", "_build_mlp_extractor": "<function ActorCriticPolicy._build_mlp_extractor at 0x7d29a4f09120>", "_build": "<function ActorCriticPolicy._build at 0x7d29a4f091b0>", "forward": "<function ActorCriticPolicy.forward at 0x7d29a4f09240>", "extract_features": "<function ActorCriticPolicy.extract_features at 0x7d29a4f092d0>", "_get_action_dist_from_latent": "<function ActorCriticPolicy._get_action_dist_from_latent at 0x7d29a4f09360>", "_predict": "<function ActorCriticPolicy._predict at 0x7d29a4f093f0>", "evaluate_actions": "<function ActorCriticPolicy.evaluate_actions at 0x7d29a4f09480>", "get_distribution": "<function ActorCriticPolicy.get_distribution at 0x7d29a4f09510>", "predict_values": "<function ActorCriticPolicy.predict_values at 0x7d29a4f095a0>", "__abstractmethods__": "frozenset()", "_abc_impl": "<_abc._abc_data object at 0x7d29a50a7bc0>"}, "verbose": 1, "policy_kwargs": {}, "num_timesteps": 1015808, "_total_timesteps": 1000000, "_num_timesteps_at_start": 0, "seed": null, "action_noise": null, "start_time": 1698270440471064974, "learning_rate": 0.0003, "tensorboard_log": null, "_last_obs": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWVdQIAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYAAgAAAAAAAGasojyPPmu6CrEYO0FoJLZ+zlc6MKoetQAAgD8AAIA/ACigPClsCLrmpM+6tyJFtZgXNbvmpfU5AACAPwAAgD9mWAA9e4KNum7RVDtkJD24exZ/ukX+/7kAAIA/AACAPzPLHj0f1fq5mrhmtkRAm7BwenW7ZlCHNQAAgD8AAIA/FhFsvrQ3pz9V6v6+R7XBvigQi77SJwG9AAAAAAAAAAAmPaw9j+4DuqtNgzoRu3u2RbK1OjOXlrkAAIA/AAAAAMCe0r1AKU8/9XDivAm1qb6vzL47qKFtvAAAAAAAAAAA5jHbvWPzmz/m0cG+bMTUvnMiw73ztea8AAAAAAAAAAAaIRO97HHqubq66TWE2o0wnQwWuxI6GLUAAIA/AACAP828DbvDQTO6fH+IujPIk7WZSY87ptmhOQAAgD8AAIA/s4pGPUjfp7qKtNW6Pq/btcJZvrZAVPU5AACAPwAAgD8zPtA8XPc4ulqlfzkQYII0JJjkugdVl7gAAIA/AACAP81OZL2OAKg/SnCDvVHvj75g10S9GzyKuwAAAAAAAAAAZt5vuxRckLqDmTY7xJFmNV4l67klxlO6AACAPwAAgD+a5xi8pJBxuWsa5DqrzWI1s2wsO+IpBroAAIA/AACAP0DX/L23Pg0/cww+PtrwlL4xlK08Q0skOwAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksQSwiGlIwBQ5R0lFKULg=="}, "_last_episode_starts": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWVgwAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACUjAVudW1weZSMBWR0eXBllJOUjAJiMZSJiIeUUpQoSwOMAXyUTk5OSv////9K/////0sAdJRiSxCFlIwBQ5R0lFKULg=="}, "_last_original_obs": null, "_episode_num": 0, "use_sde": false, "sde_sample_freq": -1, "_current_progress_remaining": -0.015808000000000044, "_stats_window_size": 100, "ep_info_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWVQgwAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpRHQGHOV6eGwieMAWyUTegDjAF0lEdAlDNxcZ9/jXV9lChoBkdAY032dupCKWgHTegDaAhHQJQ160MPSUl1fZQoaAZHQGH3HXd0q6RoB03oA2gIR0CUPP8jRlYmdX2UKGgGR0BmQD+aScLCaAdN6ANoCEdAlD9c5Ke05XV9lChoBkdAXXdH6MzdlGgHTegDaAhHQJRAobaRISV1fZQoaAZHQGPkrTQVsUJoB03oA2gIR0CUTLOlO45MdX2UKGgGR0Bfjq2v0RODaAdN6ANoCEdAlFGqc3EQ5HV9lChoBkdAZdAUFB6a9mgHTegDaAhHQJRTdcD8tPJ1fZQoaAZHQGSeXw1BMSNoB03oA2gIR0CUWTvLX+VDdX2UKGgGR0BjI6FbmlqKaAdN6ANoCEdAlFs56lchT3V9lChoBkdAYgxbor4FimgHTegDaAhHQJRf1C1JDmd1fZQoaAZHQGLsNp22XsxoB03oA2gIR0CUgRo99tuUdX2UKGgGR0BhjMS26TW5aAdN6ANoCEdAlISwQxveg3V9lChoBkdAZEcpvxYq5WgHTegDaAhHQJSKUQ+UyHp1fZQoaAZHQGMeISL61stoB03oA2gIR0CUjTzwc5sCdX2UKGgGR0Bwsg0+C9RKaAdNPgNoCEdAlI2ARChN/XV9lChoBkdAZLnkJ8fFJmgHTegDaAhHQJSOUN7SiM51fZQoaAZHQGGe83VCojxoB03oA2gIR0CUjvsFt8/mdX2UKGgGR0BjWTmyPdVOaAdN6ANoCEdAlJDwdGRV63V9lChoBkdAY9kwzLwF1WgHTegDaAhHQJSY6GtZFG51fZQoaAZHQGECiVrylN1oB03oA2gIR0CUmgCIk7fYdX2UKGgGR0BimwtSQ5mzaAdN6ANoCEdAlKjcYIjW1HV9lChoBkdAYyppQk5ZKWgHTegDaAhHQJSu1ttQ9A51fZQoaAZHQGZ5RDLKV6hoB03oA2gIR0CUsOJ53TuwdX2UKGgGR0Bl4dD4QBgeaAdN6ANoCEdAlLWrAk9lmXV9lChoBkdAZYFerMkhR2gHTegDaAhHQJS3Q1dgOSZ1fZQoaAZHQGdYQe/5+H9oB03oA2gIR0CUuk9HMEA6dX2UKGgGR0BjSyqOtGNJaAdN6ANoCEdAlNLO/5+H8HV9lChoBkdAYXgDQqqfe2gHTegDaAhHQJTVfdFfAsV1fZQoaAZHQGaa1lGwzLxoB03oA2gIR0CU2ahtLteEdX2UKGgGR0BiDHl4keIVaAdN6ANoCEdAlNy1n/T9bXV9lChoBkdAXl5YhdMTOGgHTegDaAhHQJTdA5p8F6l1fZQoaAZHQGY0UGeMAFRoB03oA2gIR0CU3crNnoPkdX2UKGgGR0BgzJlUZNwjaAdN6ANoCEdAlN5o4ACGOHV9lChoBkdAZNgtU4rBkGgHTegDaAhHQJTgedI5HVh1fZQoaAZHQGa3hStNi6RoB03oA2gIR0CU6vNZ/0/XdX2UKGgGR0BmqBIz3yqdaAdN6ANoCEdAlOxvaDf3vnV9lChoBkdAY2DgNPP9k2gHTegDaAhHQJT5DyXlbNd1fZQoaAZHQGfAaFEiMYNoB03oA2gIR0CU/aELpiZwdX2UKGgGR0Bm+8qYqoZRaAdN6ANoCEdAlP80q2Bre3V9lChoBkdAZPJtsN2C/WgHTegDaAhHQJUEZ0OmR/51fZQoaAZHQGad145cTrVoB03oA2gIR0CVBjpdrwfAdX2UKGgGR0BjTdQEZBLPaAdN6ANoCEdAlQmzSXt0FXV9lChoBkdAZIAYgq3EymgHTegDaAhHQJUTsQ2/BWR1fZQoaAZHQGVhaYmb9ZRoB03oA2gIR0CVL2DneSB9dX2UKGgGR0Bi3VU2kzoEaAdN6ANoCEdAlTcV9Sde6nV9lChoBkdAZKhu2qkuYmgHTegDaAhHQJU6veizsyB1fZQoaAZHQGY4xptaY/poB03oA2gIR0CVOx5AhStOdX2UKGgGR0BnC1Net0V8aAdN6ANoCEdAlTwLPIGQjnV9lChoBkdAY2Uh7mdRSGgHTegDaAhHQJU81GFzuF91fZQoaAZHQGKVGeUY8+1oB03oA2gIR0CVP0DG96C2dX2UKGgGR0BhyrDIikftaAdN6ANoCEdAlUgUWIoE0XV9lChoBkdAZSj9rGipN2gHTegDaAhHQJVJLSMLncN1fZQoaAZHQGPPoSlFc6hoB03oA2gIR0CVVNeJ53TvdX2UKGgGR0Bho+kN4JNTaAdN6ANoCEdAlVlsa0hNd3V9lChoBkdAXh6PdVNpNGgHTegDaAhHQJVbDied07t1fZQoaAZHQGUajHXEqDtoB03oA2gIR0CVYeNrTH81dX2UKGgGR0Bi8mV3Ux20aAdN6ANoCEdAlWRLLZBcA3V9lChoBkdAYnvC7btZ3mgHTegDaAhHQJVo1qJuVHF1fZQoaAZHQGb/44yXUpdoB03oA2gIR0CVdIiX6ZYxdX2UKGgGR0BwQ8dilSCOaAdNYwFoCEdAlYc4tcv/R3V9lChoBkdAY0lujynUD2gHTegDaAhHQJWIUy9EkSp1fZQoaAZHQGNJWNm16VtoB03oA2gIR0CVjWFz+3pfdX2UKGgGR0BktkTrVvuPaAdN6ANoCEdAlY/+E/Spi3V9lChoBkdAZoGKVII4VGgHTegDaAhHQJWQOizsyBV1fZQoaAZHQGPQccENe+poB03oA2gIR0CVkN9YfW+XdX2UKGgGR0Bn7cjxCpm3aAdN6ANoCEdAlZFqOtGNJnV9lChoBkdAYyEpSaVlgGgHTegDaAhHQJWTJ72L5yl1fZQoaAZHQGJX94u9OARoB03oA2gIR0CVm8eT3Zf2dX2UKGgGR0BmrbI5o4+9aAdN6ANoCEdAlZ1XryDqW3V9lChoBkdARIzHGS6lL2gHS/NoCEdAlaNHT/hl2HV9lChoBkdAZoYGCZnctWgHTegDaAhHQJWtUKjSG8F1fZQoaAZHQGR5/cWTHKhoB03oA2gIR0CVsnNsnAqNdX2UKGgGR0BxJjai9IwuaAdNZANoCEdAlbYEEX+ERXV9lChoBkdAYamasIVuaWgHTegDaAhHQJW5JL0z0pV1fZQoaAZHQGUewmNR3vBoB03oA2gIR0CVuwQiRnvldX2UKGgGR0BsNLoGIKtxaAdN+wJoCEdAlcTo0/GEPHV9lChoBkdAZqCN83Mpw2gHTegDaAhHQJXI3B1s+FF1fZQoaAZHQGfLvES/TLJoB03oA2gIR0CVywYDklu4dX2UKGgGR0BnzIvalDWtaAdN6ANoCEdAlcwTXOGCZnV9lChoBkdAZ5a5SWJJoWgHTegDaAhHQJXlNUT+NtJ1fZQoaAZHQGPTdUKiPABoB03oA2gIR0CV6N0Z3s5XdX2UKGgGR0BmgPMB6rvLaAdN6ANoCEdAleotknTiKnV9lChoBkdAZvICyyD7ImgHTegDaAhHQJXq7e54GEB1fZQoaAZHQEGvdvbXYlJoB0v6aAhHQJXuK1MM7U51fZQoaAZHQHEck1hsqKBoB00RA2gIR0CV9QHpr1ujdX2UKGgGR0Bi38FEAo5QaAdN6ANoCEdAlfW8sDnvD3V9lChoBkdAZf5Nucc2i2gHTegDaAhHQJX2vQ1JlJ91fZQoaAZHQGLzgmzByjpoB03oA2gIR0CV+qGMn7YTdX2UKGgGR0Bxjm+0w8GLaAdNNAFoCEdAlfrnEQ5FPXV9lChoBkdAa2R7WNFSbmgHTXgBaAhHQJX/dWU8mrt1fZQoaAZHQGNaHIyTINpoB03oA2gIR0CWBLq5sj3VdX2UKGgGR0Bh5J2ll9SdaAdN6ANoCEdAlghKya/h2nV9lChoBkdAcbBJ0W/JvGgHTdMDaAhHQJYJ7wVj7Q91fZQoaAZHQFsz7E5yU9poB03oA2gIR0CWDONzr/sFdX2UKGgGR0Bicemm+CbuaAdN6ANoCEdAlhYuBYmsvXV9lChoBkdAchxmrbQC0WgHTZoBaAhHQJYZG2b5M111fZQoaAZHQGP9RRMvh61oB03oA2gIR0CWHap+MIeHdX2UKGgGR0Bvf8gdOqNqaAdNLAJoCEdAlh3oSDh99nV9lChoBkdAY3JHTZxrBWgHTegDaAhHQJYe6/0ulGh1ZS4="}, "ep_success_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWVIAAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKULg=="}, "_n_updates": 248, "observation_space": {":type:": "<class 'gymnasium.spaces.box.Box'>", ":serialized:": "gAWVcAIAAAAAAACMFGd5bW5hc2l1bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lGgFk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMDWJvdW5kZWRfYmVsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWCAAAAAAAAAABAQEBAQEBAZRoB4wCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksIhZSMAUOUdJRSlIwNYm91bmRlZF9hYm92ZZRoECiWCAAAAAAAAAABAQEBAQEBAZRoFEsIhZRoGHSUUpSMBl9zaGFwZZRLCIWUjANsb3eUaBAoliAAAAAAAAAAAAC0wgAAtMIAAKDAAACgwNsPScAAAKDAAAAAgAAAAICUaApLCIWUaBh0lFKUjARoaWdolGgQKJYgAAAAAAAAAAAAtEIAALRCAACgQAAAoEDbD0lAAACgQAAAgD8AAIA/lGgKSwiFlGgYdJRSlIwIbG93X3JlcHKUjFtbLTkwLiAgICAgICAgLTkwLiAgICAgICAgIC01LiAgICAgICAgIC01LiAgICAgICAgIC0zLjE0MTU5MjcgIC01LgogIC0wLiAgICAgICAgIC0wLiAgICAgICBdlIwJaGlnaF9yZXBylIxTWzkwLiAgICAgICAgOTAuICAgICAgICAgNS4gICAgICAgICA1LiAgICAgICAgIDMuMTQxNTkyNyAgNS4KICAxLiAgICAgICAgIDEuICAgICAgIF2UjApfbnBfcmFuZG9tlE51Yi4=", "dtype": "float32", "bounded_below": "[ True  True  True  True  True  True  True  True]", "bounded_above": "[ True  True  True  True  True  True  True  True]", "_shape": [8], "low": "[-90.        -90.         -5.         -5.         -3.1415927  -5.\n  -0.         -0.       ]", "high": "[90.        90.         5.         5.         3.1415927  5.\n  1.         1.       ]", "low_repr": "[-90.        -90.         -5.         -5.         -3.1415927  -5.\n  -0.         -0.       ]", "high_repr": "[90.        90.         5.         5.         3.1415927  5.\n  1.         1.       ]", "_np_random": null}, "action_space": {":type:": "<class 'gymnasium.spaces.discrete.Discrete'>", ":serialized:": "gAWV1QAAAAAAAACMGWd5bW5hc2l1bS5zcGFjZXMuZGlzY3JldGWUjAhEaXNjcmV0ZZSTlCmBlH2UKIwBbpSMFW51bXB5LmNvcmUubXVsdGlhcnJheZSMBnNjYWxhcpSTlIwFbnVtcHmUjAVkdHlwZZSTlIwCaTiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYkMIBAAAAAAAAACUhpRSlIwFc3RhcnSUaAhoDkMIAAAAAAAAAACUhpRSlIwGX3NoYXBllCloCmgOjApfbnBfcmFuZG9tlE51Yi4=", "n": "4", "start": "0", "_shape": [], "dtype": "int64", "_np_random": null}, "n_envs": 16, "n_steps": 1024, "gamma": 0.999, "gae_lambda": 0.98, "ent_coef": 0.01, "vf_coef": 0.5, "max_grad_norm": 0.5, "batch_size": 64, "n_epochs": 4, "clip_range": {":type:": "<class 'function'>", ":serialized:": "gAWVxQIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSS91c3IvbG9jYWwvbGliL3B5dGhvbjMuMTAvZGlzdC1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjARmdW5jlEuEQwIEAZSMA3ZhbJSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjEkvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgAjBBfbWFrZV9lbXB0eV9jZWxslJOUKVKUhZR0lFKUjBxjbG91ZHBpY2tsZS5jbG91ZHBpY2tsZV9mYXN0lIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaB99lH2UKGgWaA2MDF9fcXVhbG5hbWVfX5SMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZSMDl9fa3dkZWZhdWx0c19flE6MDF9fZGVmYXVsdHNfX5ROjApfX21vZHVsZV9flGgXjAdfX2RvY19flE6MC19fY2xvc3VyZV9flGgAjApfbWFrZV9jZWxslJOURz/JmZmZmZmahZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjAu"}, "clip_range_vf": null, "normalize_advantage": true, "target_kl": null, "lr_schedule": {":type:": "<class 'function'>", ":serialized:": "gAWVxQIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSS91c3IvbG9jYWwvbGliL3B5dGhvbjMuMTAvZGlzdC1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjARmdW5jlEuEQwIEAZSMA3ZhbJSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjEkvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgAjBBfbWFrZV9lbXB0eV9jZWxslJOUKVKUhZR0lFKUjBxjbG91ZHBpY2tsZS5jbG91ZHBpY2tsZV9mYXN0lIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaB99lH2UKGgWaA2MDF9fcXVhbG5hbWVfX5SMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZSMDl9fa3dkZWZhdWx0c19flE6MDF9fZGVmYXVsdHNfX5ROjApfX21vZHVsZV9flGgXjAdfX2RvY19flE6MC19fY2xvc3VyZV9flGgAjApfbWFrZV9jZWxslJOURz8zqSowVTJhhZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjAu"}, "system_info": {"OS": "Linux-5.15.120+-x86_64-with-glibc2.35 # 1 SMP Wed Aug 30 11:19:59 UTC 2023", "Python": "3.10.12", "Stable-Baselines3": "2.0.0a5", "PyTorch": "2.1.0+cu118", "GPU Enabled": "True", "Numpy": "1.23.5", "Cloudpickle": "2.2.1", "Gymnasium": "0.28.1", "OpenAI Gym": "0.25.2"}}

ppo-LunarLander-v2.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b646bdd2df3ad95e9a9bd0777cf84c5f9d352b8c5d699dca4d1f92728df9d6b1
+size 148054

ppo-LunarLander-v2/_stable_baselines3_version

@@ -0,0 +1 @@
+2.0.0a5

ppo-LunarLander-v2/data

@@ -0,0 +1,99 @@
+{
+    "policy_class": {
+        ":type:": "<class 'abc.ABCMeta'>",
+        ":serialized:": "gAWVOwAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMEUFjdG9yQ3JpdGljUG9saWN5lJOULg==",
+        "__module__": "stable_baselines3.common.policies",
+        "__doc__": "\n    Policy class for actor-critic algorithms (has both policy and value prediction).\n    Used by A2C, PPO and the likes.\n\n    :param observation_space: Observation space\n    :param action_space: Action space\n    :param lr_schedule: Learning rate schedule (could be constant)\n    :param net_arch: The specification of the policy and value networks.\n    :param activation_fn: Activation function\n    :param ortho_init: Whether to use or not orthogonal initialization\n    :param use_sde: Whether to use State Dependent Exploration or not\n    :param log_std_init: Initial value for the log standard deviation\n    :param full_std: Whether to use (n_features x n_actions) parameters\n        for the std instead of only (n_features,) when using gSDE\n    :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n        a positive standard deviation (cf paper). It allows to keep variance\n        above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n    :param squash_output: Whether to squash the output using a tanh function,\n        this allows to ensure boundaries when using gSDE.\n    :param features_extractor_class: Features extractor to use.\n    :param features_extractor_kwargs: Keyword arguments\n        to pass to the features extractor.\n    :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n    :param normalize_images: Whether to normalize images or not,\n         dividing by 255.0 (True by default)\n    :param optimizer_class: The optimizer to use,\n        ``th.optim.Adam`` by default\n    :param optimizer_kwargs: Additional keyword arguments,\n        excluding the learning rate, to pass to the optimizer\n    ",
+        "__init__": "<function ActorCriticPolicy.__init__ at 0x7d29a4f08f70>",
+        "_get_constructor_parameters": "<function ActorCriticPolicy._get_constructor_parameters at 0x7d29a4f09000>",
+        "reset_noise": "<function ActorCriticPolicy.reset_noise at 0x7d29a4f09090>",
+        "_build_mlp_extractor": "<function ActorCriticPolicy._build_mlp_extractor at 0x7d29a4f09120>",
+        "_build": "<function ActorCriticPolicy._build at 0x7d29a4f091b0>",
+        "forward": "<function ActorCriticPolicy.forward at 0x7d29a4f09240>",
+        "extract_features": "<function ActorCriticPolicy.extract_features at 0x7d29a4f092d0>",
+        "_get_action_dist_from_latent": "<function ActorCriticPolicy._get_action_dist_from_latent at 0x7d29a4f09360>",
+        "_predict": "<function ActorCriticPolicy._predict at 0x7d29a4f093f0>",
+        "evaluate_actions": "<function ActorCriticPolicy.evaluate_actions at 0x7d29a4f09480>",
+        "get_distribution": "<function ActorCriticPolicy.get_distribution at 0x7d29a4f09510>",
+        "predict_values": "<function ActorCriticPolicy.predict_values at 0x7d29a4f095a0>",
+        "__abstractmethods__": "frozenset()",
+        "_abc_impl": "<_abc._abc_data object at 0x7d29a50a7bc0>"
+    },
+    "verbose": 1,
+    "policy_kwargs": {},
+    "num_timesteps": 1015808,
+    "_total_timesteps": 1000000,
+    "_num_timesteps_at_start": 0,
+    "seed": null,
+    "action_noise": null,
+    "start_time": 1698270440471064974,
+    "learning_rate": 0.0003,
+    "tensorboard_log": null,
+    "_last_obs": {
+        ":type:": "<class 'numpy.ndarray'>",
+        ":serialized:": "gAWVdQIAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYAAgAAAAAAAGasojyPPmu6CrEYO0FoJLZ+zlc6MKoetQAAgD8AAIA/ACigPClsCLrmpM+6tyJFtZgXNbvmpfU5AACAPwAAgD9mWAA9e4KNum7RVDtkJD24exZ/ukX+/7kAAIA/AACAPzPLHj0f1fq5mrhmtkRAm7BwenW7ZlCHNQAAgD8AAIA/FhFsvrQ3pz9V6v6+R7XBvigQi77SJwG9AAAAAAAAAAAmPaw9j+4DuqtNgzoRu3u2RbK1OjOXlrkAAIA/AAAAAMCe0r1AKU8/9XDivAm1qb6vzL47qKFtvAAAAAAAAAAA5jHbvWPzmz/m0cG+bMTUvnMiw73ztea8AAAAAAAAAAAaIRO97HHqubq66TWE2o0wnQwWuxI6GLUAAIA/AACAP828DbvDQTO6fH+IujPIk7WZSY87ptmhOQAAgD8AAIA/s4pGPUjfp7qKtNW6Pq/btcJZvrZAVPU5AACAPwAAgD8zPtA8XPc4ulqlfzkQYII0JJjkugdVl7gAAIA/AACAP81OZL2OAKg/SnCDvVHvj75g10S9GzyKuwAAAAAAAAAAZt5vuxRckLqDmTY7xJFmNV4l67klxlO6AACAPwAAgD+a5xi8pJBxuWsa5DqrzWI1s2wsO+IpBroAAIA/AACAP0DX/L23Pg0/cww+PtrwlL4xlK08Q0skOwAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksQSwiGlIwBQ5R0lFKULg=="
+    },
+    "_last_episode_starts": {
+        ":type:": "<class 'numpy.ndarray'>",
+        ":serialized:": "gAWVgwAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACUjAVudW1weZSMBWR0eXBllJOUjAJiMZSJiIeUUpQoSwOMAXyUTk5OSv////9K/////0sAdJRiSxCFlIwBQ5R0lFKULg=="
+    },
+    "_last_original_obs": null,
+    "_episode_num": 0,
+    "use_sde": false,
+    "sde_sample_freq": -1,
+    "_current_progress_remaining": -0.015808000000000044,
+    "_stats_window_size": 100,
+    "ep_info_buffer": {
+        ":type:": "<class 'collections.deque'>",
+        ":serialized:": "gAWVQgwAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpRHQGHOV6eGwieMAWyUTegDjAF0lEdAlDNxcZ9/jXV9lChoBkdAY032dupCKWgHTegDaAhHQJQ160MPSUl1fZQoaAZHQGH3HXd0q6RoB03oA2gIR0CUPP8jRlYmdX2UKGgGR0BmQD+aScLCaAdN6ANoCEdAlD9c5Ke05XV9lChoBkdAXXdH6MzdlGgHTegDaAhHQJRAobaRISV1fZQoaAZHQGPkrTQVsUJoB03oA2gIR0CUTLOlO45MdX2UKGgGR0Bfjq2v0RODaAdN6ANoCEdAlFGqc3EQ5HV9lChoBkdAZdAUFB6a9mgHTegDaAhHQJRTdcD8tPJ1fZQoaAZHQGSeXw1BMSNoB03oA2gIR0CUWTvLX+VDdX2UKGgGR0BjI6FbmlqKaAdN6ANoCEdAlFs56lchT3V9lChoBkdAYgxbor4FimgHTegDaAhHQJRf1C1JDmd1fZQoaAZHQGLsNp22XsxoB03oA2gIR0CUgRo99tuUdX2UKGgGR0BhjMS26TW5aAdN6ANoCEdAlISwQxveg3V9lChoBkdAZEcpvxYq5WgHTegDaAhHQJSKUQ+UyHp1fZQoaAZHQGMeISL61stoB03oA2gIR0CUjTzwc5sCdX2UKGgGR0Bwsg0+C9RKaAdNPgNoCEdAlI2ARChN/XV9lChoBkdAZLnkJ8fFJmgHTegDaAhHQJSOUN7SiM51fZQoaAZHQGGe83VCojxoB03oA2gIR0CUjvsFt8/mdX2UKGgGR0BjWTmyPdVOaAdN6ANoCEdAlJDwdGRV63V9lChoBkdAY9kwzLwF1WgHTegDaAhHQJSY6GtZFG51fZQoaAZHQGECiVrylN1oB03oA2gIR0CUmgCIk7fYdX2UKGgGR0BimwtSQ5mzaAdN6ANoCEdAlKjcYIjW1HV9lChoBkdAYyppQk5ZKWgHTegDaAhHQJSu1ttQ9A51fZQoaAZHQGZ5RDLKV6hoB03oA2gIR0CUsOJ53TuwdX2UKGgGR0Bl4dD4QBgeaAdN6ANoCEdAlLWrAk9lmXV9lChoBkdAZYFerMkhR2gHTegDaAhHQJS3Q1dgOSZ1fZQoaAZHQGdYQe/5+H9oB03oA2gIR0CUuk9HMEA6dX2UKGgGR0BjSyqOtGNJaAdN6ANoCEdAlNLO/5+H8HV9lChoBkdAYXgDQqqfe2gHTegDaAhHQJTVfdFfAsV1fZQoaAZHQGaa1lGwzLxoB03oA2gIR0CU2ahtLteEdX2UKGgGR0BiDHl4keIVaAdN6ANoCEdAlNy1n/T9bXV9lChoBkdAXl5YhdMTOGgHTegDaAhHQJTdA5p8F6l1fZQoaAZHQGY0UGeMAFRoB03oA2gIR0CU3crNnoPkdX2UKGgGR0BgzJlUZNwjaAdN6ANoCEdAlN5o4ACGOHV9lChoBkdAZNgtU4rBkGgHTegDaAhHQJTgedI5HVh1fZQoaAZHQGa3hStNi6RoB03oA2gIR0CU6vNZ/0/XdX2UKGgGR0BmqBIz3yqdaAdN6ANoCEdAlOxvaDf3vnV9lChoBkdAY2DgNPP9k2gHTegDaAhHQJT5DyXlbNd1fZQoaAZHQGfAaFEiMYNoB03oA2gIR0CU/aELpiZwdX2UKGgGR0Bm+8qYqoZRaAdN6ANoCEdAlP80q2Bre3V9lChoBkdAZPJtsN2C/WgHTegDaAhHQJUEZ0OmR/51fZQoaAZHQGad145cTrVoB03oA2gIR0CVBjpdrwfAdX2UKGgGR0BjTdQEZBLPaAdN6ANoCEdAlQmzSXt0FXV9lChoBkdAZIAYgq3EymgHTegDaAhHQJUTsQ2/BWR1fZQoaAZHQGVhaYmb9ZRoB03oA2gIR0CVL2DneSB9dX2UKGgGR0Bi3VU2kzoEaAdN6ANoCEdAlTcV9Sde6nV9lChoBkdAZKhu2qkuYmgHTegDaAhHQJU6veizsyB1fZQoaAZHQGY4xptaY/poB03oA2gIR0CVOx5AhStOdX2UKGgGR0BnC1Net0V8aAdN6ANoCEdAlTwLPIGQjnV9lChoBkdAY2Uh7mdRSGgHTegDaAhHQJU81GFzuF91fZQoaAZHQGKVGeUY8+1oB03oA2gIR0CVP0DG96C2dX2UKGgGR0BhyrDIikftaAdN6ANoCEdAlUgUWIoE0XV9lChoBkdAZSj9rGipN2gHTegDaAhHQJVJLSMLncN1fZQoaAZHQGPPoSlFc6hoB03oA2gIR0CVVNeJ53TvdX2UKGgGR0Bho+kN4JNTaAdN6ANoCEdAlVlsa0hNd3V9lChoBkdAXh6PdVNpNGgHTegDaAhHQJVbDied07t1fZQoaAZHQGUajHXEqDtoB03oA2gIR0CVYeNrTH81dX2UKGgGR0Bi8mV3Ux20aAdN6ANoCEdAlWRLLZBcA3V9lChoBkdAYnvC7btZ3mgHTegDaAhHQJVo1qJuVHF1fZQoaAZHQGb/44yXUpdoB03oA2gIR0CVdIiX6ZYxdX2UKGgGR0BwQ8dilSCOaAdNYwFoCEdAlYc4tcv/R3V9lChoBkdAY0lujynUD2gHTegDaAhHQJWIUy9EkSp1fZQoaAZHQGNJWNm16VtoB03oA2gIR0CVjWFz+3pfdX2UKGgGR0BktkTrVvuPaAdN6ANoCEdAlY/+E/Spi3V9lChoBkdAZoGKVII4VGgHTegDaAhHQJWQOizsyBV1fZQoaAZHQGPQccENe+poB03oA2gIR0CVkN9YfW+XdX2UKGgGR0Bn7cjxCpm3aAdN6ANoCEdAlZFqOtGNJnV9lChoBkdAYyEpSaVlgGgHTegDaAhHQJWTJ72L5yl1fZQoaAZHQGJX94u9OARoB03oA2gIR0CVm8eT3Zf2dX2UKGgGR0BmrbI5o4+9aAdN6ANoCEdAlZ1XryDqW3V9lChoBkdARIzHGS6lL2gHS/NoCEdAlaNHT/hl2HV9lChoBkdAZoYGCZnctWgHTegDaAhHQJWtUKjSG8F1fZQoaAZHQGR5/cWTHKhoB03oA2gIR0CVsnNsnAqNdX2UKGgGR0BxJjai9IwuaAdNZANoCEdAlbYEEX+ERXV9lChoBkdAYamasIVuaWgHTegDaAhHQJW5JL0z0pV1fZQoaAZHQGUewmNR3vBoB03oA2gIR0CVuwQiRnvldX2UKGgGR0BsNLoGIKtxaAdN+wJoCEdAlcTo0/GEPHV9lChoBkdAZqCN83Mpw2gHTegDaAhHQJXI3B1s+FF1fZQoaAZHQGfLvES/TLJoB03oA2gIR0CVywYDklu4dX2UKGgGR0BnzIvalDWtaAdN6ANoCEdAlcwTXOGCZnV9lChoBkdAZ5a5SWJJoWgHTegDaAhHQJXlNUT+NtJ1fZQoaAZHQGPTdUKiPABoB03oA2gIR0CV6N0Z3s5XdX2UKGgGR0BmgPMB6rvLaAdN6ANoCEdAleotknTiKnV9lChoBkdAZvICyyD7ImgHTegDaAhHQJXq7e54GEB1fZQoaAZHQEGvdvbXYlJoB0v6aAhHQJXuK1MM7U51fZQoaAZHQHEck1hsqKBoB00RA2gIR0CV9QHpr1ujdX2UKGgGR0Bi38FEAo5QaAdN6ANoCEdAlfW8sDnvD3V9lChoBkdAZf5Nucc2i2gHTegDaAhHQJX2vQ1JlJ91fZQoaAZHQGLzgmzByjpoB03oA2gIR0CV+qGMn7YTdX2UKGgGR0Bxjm+0w8GLaAdNNAFoCEdAlfrnEQ5FPXV9lChoBkdAa2R7WNFSbmgHTXgBaAhHQJX/dWU8mrt1fZQoaAZHQGNaHIyTINpoB03oA2gIR0CWBLq5sj3VdX2UKGgGR0Bh5J2ll9SdaAdN6ANoCEdAlghKya/h2nV9lChoBkdAcbBJ0W/JvGgHTdMDaAhHQJYJ7wVj7Q91fZQoaAZHQFsz7E5yU9poB03oA2gIR0CWDONzr/sFdX2UKGgGR0Bicemm+CbuaAdN6ANoCEdAlhYuBYmsvXV9lChoBkdAchxmrbQC0WgHTZoBaAhHQJYZG2b5M111fZQoaAZHQGP9RRMvh61oB03oA2gIR0CWHap+MIeHdX2UKGgGR0Bvf8gdOqNqaAdNLAJoCEdAlh3oSDh99nV9lChoBkdAY3JHTZxrBWgHTegDaAhHQJYe6/0ulGh1ZS4="
+    },
+    "ep_success_buffer": {
+        ":type:": "<class 'collections.deque'>",
+        ":serialized:": "gAWVIAAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKULg=="
+    },
+    "_n_updates": 248,
+    "observation_space": {
+        ":type:": "<class 'gymnasium.spaces.box.Box'>",
+        ":serialized:": "gAWVcAIAAAAAAACMFGd5bW5hc2l1bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lGgFk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMDWJvdW5kZWRfYmVsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWCAAAAAAAAAABAQEBAQEBAZRoB4wCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksIhZSMAUOUdJRSlIwNYm91bmRlZF9hYm92ZZRoECiWCAAAAAAAAAABAQEBAQEBAZRoFEsIhZRoGHSUUpSMBl9zaGFwZZRLCIWUjANsb3eUaBAoliAAAAAAAAAAAAC0wgAAtMIAAKDAAACgwNsPScAAAKDAAAAAgAAAAICUaApLCIWUaBh0lFKUjARoaWdolGgQKJYgAAAAAAAAAAAAtEIAALRCAACgQAAAoEDbD0lAAACgQAAAgD8AAIA/lGgKSwiFlGgYdJRSlIwIbG93X3JlcHKUjFtbLTkwLiAgICAgICAgLTkwLiAgICAgICAgIC01LiAgICAgICAgIC01LiAgICAgICAgIC0zLjE0MTU5MjcgIC01LgogIC0wLiAgICAgICAgIC0wLiAgICAgICBdlIwJaGlnaF9yZXBylIxTWzkwLiAgICAgICAgOTAuICAgICAgICAgNS4gICAgICAgICA1LiAgICAgICAgIDMuMTQxNTkyNyAgNS4KICAxLiAgICAgICAgIDEuICAgICAgIF2UjApfbnBfcmFuZG9tlE51Yi4=",
+        "dtype": "float32",
+        "bounded_below": "[ True  True  True  True  True  True  True  True]",
+        "bounded_above": "[ True  True  True  True  True  True  True  True]",
+        "_shape": [
+            8
+        ],
+        "low": "[-90.        -90.         -5.         -5.         -3.1415927  -5.\n  -0.         -0.       ]",
+        "high": "[90.        90.         5.         5.         3.1415927  5.\n  1.         1.       ]",
+        "low_repr": "[-90.        -90.         -5.         -5.         -3.1415927  -5.\n  -0.         -0.       ]",
+        "high_repr": "[90.        90.         5.         5.         3.1415927  5.\n  1.         1.       ]",
+        "_np_random": null
+    },
+    "action_space": {
+        ":type:": "<class 'gymnasium.spaces.discrete.Discrete'>",
+        ":serialized:": "gAWV1QAAAAAAAACMGWd5bW5hc2l1bS5zcGFjZXMuZGlzY3JldGWUjAhEaXNjcmV0ZZSTlCmBlH2UKIwBbpSMFW51bXB5LmNvcmUubXVsdGlhcnJheZSMBnNjYWxhcpSTlIwFbnVtcHmUjAVkdHlwZZSTlIwCaTiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYkMIBAAAAAAAAACUhpRSlIwFc3RhcnSUaAhoDkMIAAAAAAAAAACUhpRSlIwGX3NoYXBllCloCmgOjApfbnBfcmFuZG9tlE51Yi4=",
+        "n": "4",
+        "start": "0",
+        "_shape": [],
+        "dtype": "int64",
+        "_np_random": null
+    },
+    "n_envs": 16,
+    "n_steps": 1024,
+    "gamma": 0.999,
+    "gae_lambda": 0.98,
+    "ent_coef": 0.01,
+    "vf_coef": 0.5,
+    "max_grad_norm": 0.5,
+    "batch_size": 64,
+    "n_epochs": 4,
+    "clip_range": {
+        ":type:": "<class 'function'>",
+        ":serialized:": "gAWVxQIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSS91c3IvbG9jYWwvbGliL3B5dGhvbjMuMTAvZGlzdC1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjARmdW5jlEuEQwIEAZSMA3ZhbJSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjEkvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgAjBBfbWFrZV9lbXB0eV9jZWxslJOUKVKUhZR0lFKUjBxjbG91ZHBpY2tsZS5jbG91ZHBpY2tsZV9mYXN0lIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaB99lH2UKGgWaA2MDF9fcXVhbG5hbWVfX5SMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZSMDl9fa3dkZWZhdWx0c19flE6MDF9fZGVmYXVsdHNfX5ROjApfX21vZHVsZV9flGgXjAdfX2RvY19flE6MC19fY2xvc3VyZV9flGgAjApfbWFrZV9jZWxslJOURz/JmZmZmZmahZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjAu"
+    },
+    "clip_range_vf": null,
+    "normalize_advantage": true,
+    "target_kl": null,
+    "lr_schedule": {
+        ":type:": "<class 'function'>",
+        ":serialized:": "gAWVxQIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSS91c3IvbG9jYWwvbGliL3B5dGhvbjMuMTAvZGlzdC1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjARmdW5jlEuEQwIEAZSMA3ZhbJSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjEkvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgAjBBfbWFrZV9lbXB0eV9jZWxslJOUKVKUhZR0lFKUjBxjbG91ZHBpY2tsZS5jbG91ZHBpY2tsZV9mYXN0lIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaB99lH2UKGgWaA2MDF9fcXVhbG5hbWVfX5SMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZSMDl9fa3dkZWZhdWx0c19flE6MDF9fZGVmYXVsdHNfX5ROjApfX21vZHVsZV9flGgXjAdfX2RvY19flE6MC19fY2xvc3VyZV9flGgAjApfbWFrZV9jZWxslJOURz8zqSowVTJhhZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjAu"
+    }
+}

ppo-LunarLander-v2/policy.optimizer.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ee40086500ee20c44b7de93774ad9d750b8abf3289b9405ded62c2849785ac5
+size 88362

ppo-LunarLander-v2/policy.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76b0506192d9b9cb38e296aefe67063a0f7618eeac4b734df0e65e2d5b618128
+size 43762

ppo-LunarLander-v2/pytorch_variables.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c35cea3b2e60fb5e7e162d3592df775cd400e575a31c72f359fb9e654ab00c5
+size 864

ppo-LunarLander-v2/system_info.txt

@@ -0,0 +1,9 @@
+- OS: Linux-5.15.120+-x86_64-with-glibc2.35 # 1 SMP Wed Aug 30 11:19:59 UTC 2023
+- Python: 3.10.12
+- Stable-Baselines3: 2.0.0a5
+- PyTorch: 2.1.0+cu118
+- GPU Enabled: True
+- Numpy: 1.23.5
+- Cloudpickle: 2.2.1
+- Gymnasium: 0.28.1
+- OpenAI Gym: 0.25.2

results.json

@@ -1 +1 @@
-{"mean_reward": -193.250698, "std_reward": 78.06877240825042, "is_deterministic": true, "n_eval_episodes": 10, "eval_datetime": "2023-10-24T13:07:55.005679"}
+{"mean_reward": 268.41768854272084, "std_reward": 18.311000394432835, "is_deterministic": true, "n_eval_episodes": 10, "eval_datetime": "2023-10-25T22:10:24.343261"}