run PPO with more vectorized environments to solve LunarLander

README.md

@@ -0,0 +1,37 @@
+---
+library_name: stable-baselines3
+tags:
+- LunarLander-v2
+- deep-reinforcement-learning
+- reinforcement-learning
+- stable-baselines3
+model-index:
+- name: PPO
+  results:
+  - task:
+      type: reinforcement-learning
+      name: reinforcement-learning
+    dataset:
+      name: LunarLander-v2
+      type: LunarLander-v2
+    metrics:
+    - type: mean_reward
+      value: 277.10 +/- 19.28
+      name: mean_reward
+      verified: false
+---
+
+# **PPO** Agent playing **LunarLander-v2**
+This is a trained model of a **PPO** agent playing **LunarLander-v2**
+using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3).
+
+## Usage (with Stable-baselines3)
+TODO: Add your code
+
+
+```python
+from stable_baselines3 import ...
+from huggingface_sb3 import load_from_hub
+
+...
+```

config.json

@@ -0,0 +1 @@
+{"policy_class": {":type:": "<class 'abc.ABCMeta'>", ":serialized:": "gAWVOwAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMEUFjdG9yQ3JpdGljUG9saWN5lJOULg==", "__module__": "stable_baselines3.common.policies", "__doc__": "\n    Policy class for actor-critic algorithms (has both policy and value prediction).\n    Used by A2C, PPO and the likes.\n\n    :param observation_space: Observation space\n    :param action_space: Action space\n    :param lr_schedule: Learning rate schedule (could be constant)\n    :param net_arch: The specification of the policy and value networks.\n    :param activation_fn: Activation function\n    :param ortho_init: Whether to use or not orthogonal initialization\n    :param use_sde: Whether to use State Dependent Exploration or not\n    :param log_std_init: Initial value for the log standard deviation\n    :param full_std: Whether to use (n_features x n_actions) parameters\n        for the std instead of only (n_features,) when using gSDE\n    :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n        a positive standard deviation (cf paper). It allows to keep variance\n        above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n    :param squash_output: Whether to squash the output using a tanh function,\n        this allows to ensure boundaries when using gSDE.\n    :param features_extractor_class: Features extractor to use.\n    :param features_extractor_kwargs: Keyword arguments\n        to pass to the features extractor.\n    :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n    :param normalize_images: Whether to normalize images or not,\n         dividing by 255.0 (True by default)\n    :param optimizer_class: The optimizer to use,\n        ``th.optim.Adam`` by default\n    :param optimizer_kwargs: Additional keyword arguments,\n        excluding the learning rate, to pass to the optimizer\n    ", "__init__": "<function ActorCriticPolicy.__init__ at 0x7f86fe07cca0>", "_get_constructor_parameters": "<function ActorCriticPolicy._get_constructor_parameters at 0x7f86fe07cd30>", "reset_noise": "<function ActorCriticPolicy.reset_noise at 0x7f86fe07cdc0>", "_build_mlp_extractor": "<function ActorCriticPolicy._build_mlp_extractor at 0x7f86fe07ce50>", "_build": "<function ActorCriticPolicy._build at 0x7f86fe07cee0>", "forward": "<function ActorCriticPolicy.forward at 0x7f86fe07cf70>", "extract_features": "<function ActorCriticPolicy.extract_features at 0x7f86fe080040>", "_get_action_dist_from_latent": "<function ActorCriticPolicy._get_action_dist_from_latent at 0x7f86fe0800d0>", "_predict": "<function ActorCriticPolicy._predict at 0x7f86fe080160>", "evaluate_actions": "<function ActorCriticPolicy.evaluate_actions at 0x7f86fe0801f0>", "get_distribution": "<function ActorCriticPolicy.get_distribution at 0x7f86fe080280>", "predict_values": "<function ActorCriticPolicy.predict_values at 0x7f86fe080310>", "__abstractmethods__": "frozenset()", "_abc_impl": "<_abc._abc_data object at 0x7f86a4262700>"}, "verbose": 1, "policy_kwargs": {}, "num_timesteps": 5111808, "_total_timesteps": 5000000, "_num_timesteps_at_start": 0, "seed": null, "action_noise": null, "start_time": 1681948114452577449, "learning_rate": 0.0003, "tensorboard_log": null, "lr_schedule": {":type:": "<class 'function'>", ":serialized:": "gAWVwwIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZSMBGZ1bmOUS4JDAgABlIwDdmFslIWUKXSUUpR9lCiMC19fcGFja2FnZV9flIwYc3RhYmxlX2Jhc2VsaW5lczMuY29tbW9ulIwIX19uYW1lX1+UjB5zdGFibGVfYmFzZWxpbmVzMy5jb21tb24udXRpbHOUjAhfX2ZpbGVfX5SMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZR1Tk5oAIwQX21ha2VfZW1wdHlfY2VsbJSTlClSlIWUdJRSlIwcY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgffZR9lChoFmgNjAxfX3F1YWxuYW1lX1+UjBljb25zdGFudF9mbi48bG9jYWxzPi5mdW5jlIwPX19hbm5vdGF0aW9uc19flH2UjA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoF4wHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlEc/M6kqMFUyYYWUUpSFlIwXX2Nsb3VkcGlja2xlX3N1Ym1vZHVsZXOUXZSMC19fZ2xvYmFsc19flH2UdYaUhlIwLg=="}, "_last_obs": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWVdRAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYAEAAAAAAAAE0mQ742xpg/kn3avlcbL7+1bIu+QD5AvQAAAAAAAAAATaukvfbwMLoTFxW4oduGs1IAFrtTNy43AAAAAAAAAACzHFu9FHyLuuwtsznxSji2ARksua6Pz7gAAIA/AACAP4C82L2ru2Q/T7+1vWfMOr+w1jC+WkmkuwAAAAAAAAAAmsUbvb4XCz/AOPI8YWwRvzqH271Yv/67AAAAAAAAAAAtB2e+WaAJP33hPT6JdAe/1OU+vq1qKD4AAAAAAAAAAIAJpr2kLwI+4b6KPmBbwr5bvkk86R0bPgAAAAAAAAAAM6GmvKPRrT9sMai+T9nqvioYyDu7tda8AAAAAAAAAACaGTQ5ODjfu4OQGL6OCF89naeVPE463DwAAIA/AACAPxNbNL4Cg9s+9a7mPeP7Gr9Lphq+WpWiPQAAAAAAAAAAGjhdvc4vXj+WFri9kRxGv3Pz2r3qiU+7AAAAAAAAAACtuj6+hWaIPGeJRT/cifC+wTWKviIsiz8AAIA/AAAAADPbeL25Gfg+KNT1u1k5Br8Gp4K9ytXaPQAAAAAAAAAAZjAzvbyYOT3e9iS+hw1PvtrjGr6Muro8AAAAAAAAAAATWiQ+Ppn4PviK0713ihi/RtITPUjM9r0AAAAAAAAAAPNT4T39t8c+mgVHvjwiAb/MxGg9huzHvQAAAAAAAAAAM+OvuhREiroYyySzevvyLkkujLrar8UzAACAPwAAgD/NrOG6jru2P8Fbsr0eL7c+3coBO6P2nzwAAAAAAAAAABqcT706IqQ/tlDsvnDtML8ZWry8/o5fvgAAAAAAAAAAbUQtPkwQJT6Sg6G+uvylvlJyTj2XZC6+AAAAAAAAAAAgxci+R9RDP7ORqL0auRW/NKHAvo89Dj4AAAAAAAAAAJpF3Lwf9c65+jhEswZEAjBW/KO7QbnLMwAAgD8AAIA/psniPfz+BT0aT8G8bixuvt+kuD3X7hC9AAAAAAAAAAA2One+Pr2XPx4YD7/A0w+/QcOuvlbVJL4AAAAAAAAAAOb/dT28pAw9bRrjvQxxkL60r5A85lRBPQAAAAAAAAAAABx+PCnILbr9GF04NpifMzIrzTpz+YG3AACAPwAAgD8z0/k7qDjUPXq8ZryK9Ky+oi6cPP6gKTsAAAAAAAAAAFPWI76112w/wLJ5vn9XG784hLq+gNxuvQAAAAAAAAAAAAbTPK6Bj7rQZxs2kf5LMOj9T7pa+0G1AACAPwAAgD9mU5g89raYP3FmCz3yiA+/Pc4qPayjrj0AAAAAAAAAAGaRqjyPmh66He9Nu3GZ9DfnYQU7D/cCOgAAgD8AAIA/ZiEIPjchsD5m/oi+F4nDvjI5rDxhihe+AAAAAAAAAACTkDA+bKWIP9M12z4X7Au/l7uYPl0anD4AAAAAAAAAAGYwSbwpzCm6NwcxNNV4GzBCHbk7dbybswAAgD8AAIA/QHiOPY/2arra8SU4SVHLMsl+Kzk5gEG3AACAPwAAgD8AXnq8BULFu6O24T1uQBI9k5UPvXqG8T0AAIA/AACAP4DsPz5EtbY+nWOLvoZCtb4kA7E9ndAVvgAAAAAAAAAAjaCVvSkACLwmeQS/ERm3uwaoJz1cvLc8AACAPwAAgD+aF8E8aj9eP/B3Tj3U+UG/3NlnPDsu47sAAAAAAAAAAGYKm7ufWpK7hkoAu9ICwDwnHdU8kMehvQAAgD8AAIA/4HQTvqfwYz9ict+9svtHvxlmV74kRT69AAAAAAAAAADzNJu9j7oTulxZq7pr7jY1zZQpuzSexzkAAIA/AACAP2Z6njwK+na7AheKPaJTujwyKp28uP+dPQAAgD8AAIA/ZrYwvnO+Dj9pjw0+a10Gv0/MTr4qiL89AAAAAAAAAAAzESk8wVCOPds7qb3VwS6+viswvUUmvz0AAAAAAAAAAM24Rz1xdym77dbqvWBpkTxrDBM8FtN6vQAAgD8AAIA/Mz8tvJz/I7xpGJ89s4UjPcPBi70eqwM+AACAPwAAgD+ArrY91LGlP/SujT79zhS/+Tw4PkPZbz0AAAAAAAAAAOosm75uQVg/hE2Wvql/I7/KkgG/s1d5PQAAAAAAAAAAs/Urvsufsj5jl5c+Woe5vnbYg72wBxQ+AAAAAAAAAAAACF8+P/0rP5PWRL42bwm/MTthPg24uL4AAAAAAAAAAHPStT1x+XO7zklZvvaqpL6zYRs8Ho+0PAAAAAAAAIA/DawEPlYaiD8OyUU+YLgbv85XSj5LEpg9AAAAAAAAAABmAt47nyzqu4iyF725tSQ8wD8yPcnADr0AAIA/AACAP3qhG744M9w8+CbvPiZ+jb4h6tY9gPUMPgAAAAAAAAAATUhTPYr1mz/WyJs+ieMavxHjzT2jmIo+AAAAAAAAAABNJKg9zXgSP45npL1m0h6/C1wlPYrvTb0AAAAAAAAAAHr3l74M8/8+/PGYvY9gIL9wifO++LPkPQAAAAAAAAAAbVAKPtJlMz+jK4U9yKoAvw/+hz7SywS9AAAAAAAAAAAapyk+oG2yP5iW1D5y2vu+GjejPrs7Lz4AAAAAAAAAAPP/nD09K1+7LO8SvnsFTr6I5UQ7fnHsvgAAgD8AAIA/08JPvmx1zD7Gsxc+YvQFv3mgML52TEI+AAAAAAAAAAAAcD68uKIePxMn4jurux2/MNGKvSvf97oAAAAAAAAAADOzNzzD2Wq6o+QvPQqdxrJtMsy6ex30swAAgD8AAIA/ZmvIPILEuD9GFDU+XyfUvG/EuTxqvw0+AAAAAAAAAAAahzI9a4blPSGPEb4X73y+5P6ZPBJSC74AAAAAAAAAAODMZT7QR8M+1j2zvqzPur7B5tA8pW3SvQAAAAAAAAAAmotKvIWL2rntswc1BGYzMAef2jtauW+0AACAPwAAgD/msjs9DteSPUXgrr12LKi+ZcXOvID9Ub0AAAAAAAAAABrPNr2ux+k3pTrtOY4AWDWr4427UzAQuQAAgD8AAIA/TX9OPfbsLrqKmRS0XnuQsFnLVjs4iKYzAACAPwAAgD8tdT0+eDXwPjjAVb7JHeO+ikraPYTjHr4AAAAAAAAAADMLDT0unYo/tp49Paa7W7+WGCQ9Q5BkvQAAAAAAAAAAAIAKOTf8nz+ORqe85HEXv8m35Lz+YRk9AAAAAAAAAABzLoO99vgwP4p4E7wk0DG/pK0Wvhq/Lz0AAAAAAAAAAM3GcD3sSdo6gqanvQ5ogL4oQAw9ppGMPAAAAAAAAAAAmlmwO3v6n7ou3eG73CC9PMZ3Vjt1g6K9AACAPwAAgD8AkFU8V4Z6PIhdBb4qSI2+7oyzvRC/NT0AAAAAAAAAAIa/Z76kZIk+/pbEPvVUyL5+GAW9Vo5gPgAAAAAAAAAATcfYPROkoz8/IQY/y0cBv6w1Az5mdps+AAAAAAAAAACNvVk+SgGRPpKqnb4z/Zy+3dfpPZhObL4AAAAAAAAAANp9jj2X0Vg+Fj4lvgqluL6AWg+9YBPQvAAAAAAAAAAAmt2SuzhAlbtuET08QDkpPGYkvjxiwhS9AACAPwAAgD+aNAC+Hj6JP9c1lb45ORm/Gi2EvqfCHb4AAAAAAAAAAHO0rT3hFoO6MwbgtHEA0C9Y6nS7M88oNAAAgD8AAIA/zXbTPMMZT7oBCj+0T3E4sN9zS7vlY5szAACAPwAAgD+a2hQ9uMaXuRnRAzqubha5CXZPu6ePDLkAAIA/AACAP00Eiz04JNi7td3JvQd6HT3sRy09aooBvgAAgD8AAIA/My2jPARGQz7v9oc8sam4viADUDxyYDM8AAAAAAAAAAAadGg9uN3du40V5z3BKJI8WlY7vfL4dT0AAIA/AACAPxqTAz3SoYu79oAIvJpTgTwzqvc8O4pdvQAAgD8AAIA/QKqNPctJDD/gZWA8y7DovrGWLD2zdNC8AAAAAAAAAAAzBsA8T94mvHv4h72rWy69z8i6PKAwQT4AAIA/AACAPxrJBz2ZQoY/LhyyPdXMQL8DsAg8yJVkPQAAAAAAAAAA5g63vfSlrT/CkBi/dYawvp+FFL3zpFi+AAAAAAAAAAAgVA2+wowoPuAdYz7Lh62+2J4fvVk3Ij4AAAAAAAAAAE2oqz0Cmxw+QkWpvvKumb5oz2u9n9AkvQAAAAAAAAAAZjJ5PI8yd7r1VyC4qV0hs27YGztVwTs3AACAPwAAgD8NRDo+95Y2P7rTZbxfGBa/eGRPPltq8b0AAAAAAAAAAJqpuTp9M3w+X5I4O6ONt77GSVi88UgIvQAAAAAAAAAAmi+0PH/Drj9YXbI+DQfPvgkWHLtyKok9AAAAAAAAAADNoi4995HKPspG4rnuUN6+zSy6PVObiz0AAAAAAAAAALPbjD1XDk0+EKfAvnObmL41CCu+lxIHvAAAAAAAAAAAwA79PXQxYD5afgO+BCq0vnSaq7zP1Tu9AAAAAAAAAABm8Ha8FLClujN8PDj6bS8zvZrNupqaWLcAAIA/AACAP2ZGWDpI6ZS6YERgPdT1DzwQOjc7G0MDvQAAgD8AAIA/+g9JvrTGkbyTPXK6HAieuKwYBD41QJc5AACAPwAAgD9AOFc+eAKRPypVwj71/Pq+kyC/Ptb5uT0AAAAAAAAAACZZjT1xars/4KooP16P8T3Ukqu6Q4X9PQAAAAAAAAAAGiDOPawtYz86gRs+TyMbv2BYKj7agyA9AAAAAAAAAACNKYe9w2V1umv6XTTFtoMvx9FyO94ckrMAAIA/AACAPxovzb0K/3888f2BPvPpsb4uhyQ9w72/vQAAAAAAAAAAGqVUvfWGgj9iJgS+c0FKv+d0D76bEhi9AAAAAAAAAAAA6xq9cRsVPp7YRj5x1ma+YlKHPbv4Jz4AAAAAAAAAADOym7wrGs8+/kFCPYrg1r52VHK9lcKNPQAAAAAAAAAAM8MvPh/G1D6XlQe+By73vq3D+j0S29a9AAAAAAAAAABmrk+8UurYPKtJED42soS+HEL3PYilfzwAAAAAAAAAAGA1Qr7h4cs+xRaBPkadD7+4Kc+9gpmuPQAAAAAAAAAATVANPQPUuT/yFSs+8owUvj6HRD3sGsk9AAAAAAAAAAAzErc8coodPxbhaTyL9xi/MylTvNZdSj0AAAAAAAAAADPSiLzNDKY/RdqovYC0Bb/bVmi9eCDcPAAAAAAAAAAAFrqTvh6Igj9/xKC+XXcmv8Re1b4yF2i9AAAAAAAAAACzxwg9cGitP0JEkT5QXLi+OqhkPev5Iz4AAAAAAAAAAJrRLDsfs4o8bn07PmzhPr67HAU+fYdVPQAAAAAAAAAAxhENPv/LtD9AKfw+rm2jvixFfD6xYsc+AAAAAAAAAACtZh4+DiCiP52iBz9+vQq/da+7PmOY4T4AAAAAAAAAAGabVr0UQKO6oV6HOA25fTP6NLI5/ZqbtwAAgD8AAIA/WoWyvQXhv7t+Jj896vawu6MXw7wTn56+AAAAAAAAgD+UjAVudW1weZSMBWR0eXBllJOUjAJmNJSJiIeUUpQoSwOMATyUTk5OSv////9K/////0sAdJRiS4BLCIaUjAFDlHSUUpQu"}, "_last_episode_starts": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWV8wAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJaAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYkuAhZSMAUOUdJRSlC4="}, "_last_original_obs": null, "_episode_num": 0, "use_sde": false, "sde_sample_freq": -1, "_current_progress_remaining": -0.02236159999999998, "_stats_window_size": 100, "ep_info_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWVIRAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpSMFW51bXB5LmNvcmUubXVsdGlhcnJheZSMBnNjYWxhcpSTlIwFbnVtcHmUjAVkdHlwZZSTlIwCZjiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYkMIHHqLh3fpa0CUhpRSlIwBbJRNrgGMAXSUR0Cw9JCOBDohdX2UKGgGaAloD0MI0JhJ1AsJc0CUhpRSlGgVS79oFkdAsPTOEcsDn3V9lChoBmgJaA9DCERPyqSGZnJAlIaUUpRoFUvMaBZHQLD0zCwr1/V1fZQoaAZoCWgPQwjedTbkn61zQJSGlFKUaBVLu2gWR0Cw9OcvRJEqdX2UKGgGaAloD0MIiITv/Y0VckCUhpRSlGgVS91oFkdAsPTe5rgwXnV9lChoBmgJaA9DCIHoSZmUF3JAlIaUUpRoFUuraBZHQLD07QAMlTp1fZQoaAZoCWgPQwhm+iXibc9wQJSGlFKUaBVLz2gWR0Cw9Qb4agmJdX2UKGgGaAloD0MIoYSZtr9bcECUhpRSlGgVS8FoFkdAsPUBV5rxiHV9lChoBmgJaA9DCPP/qiOHiXBAlIaUUpRoFUu3aBZHQLD1LpJwsGx1fZQoaAZoCWgPQwgr9pfdE8txQJSGlFKUaBVLy2gWR0Cw9R9qQA+7dX2UKGgGaAloD0MIEr9iDRfocECUhpRSlGgVS7RoFkdAsPVKhK15SnV9lChoBmgJaA9DCPdZZaa0LFJAlIaUUpRoFUuuaBZHQLD1RTdtVJd1fZQoaAZoCWgPQwha9bnaimxyQJSGlFKUaBVL32gWR0Cw9WYYixFBdX2UKGgGaAloD0MI6ukj8IctcUCUhpRSlGgVS8ZoFkdAsPVqRmseXHV9lChoBmgJaA9DCJSl1vsN2XBAlIaUUpRoFUvSaBZHQLD1jslsxfx1fZQoaAZoCWgPQwjjNEQV/u1zQJSGlFKUaBVN5AFoFkdAsPWIGlhw2nV9lChoBmgJaA9DCPT7/s3LZnJAlIaUUpRoFUvVaBZHQLD1h53Tuv51fZQoaAZoCWgPQwjVzFoKSJxwQJSGlFKUaBVLzWgWR0Cw9aHm7rcCdX2UKGgGaAloD0MI5rLROT9dckCUhpRSlGgVS8toFkdAsPWidMCcPXV9lChoBmgJaA9DCIjX9Qt28XBAlIaUUpRoFUuraBZHQLD1odEsrd51fZQoaAZoCWgPQwj7lc6HJ4lwQJSGlFKUaBVLuGgWR0Cw9bD9GZuydX2UKGgGaAloD0MIK/pDM49TcUCUhpRSlGgVS9doFkdAsPXIyRB/qnV9lChoBmgJaA9DCIULeQQ3t3FAlIaUUpRoFUvJaBZHQLD149ytFKF1fZQoaAZoCWgPQwjq6/ma5RJxQJSGlFKUaBVLxWgWR0Cw9f6aw2VFdX2UKGgGaAloD0MIbxEY61tnc0CUhpRSlGgVS95oFkdAsPYHPnjhk3V9lChoBmgJaA9DCPcDHhhA/W5AlIaUUpRoFUvGaBZHQLD2CY2sJY11fZQoaAZoCWgPQwgkYkok0T5yQJSGlFKUaBVL4WgWR0Cw9gmBas6rdX2UKGgGaAloD0MISFD8GPPNcUCUhpRSlGgVS9loFkdAsPYFORDCxnV9lChoBmgJaA9DCMpt+x717nFAlIaUUpRoFUvSaBZHQLD2DQZ4wAV1fZQoaAZoCWgPQwiRmnYxTSVvQJSGlFKUaBVLy2gWR0Cw9iBKDkELdX2UKGgGaAloD0MIQlvOpbj6T0CUhpRSlGgVS6VoFkdAsPYUSVW0Z3V9lChoBmgJaA9DCAA7N23GTHNAlIaUUpRoFUvdaBZHQLD2JpaA4GV1fZQoaAZoCWgPQwjSVbq7zh9yQJSGlFKUaBVLyWgWR0Cw9mEu14PgdX2UKGgGaAloD0MI5j45CpDEcECUhpRSlGgVS8xoFkdAsPZpl2/zrnV9lChoBmgJaA9DCCKl2TxO33NAlIaUUpRoFUvYaBZHQLD2ZLXcxj91fZQoaAZoCWgPQwjG98WlqrdtQJSGlFKUaBVLw2gWR0Cw9nUxdpqRdX2UKGgGaAloD0MIIhlybH3pcECUhpRSlGgVS7doFkdAsPZxf5ULlXV9lChoBmgJaA9DCKneGtgqfnFAlIaUUpRoFUvGaBZHQLD2b2cJ+lV1fZQoaAZoCWgPQwh8ZHPVvCNxQJSGlFKUaBVLw2gWR0Cw9oOUD+zddX2UKGgGaAloD0MIgeuKGWGXb0CUhpRSlGgVS7ZoFkdAsPac7/4qPXV9lChoBmgJaA9DCOFBs+teV2FAlIaUUpRoFU3oA2gWR0Cw9rEcwQDndX2UKGgGaAloD0MIPGh23Zs8c0CUhpRSlGgVS91oFkdAsPapYkmhNHV9lChoBmgJaA9DCGkewCK/ZHBAlIaUUpRoFUvIaBZHQLD2vLhaTwF1fZQoaAZoCWgPQwhyv0NRYFlxQJSGlFKUaBVL2GgWR0Cw9tyPuG9IdX2UKGgGaAloD0MIjSYXY2DBckCUhpRSlGgVS+FoFkdAsPbWiQDFInV9lChoBmgJaA9DCDBK0F/o2HFAlIaUUpRoFUvjaBZHQLD27Dh99c91fZQoaAZoCWgPQwg4FD5bxypyQJSGlFKUaBVL52gWR0Cw9ubCN0eVdX2UKGgGaAloD0MIezGUE+0nckCUhpRSlGgVS6FoFkdAsPb+YeDFqHV9lChoBmgJaA9DCJliDoJOenNAlIaUUpRoFUvqaBZHQLD2/U96kZd1fZQoaAZoCWgPQwjUD+oiBbtvQJSGlFKUaBVL8mgWR0Cw9xLxVhkRdX2UKGgGaAloD0MIPnjt0gbEcUCUhpRSlGgVS8JoFkdAsPc2iO/+KnV9lChoBmgJaA9DCHsVGR0Qf3JAlIaUUpRoFUvdaBZHQLD3SldTo+x1fZQoaAZoCWgPQwgFw7mGmbZxQJSGlFKUaBVLrGgWR0Cw90ke+23KdX2UKGgGaAloD0MIaf6Y1qYQckCUhpRSlGgVS7poFkdAsPdXDR+jM3V9lChoBmgJaA9DCBK/Yg2XX25AlIaUUpRoFUu8aBZHQLD3ZKk2xY91fZQoaAZoCWgPQwhrZcIv9VFwQJSGlFKUaBVL7WgWR0Cw93ikCV8kdX2UKGgGaAloD0MIatlaX2TacUCUhpRSlGgVS8ZoFkdAsPfUxZdOZnV9lChoBmgJaA9DCHFV2XeFjHBAlIaUUpRoFUu9aBZHQLD33ZYgaFV1fZQoaAZoCWgPQwgF+G7zhgpyQJSGlFKUaBVLvGgWR0Cw+AoNy5qedX2UKGgGaAloD0MIwLD8+baxbUCUhpRSlGgVS8toFkdAsPgaAFxGUnV9lChoBmgJaA9DCFk1CHO7XHFAlIaUUpRoFUvkaBZHQLD4NTTvy9V1fZQoaAZoCWgPQwhAwcWK2vNxQJSGlFKUaBVLw2gWR0Cw+C9XLeQ/dX2UKGgGaAloD0MInRIQk3A7c0CUhpRSlGgVS8RoFkdAsPg77Ikqt3V9lChoBmgJaA9DCGgFhqzus3NAlIaUUpRoFUvRaBZHQLD4UFCb+cZ1fZQoaAZoCWgPQwhmg0wycgVwQJSGlFKUaBVLxGgWR0Cw+G+2qkuZdX2UKGgGaAloD0MIV12Haspwc0CUhpRSlGgVS79oFkdAsPiGA/cFhXV9lChoBmgJaA9DCIjZy7aTpnBAlIaUUpRoFUvHaBZHQLD4gFM7EHd1fZQoaAZoCWgPQwgHX5hMFetvQJSGlFKUaBVLyGgWR0Cw+JGykbgkdX2UKGgGaAloD0MIgPChREvIckCUhpRSlGgVS/BoFkdAsPis7+1jRXV9lChoBmgJaA9DCMaFAyGZ+nBAlIaUUpRoFUvraBZHQLD43ACnxax1fZQoaAZoCWgPQwjoMcoz76ByQJSGlFKUaBVL4GgWR0Cw+PNLDhtMdX2UKGgGaAloD0MI22ysxHyDcUCUhpRSlGgVS9JoFkdAsPkl2V3Ux3V9lChoBmgJaA9DCNi4/l2fGXJAlIaUUpRoFUvfaBZHQLD5PZof0Vd1fZQoaAZoCWgPQwi4Pqw36nBzQJSGlFKUaBVL0GgWR0Cw+Vn6InBtdX2UKGgGaAloD0MIZoNMMnJZcUCUhpRSlGgVS79oFkdAsPlV2OhkAnV9lChoBmgJaA9DCCfBG9IogHJAlIaUUpRoFUvcaBZHQLD5bl4C6pZ1fZQoaAZoCWgPQwg1C7Q7JCpuQJSGlFKUaBVLt2gWR0Cw+Wm+49X+dX2UKGgGaAloD0MI3NYWntfycUCUhpRSlGgVS9VoFkdAsPmOWGATZnV9lChoBmgJaA9DCA9j0t8LO3NAlIaUUpRoFUvXaBZHQLD5jo5PuXx1fZQoaAZoCWgPQwj1hZDzvmhxQJSGlFKUaBVLq2gWR0Cw+YXnyNGWdX2UKGgGaAloD0MIwF/MlmwtdECUhpRSlGgVS7doFkdAsPnD1vl2eXV9lChoBmgJaA9DCKck63C063FAlIaUUpRoFUvHaBZHQLD5zd07r9l1fZQoaAZoCWgPQwg74/vi0gpyQJSGlFKUaBVLs2gWR0Cw+fyEDhcadX2UKGgGaAloD0MIliGOdfGXb0CUhpRSlGgVS8loFkdAsPoBMN+b3HV9lChoBmgJaA9DCJ8cBYjCa3JAlIaUUpRoFUuxaBZHQLD6HNFSbYt1fZQoaAZoCWgPQwiQSrGjMc1xQJSGlFKUaBVL/2gWR0Cw+ipJTVDsdX2UKGgGaAloD0MIqI3qdOCEc0CUhpRSlGgVS89oFkdAsPoqd8RcvHV9lChoBmgJaA9DCL2PozlyoHBAlIaUUpRoFUupaBZHQLD6UH58BuJ1fZQoaAZoCWgPQwieB3dn7VFyQJSGlFKUaBVNEwFoFkdAsPqBZHNHH3V9lChoBmgJaA9DCL2qs1ogr3FAlIaUUpRoFUvVaBZHQLD6lDyOJch1fZQoaAZoCWgPQwhWurvOhrdyQJSGlFKUaBVL02gWR0Cw+pNFOO81dX2UKGgGaAloD0MI7bjhd9O9cECUhpRSlGgVS6RoFkdAsPq00uUUwnV9lChoBmgJaA9DCFQ7w9QW6HJAlIaUUpRoFUvvaBZHQLD6zuwHJLd1fZQoaAZoCWgPQwirr64KVLVwQJSGlFKUaBVLxWgWR0Cw+u8c6vJSdX2UKGgGaAloD0MIOey+Y/gMc0CUhpRSlGgVS89oFkdAsPr5UR3/xXV9lChoBmgJaA9DCCOHiJtT0G1AlIaUUpRoFUvDaBZHQLD7ETGYKIB1fZQoaAZoCWgPQwgfK/htCFNxQJSGlFKUaBVL1GgWR0Cw+wg9eQdTdX2UKGgGaAloD0MIyXTo9DzXcUCUhpRSlGgVS/BoFkdAsPtJGLDQ7nV9lChoBmgJaA9DCERN9Pmo221AlIaUUpRoFUusaBZHQLD7QEDyOJd1fZQoaAZoCWgPQwjE7GXbKehyQJSGlFKUaBVLx2gWR0Cw+4Ds+mm+dWUu"}, "ep_success_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWVIAAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKULg=="}, "_n_updates": 195, "observation_space": {":type:": "<class 'gym.spaces.box.Box'>", ":serialized:": "gAWVnwEAAAAAAACMDmd5bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lGgFk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMBl9zaGFwZZRLCIWUjANsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWIAAAAAAAAAAAAID/AACA/wAAgP8AAID/AACA/wAAgP8AAID/AACA/5RoCksIhZSMAUOUdJRSlIwEaGlnaJRoEiiWIAAAAAAAAAAAAIB/AACAfwAAgH8AAIB/AACAfwAAgH8AAIB/AACAf5RoCksIhZRoFXSUUpSMDWJvdW5kZWRfYmVsb3eUaBIolggAAAAAAAAAAAAAAAAAAACUaAeMAmIxlImIh5RSlChLA4wBfJROTk5K/////0r/////SwB0lGJLCIWUaBV0lFKUjA1ib3VuZGVkX2Fib3ZllGgSKJYIAAAAAAAAAAAAAAAAAAAAlGghSwiFlGgVdJRSlIwKX25wX3JhbmRvbZROdWIu", "dtype": "float32", "_shape": [8], "low": "[-inf -inf -inf -inf -inf -inf -inf -inf]", "high": "[inf inf inf inf inf inf inf inf]", "bounded_below": "[False False False False False False False False]", "bounded_above": "[False False False False False False False False]", "_np_random": null}, "action_space": {":type:": "<class 'gym.spaces.discrete.Discrete'>", ":serialized:": "gAWVggAAAAAAAACME2d5bS5zcGFjZXMuZGlzY3JldGWUjAhEaXNjcmV0ZZSTlCmBlH2UKIwBbpRLBIwGX3NoYXBllCmMBWR0eXBllIwFbnVtcHmUaAeTlIwCaTiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYowKX25wX3JhbmRvbZROdWIu", "n": 4, "_shape": [], "dtype": "int64", "_np_random": null}, "n_envs": 128, "n_steps": 1024, "gamma": 0.998, "gae_lambda": 0.98, "ent_coef": 0.01, "vf_coef": 0.5, "max_grad_norm": 0.5, "batch_size": 128, "n_epochs": 5, "clip_range": {":type:": "<class 'function'>", ":serialized:": "gAWVwwIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZSMBGZ1bmOUS4JDAgABlIwDdmFslIWUKXSUUpR9lCiMC19fcGFja2FnZV9flIwYc3RhYmxlX2Jhc2VsaW5lczMuY29tbW9ulIwIX19uYW1lX1+UjB5zdGFibGVfYmFzZWxpbmVzMy5jb21tb24udXRpbHOUjAhfX2ZpbGVfX5SMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZR1Tk5oAIwQX21ha2VfZW1wdHlfY2VsbJSTlClSlIWUdJRSlIwcY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgffZR9lChoFmgNjAxfX3F1YWxuYW1lX1+UjBljb25zdGFudF9mbi48bG9jYWxzPi5mdW5jlIwPX19hbm5vdGF0aW9uc19flH2UjA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoF4wHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlEc/yZmZmZmZmoWUUpSFlIwXX2Nsb3VkcGlja2xlX3N1Ym1vZHVsZXOUXZSMC19fZ2xvYmFsc19flH2UdYaUhlIwLg=="}, "clip_range_vf": null, "normalize_advantage": true, "target_kl": null, "system_info": {"OS": "Linux-5.10.147+-x86_64-with-glibc2.31 # 1 SMP Sat Dec 10 16:00:40 UTC 2022", "Python": "3.9.16", "Stable-Baselines3": "1.8.0", "PyTorch": "2.0.0+cu118", "GPU Enabled": "True", "Numpy": "1.22.4", "Gym": "0.21.0"}}

ppo-LunarLander-v2.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76c29a5137cbb9eeb35d54d0306c9b0378d9601ee385d0e590948a90ede1fff5
+size 152192

ppo-LunarLander-v2/_stable_baselines3_version

@@ -0,0 +1 @@
+1.8.0

ppo-LunarLander-v2/data

@@ -0,0 +1,96 @@
+{
+    "policy_class": {
+        ":type:": "<class 'abc.ABCMeta'>",
+        ":serialized:": "gAWVOwAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMEUFjdG9yQ3JpdGljUG9saWN5lJOULg==",
+        "__module__": "stable_baselines3.common.policies",
+        "__doc__": "\n    Policy class for actor-critic algorithms (has both policy and value prediction).\n    Used by A2C, PPO and the likes.\n\n    :param observation_space: Observation space\n    :param action_space: Action space\n    :param lr_schedule: Learning rate schedule (could be constant)\n    :param net_arch: The specification of the policy and value networks.\n    :param activation_fn: Activation function\n    :param ortho_init: Whether to use or not orthogonal initialization\n    :param use_sde: Whether to use State Dependent Exploration or not\n    :param log_std_init: Initial value for the log standard deviation\n    :param full_std: Whether to use (n_features x n_actions) parameters\n        for the std instead of only (n_features,) when using gSDE\n    :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n        a positive standard deviation (cf paper). It allows to keep variance\n        above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n    :param squash_output: Whether to squash the output using a tanh function,\n        this allows to ensure boundaries when using gSDE.\n    :param features_extractor_class: Features extractor to use.\n    :param features_extractor_kwargs: Keyword arguments\n        to pass to the features extractor.\n    :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n    :param normalize_images: Whether to normalize images or not,\n         dividing by 255.0 (True by default)\n    :param optimizer_class: The optimizer to use,\n        ``th.optim.Adam`` by default\n    :param optimizer_kwargs: Additional keyword arguments,\n        excluding the learning rate, to pass to the optimizer\n    ",
+        "__init__": "<function ActorCriticPolicy.__init__ at 0x7f86fe07cca0>",
+        "_get_constructor_parameters": "<function ActorCriticPolicy._get_constructor_parameters at 0x7f86fe07cd30>",
+        "reset_noise": "<function ActorCriticPolicy.reset_noise at 0x7f86fe07cdc0>",
+        "_build_mlp_extractor": "<function ActorCriticPolicy._build_mlp_extractor at 0x7f86fe07ce50>",
+        "_build": "<function ActorCriticPolicy._build at 0x7f86fe07cee0>",
+        "forward": "<function ActorCriticPolicy.forward at 0x7f86fe07cf70>",
+        "extract_features": "<function ActorCriticPolicy.extract_features at 0x7f86fe080040>",
+        "_get_action_dist_from_latent": "<function ActorCriticPolicy._get_action_dist_from_latent at 0x7f86fe0800d0>",
+        "_predict": "<function ActorCriticPolicy._predict at 0x7f86fe080160>",
+        "evaluate_actions": "<function ActorCriticPolicy.evaluate_actions at 0x7f86fe0801f0>",
+        "get_distribution": "<function ActorCriticPolicy.get_distribution at 0x7f86fe080280>",
+        "predict_values": "<function ActorCriticPolicy.predict_values at 0x7f86fe080310>",
+        "__abstractmethods__": "frozenset()",
+        "_abc_impl": "<_abc._abc_data object at 0x7f86a4262700>"
+    },
+    "verbose": 1,
+    "policy_kwargs": {},
+    "num_timesteps": 5111808,
+    "_total_timesteps": 5000000,
+    "_num_timesteps_at_start": 0,
+    "seed": null,
+    "action_noise": null,
+    "start_time": 1681948114452577449,
+    "learning_rate": 0.0003,
+    "tensorboard_log": null,
+    "lr_schedule": {
+        ":type:": "<class 'function'>",
+        ":serialized:": "gAWVwwIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZSMBGZ1bmOUS4JDAgABlIwDdmFslIWUKXSUUpR9lCiMC19fcGFja2FnZV9flIwYc3RhYmxlX2Jhc2VsaW5lczMuY29tbW9ulIwIX19uYW1lX1+UjB5zdGFibGVfYmFzZWxpbmVzMy5jb21tb24udXRpbHOUjAhfX2ZpbGVfX5SMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZR1Tk5oAIwQX21ha2VfZW1wdHlfY2VsbJSTlClSlIWUdJRSlIwcY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgffZR9lChoFmgNjAxfX3F1YWxuYW1lX1+UjBljb25zdGFudF9mbi48bG9jYWxzPi5mdW5jlIwPX19hbm5vdGF0aW9uc19flH2UjA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoF4wHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlEc/M6kqMFUyYYWUUpSFlIwXX2Nsb3VkcGlja2xlX3N1Ym1vZHVsZXOUXZSMC19fZ2xvYmFsc19flH2UdYaUhlIwLg=="
+    },
+    "_last_obs": {
+        ":type:": "<class 'numpy.ndarray'>",
+        ":serialized:": "gAWVdRAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYAEAAAAAAAAE0mQ742xpg/kn3avlcbL7+1bIu+QD5AvQAAAAAAAAAATaukvfbwMLoTFxW4oduGs1IAFrtTNy43AAAAAAAAAACzHFu9FHyLuuwtsznxSji2ARksua6Pz7gAAIA/AACAP4C82L2ru2Q/T7+1vWfMOr+w1jC+WkmkuwAAAAAAAAAAmsUbvb4XCz/AOPI8YWwRvzqH271Yv/67AAAAAAAAAAAtB2e+WaAJP33hPT6JdAe/1OU+vq1qKD4AAAAAAAAAAIAJpr2kLwI+4b6KPmBbwr5bvkk86R0bPgAAAAAAAAAAM6GmvKPRrT9sMai+T9nqvioYyDu7tda8AAAAAAAAAACaGTQ5ODjfu4OQGL6OCF89naeVPE463DwAAIA/AACAPxNbNL4Cg9s+9a7mPeP7Gr9Lphq+WpWiPQAAAAAAAAAAGjhdvc4vXj+WFri9kRxGv3Pz2r3qiU+7AAAAAAAAAACtuj6+hWaIPGeJRT/cifC+wTWKviIsiz8AAIA/AAAAADPbeL25Gfg+KNT1u1k5Br8Gp4K9ytXaPQAAAAAAAAAAZjAzvbyYOT3e9iS+hw1PvtrjGr6Muro8AAAAAAAAAAATWiQ+Ppn4PviK0713ihi/RtITPUjM9r0AAAAAAAAAAPNT4T39t8c+mgVHvjwiAb/MxGg9huzHvQAAAAAAAAAAM+OvuhREiroYyySzevvyLkkujLrar8UzAACAPwAAgD/NrOG6jru2P8Fbsr0eL7c+3coBO6P2nzwAAAAAAAAAABqcT706IqQ/tlDsvnDtML8ZWry8/o5fvgAAAAAAAAAAbUQtPkwQJT6Sg6G+uvylvlJyTj2XZC6+AAAAAAAAAAAgxci+R9RDP7ORqL0auRW/NKHAvo89Dj4AAAAAAAAAAJpF3Lwf9c65+jhEswZEAjBW/KO7QbnLMwAAgD8AAIA/psniPfz+BT0aT8G8bixuvt+kuD3X7hC9AAAAAAAAAAA2One+Pr2XPx4YD7/A0w+/QcOuvlbVJL4AAAAAAAAAAOb/dT28pAw9bRrjvQxxkL60r5A85lRBPQAAAAAAAAAAABx+PCnILbr9GF04NpifMzIrzTpz+YG3AACAPwAAgD8z0/k7qDjUPXq8ZryK9Ky+oi6cPP6gKTsAAAAAAAAAAFPWI76112w/wLJ5vn9XG784hLq+gNxuvQAAAAAAAAAAAAbTPK6Bj7rQZxs2kf5LMOj9T7pa+0G1AACAPwAAgD9mU5g89raYP3FmCz3yiA+/Pc4qPayjrj0AAAAAAAAAAGaRqjyPmh66He9Nu3GZ9DfnYQU7D/cCOgAAgD8AAIA/ZiEIPjchsD5m/oi+F4nDvjI5rDxhihe+AAAAAAAAAACTkDA+bKWIP9M12z4X7Au/l7uYPl0anD4AAAAAAAAAAGYwSbwpzCm6NwcxNNV4GzBCHbk7dbybswAAgD8AAIA/QHiOPY/2arra8SU4SVHLMsl+Kzk5gEG3AACAPwAAgD8AXnq8BULFu6O24T1uQBI9k5UPvXqG8T0AAIA/AACAP4DsPz5EtbY+nWOLvoZCtb4kA7E9ndAVvgAAAAAAAAAAjaCVvSkACLwmeQS/ERm3uwaoJz1cvLc8AACAPwAAgD+aF8E8aj9eP/B3Tj3U+UG/3NlnPDsu47sAAAAAAAAAAGYKm7ufWpK7hkoAu9ICwDwnHdU8kMehvQAAgD8AAIA/4HQTvqfwYz9ict+9svtHvxlmV74kRT69AAAAAAAAAADzNJu9j7oTulxZq7pr7jY1zZQpuzSexzkAAIA/AACAP2Z6njwK+na7AheKPaJTujwyKp28uP+dPQAAgD8AAIA/ZrYwvnO+Dj9pjw0+a10Gv0/MTr4qiL89AAAAAAAAAAAzESk8wVCOPds7qb3VwS6+viswvUUmvz0AAAAAAAAAAM24Rz1xdym77dbqvWBpkTxrDBM8FtN6vQAAgD8AAIA/Mz8tvJz/I7xpGJ89s4UjPcPBi70eqwM+AACAPwAAgD+ArrY91LGlP/SujT79zhS/+Tw4PkPZbz0AAAAAAAAAAOosm75uQVg/hE2Wvql/I7/KkgG/s1d5PQAAAAAAAAAAs/Urvsufsj5jl5c+Woe5vnbYg72wBxQ+AAAAAAAAAAAACF8+P/0rP5PWRL42bwm/MTthPg24uL4AAAAAAAAAAHPStT1x+XO7zklZvvaqpL6zYRs8Ho+0PAAAAAAAAIA/DawEPlYaiD8OyUU+YLgbv85XSj5LEpg9AAAAAAAAAABmAt47nyzqu4iyF725tSQ8wD8yPcnADr0AAIA/AACAP3qhG744M9w8+CbvPiZ+jb4h6tY9gPUMPgAAAAAAAAAATUhTPYr1mz/WyJs+ieMavxHjzT2jmIo+AAAAAAAAAABNJKg9zXgSP45npL1m0h6/C1wlPYrvTb0AAAAAAAAAAHr3l74M8/8+/PGYvY9gIL9wifO++LPkPQAAAAAAAAAAbVAKPtJlMz+jK4U9yKoAvw/+hz7SywS9AAAAAAAAAAAapyk+oG2yP5iW1D5y2vu+GjejPrs7Lz4AAAAAAAAAAPP/nD09K1+7LO8SvnsFTr6I5UQ7fnHsvgAAgD8AAIA/08JPvmx1zD7Gsxc+YvQFv3mgML52TEI+AAAAAAAAAAAAcD68uKIePxMn4jurux2/MNGKvSvf97oAAAAAAAAAADOzNzzD2Wq6o+QvPQqdxrJtMsy6ex30swAAgD8AAIA/ZmvIPILEuD9GFDU+XyfUvG/EuTxqvw0+AAAAAAAAAAAahzI9a4blPSGPEb4X73y+5P6ZPBJSC74AAAAAAAAAAODMZT7QR8M+1j2zvqzPur7B5tA8pW3SvQAAAAAAAAAAmotKvIWL2rntswc1BGYzMAef2jtauW+0AACAPwAAgD/msjs9DteSPUXgrr12LKi+ZcXOvID9Ub0AAAAAAAAAABrPNr2ux+k3pTrtOY4AWDWr4427UzAQuQAAgD8AAIA/TX9OPfbsLrqKmRS0XnuQsFnLVjs4iKYzAACAPwAAgD8tdT0+eDXwPjjAVb7JHeO+ikraPYTjHr4AAAAAAAAAADMLDT0unYo/tp49Paa7W7+WGCQ9Q5BkvQAAAAAAAAAAAIAKOTf8nz+ORqe85HEXv8m35Lz+YRk9AAAAAAAAAABzLoO99vgwP4p4E7wk0DG/pK0Wvhq/Lz0AAAAAAAAAAM3GcD3sSdo6gqanvQ5ogL4oQAw9ppGMPAAAAAAAAAAAmlmwO3v6n7ou3eG73CC9PMZ3Vjt1g6K9AACAPwAAgD8AkFU8V4Z6PIhdBb4qSI2+7oyzvRC/NT0AAAAAAAAAAIa/Z76kZIk+/pbEPvVUyL5+GAW9Vo5gPgAAAAAAAAAATcfYPROkoz8/IQY/y0cBv6w1Az5mdps+AAAAAAAAAACNvVk+SgGRPpKqnb4z/Zy+3dfpPZhObL4AAAAAAAAAANp9jj2X0Vg+Fj4lvgqluL6AWg+9YBPQvAAAAAAAAAAAmt2SuzhAlbtuET08QDkpPGYkvjxiwhS9AACAPwAAgD+aNAC+Hj6JP9c1lb45ORm/Gi2EvqfCHb4AAAAAAAAAAHO0rT3hFoO6MwbgtHEA0C9Y6nS7M88oNAAAgD8AAIA/zXbTPMMZT7oBCj+0T3E4sN9zS7vlY5szAACAPwAAgD+a2hQ9uMaXuRnRAzqubha5CXZPu6ePDLkAAIA/AACAP00Eiz04JNi7td3JvQd6HT3sRy09aooBvgAAgD8AAIA/My2jPARGQz7v9oc8sam4viADUDxyYDM8AAAAAAAAAAAadGg9uN3du40V5z3BKJI8WlY7vfL4dT0AAIA/AACAPxqTAz3SoYu79oAIvJpTgTwzqvc8O4pdvQAAgD8AAIA/QKqNPctJDD/gZWA8y7DovrGWLD2zdNC8AAAAAAAAAAAzBsA8T94mvHv4h72rWy69z8i6PKAwQT4AAIA/AACAPxrJBz2ZQoY/LhyyPdXMQL8DsAg8yJVkPQAAAAAAAAAA5g63vfSlrT/CkBi/dYawvp+FFL3zpFi+AAAAAAAAAAAgVA2+wowoPuAdYz7Lh62+2J4fvVk3Ij4AAAAAAAAAAE2oqz0Cmxw+QkWpvvKumb5oz2u9n9AkvQAAAAAAAAAAZjJ5PI8yd7r1VyC4qV0hs27YGztVwTs3AACAPwAAgD8NRDo+95Y2P7rTZbxfGBa/eGRPPltq8b0AAAAAAAAAAJqpuTp9M3w+X5I4O6ONt77GSVi88UgIvQAAAAAAAAAAmi+0PH/Drj9YXbI+DQfPvgkWHLtyKok9AAAAAAAAAADNoi4995HKPspG4rnuUN6+zSy6PVObiz0AAAAAAAAAALPbjD1XDk0+EKfAvnObmL41CCu+lxIHvAAAAAAAAAAAwA79PXQxYD5afgO+BCq0vnSaq7zP1Tu9AAAAAAAAAABm8Ha8FLClujN8PDj6bS8zvZrNupqaWLcAAIA/AACAP2ZGWDpI6ZS6YERgPdT1DzwQOjc7G0MDvQAAgD8AAIA/+g9JvrTGkbyTPXK6HAieuKwYBD41QJc5AACAPwAAgD9AOFc+eAKRPypVwj71/Pq+kyC/Ptb5uT0AAAAAAAAAACZZjT1xars/4KooP16P8T3Ukqu6Q4X9PQAAAAAAAAAAGiDOPawtYz86gRs+TyMbv2BYKj7agyA9AAAAAAAAAACNKYe9w2V1umv6XTTFtoMvx9FyO94ckrMAAIA/AACAPxovzb0K/3888f2BPvPpsb4uhyQ9w72/vQAAAAAAAAAAGqVUvfWGgj9iJgS+c0FKv+d0D76bEhi9AAAAAAAAAAAA6xq9cRsVPp7YRj5x1ma+YlKHPbv4Jz4AAAAAAAAAADOym7wrGs8+/kFCPYrg1r52VHK9lcKNPQAAAAAAAAAAM8MvPh/G1D6XlQe+By73vq3D+j0S29a9AAAAAAAAAABmrk+8UurYPKtJED42soS+HEL3PYilfzwAAAAAAAAAAGA1Qr7h4cs+xRaBPkadD7+4Kc+9gpmuPQAAAAAAAAAATVANPQPUuT/yFSs+8owUvj6HRD3sGsk9AAAAAAAAAAAzErc8coodPxbhaTyL9xi/MylTvNZdSj0AAAAAAAAAADPSiLzNDKY/RdqovYC0Bb/bVmi9eCDcPAAAAAAAAAAAFrqTvh6Igj9/xKC+XXcmv8Re1b4yF2i9AAAAAAAAAACzxwg9cGitP0JEkT5QXLi+OqhkPev5Iz4AAAAAAAAAAJrRLDsfs4o8bn07PmzhPr67HAU+fYdVPQAAAAAAAAAAxhENPv/LtD9AKfw+rm2jvixFfD6xYsc+AAAAAAAAAACtZh4+DiCiP52iBz9+vQq/da+7PmOY4T4AAAAAAAAAAGabVr0UQKO6oV6HOA25fTP6NLI5/ZqbtwAAgD8AAIA/WoWyvQXhv7t+Jj896vawu6MXw7wTn56+AAAAAAAAgD+UjAVudW1weZSMBWR0eXBllJOUjAJmNJSJiIeUUpQoSwOMATyUTk5OSv////9K/////0sAdJRiS4BLCIaUjAFDlHSUUpQu"
+    },
+    "_last_episode_starts": {
+        ":type:": "<class 'numpy.ndarray'>",
+        ":serialized:": "gAWV8wAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJaAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYkuAhZSMAUOUdJRSlC4="
+    },
+    "_last_original_obs": null,
+    "_episode_num": 0,
+    "use_sde": false,
+    "sde_sample_freq": -1,
+    "_current_progress_remaining": -0.02236159999999998,
+    "_stats_window_size": 100,
+    "ep_info_buffer": {
+        ":type:": "<class 'collections.deque'>",
+        ":serialized:": "gAWVIRAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpSMFW51bXB5LmNvcmUubXVsdGlhcnJheZSMBnNjYWxhcpSTlIwFbnVtcHmUjAVkdHlwZZSTlIwCZjiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYkMIHHqLh3fpa0CUhpRSlIwBbJRNrgGMAXSUR0Cw9JCOBDohdX2UKGgGaAloD0MI0JhJ1AsJc0CUhpRSlGgVS79oFkdAsPTOEcsDn3V9lChoBmgJaA9DCERPyqSGZnJAlIaUUpRoFUvMaBZHQLD0zCwr1/V1fZQoaAZoCWgPQwjedTbkn61zQJSGlFKUaBVLu2gWR0Cw9OcvRJEqdX2UKGgGaAloD0MIiITv/Y0VckCUhpRSlGgVS91oFkdAsPTe5rgwXnV9lChoBmgJaA9DCIHoSZmUF3JAlIaUUpRoFUuraBZHQLD07QAMlTp1fZQoaAZoCWgPQwhm+iXibc9wQJSGlFKUaBVLz2gWR0Cw9Qb4agmJdX2UKGgGaAloD0MIoYSZtr9bcECUhpRSlGgVS8FoFkdAsPUBV5rxiHV9lChoBmgJaA9DCPP/qiOHiXBAlIaUUpRoFUu3aBZHQLD1LpJwsGx1fZQoaAZoCWgPQwgr9pfdE8txQJSGlFKUaBVLy2gWR0Cw9R9qQA+7dX2UKGgGaAloD0MIEr9iDRfocECUhpRSlGgVS7RoFkdAsPVKhK15SnV9lChoBmgJaA9DCPdZZaa0LFJAlIaUUpRoFUuuaBZHQLD1RTdtVJd1fZQoaAZoCWgPQwha9bnaimxyQJSGlFKUaBVL32gWR0Cw9WYYixFBdX2UKGgGaAloD0MI6ukj8IctcUCUhpRSlGgVS8ZoFkdAsPVqRmseXHV9lChoBmgJaA9DCJSl1vsN2XBAlIaUUpRoFUvSaBZHQLD1jslsxfx1fZQoaAZoCWgPQwjjNEQV/u1zQJSGlFKUaBVN5AFoFkdAsPWIGlhw2nV9lChoBmgJaA9DCPT7/s3LZnJAlIaUUpRoFUvVaBZHQLD1h53Tuv51fZQoaAZoCWgPQwjVzFoKSJxwQJSGlFKUaBVLzWgWR0Cw9aHm7rcCdX2UKGgGaAloD0MI5rLROT9dckCUhpRSlGgVS8toFkdAsPWidMCcPXV9lChoBmgJaA9DCIjX9Qt28XBAlIaUUpRoFUuraBZHQLD1odEsrd51fZQoaAZoCWgPQwj7lc6HJ4lwQJSGlFKUaBVLuGgWR0Cw9bD9GZuydX2UKGgGaAloD0MIK/pDM49TcUCUhpRSlGgVS9doFkdAsPXIyRB/qnV9lChoBmgJaA9DCIULeQQ3t3FAlIaUUpRoFUvJaBZHQLD149ytFKF1fZQoaAZoCWgPQwjq6/ma5RJxQJSGlFKUaBVLxWgWR0Cw9f6aw2VFdX2UKGgGaAloD0MIbxEY61tnc0CUhpRSlGgVS95oFkdAsPYHPnjhk3V9lChoBmgJaA9DCPcDHhhA/W5AlIaUUpRoFUvGaBZHQLD2CY2sJY11fZQoaAZoCWgPQwgkYkok0T5yQJSGlFKUaBVL4WgWR0Cw9gmBas6rdX2UKGgGaAloD0MISFD8GPPNcUCUhpRSlGgVS9loFkdAsPYFORDCxnV9lChoBmgJaA9DCMpt+x717nFAlIaUUpRoFUvSaBZHQLD2DQZ4wAV1fZQoaAZoCWgPQwiRmnYxTSVvQJSGlFKUaBVLy2gWR0Cw9iBKDkELdX2UKGgGaAloD0MIQlvOpbj6T0CUhpRSlGgVS6VoFkdAsPYUSVW0Z3V9lChoBmgJaA9DCAA7N23GTHNAlIaUUpRoFUvdaBZHQLD2JpaA4GV1fZQoaAZoCWgPQwjSVbq7zh9yQJSGlFKUaBVLyWgWR0Cw9mEu14PgdX2UKGgGaAloD0MI5j45CpDEcECUhpRSlGgVS8xoFkdAsPZpl2/zrnV9lChoBmgJaA9DCCKl2TxO33NAlIaUUpRoFUvYaBZHQLD2ZLXcxj91fZQoaAZoCWgPQwjG98WlqrdtQJSGlFKUaBVLw2gWR0Cw9nUxdpqRdX2UKGgGaAloD0MIIhlybH3pcECUhpRSlGgVS7doFkdAsPZxf5ULlXV9lChoBmgJaA9DCKneGtgqfnFAlIaUUpRoFUvGaBZHQLD2b2cJ+lV1fZQoaAZoCWgPQwh8ZHPVvCNxQJSGlFKUaBVLw2gWR0Cw9oOUD+zddX2UKGgGaAloD0MIgeuKGWGXb0CUhpRSlGgVS7ZoFkdAsPac7/4qPXV9lChoBmgJaA9DCOFBs+teV2FAlIaUUpRoFU3oA2gWR0Cw9rEcwQDndX2UKGgGaAloD0MIPGh23Zs8c0CUhpRSlGgVS91oFkdAsPapYkmhNHV9lChoBmgJaA9DCGkewCK/ZHBAlIaUUpRoFUvIaBZHQLD2vLhaTwF1fZQoaAZoCWgPQwhyv0NRYFlxQJSGlFKUaBVL2GgWR0Cw9tyPuG9IdX2UKGgGaAloD0MIjSYXY2DBckCUhpRSlGgVS+FoFkdAsPbWiQDFInV9lChoBmgJaA9DCDBK0F/o2HFAlIaUUpRoFUvjaBZHQLD27Dh99c91fZQoaAZoCWgPQwg4FD5bxypyQJSGlFKUaBVL52gWR0Cw9ubCN0eVdX2UKGgGaAloD0MIezGUE+0nckCUhpRSlGgVS6FoFkdAsPb+YeDFqHV9lChoBmgJaA9DCJliDoJOenNAlIaUUpRoFUvqaBZHQLD2/U96kZd1fZQoaAZoCWgPQwjUD+oiBbtvQJSGlFKUaBVL8mgWR0Cw9xLxVhkRdX2UKGgGaAloD0MIPnjt0gbEcUCUhpRSlGgVS8JoFkdAsPc2iO/+KnV9lChoBmgJaA9DCHsVGR0Qf3JAlIaUUpRoFUvdaBZHQLD3SldTo+x1fZQoaAZoCWgPQwgFw7mGmbZxQJSGlFKUaBVLrGgWR0Cw90ke+23KdX2UKGgGaAloD0MIaf6Y1qYQckCUhpRSlGgVS7poFkdAsPdXDR+jM3V9lChoBmgJaA9DCBK/Yg2XX25AlIaUUpRoFUu8aBZHQLD3ZKk2xY91fZQoaAZoCWgPQwhrZcIv9VFwQJSGlFKUaBVL7WgWR0Cw93ikCV8kdX2UKGgGaAloD0MIatlaX2TacUCUhpRSlGgVS8ZoFkdAsPfUxZdOZnV9lChoBmgJaA9DCHFV2XeFjHBAlIaUUpRoFUu9aBZHQLD33ZYgaFV1fZQoaAZoCWgPQwgF+G7zhgpyQJSGlFKUaBVLvGgWR0Cw+AoNy5qedX2UKGgGaAloD0MIwLD8+baxbUCUhpRSlGgVS8toFkdAsPgaAFxGUnV9lChoBmgJaA9DCFk1CHO7XHFAlIaUUpRoFUvkaBZHQLD4NTTvy9V1fZQoaAZoCWgPQwhAwcWK2vNxQJSGlFKUaBVLw2gWR0Cw+C9XLeQ/dX2UKGgGaAloD0MInRIQk3A7c0CUhpRSlGgVS8RoFkdAsPg77Ikqt3V9lChoBmgJaA9DCGgFhqzus3NAlIaUUpRoFUvRaBZHQLD4UFCb+cZ1fZQoaAZoCWgPQwhmg0wycgVwQJSGlFKUaBVLxGgWR0Cw+G+2qkuZdX2UKGgGaAloD0MIV12Haspwc0CUhpRSlGgVS79oFkdAsPiGA/cFhXV9lChoBmgJaA9DCIjZy7aTpnBAlIaUUpRoFUvHaBZHQLD4gFM7EHd1fZQoaAZoCWgPQwgHX5hMFetvQJSGlFKUaBVLyGgWR0Cw+JGykbgkdX2UKGgGaAloD0MIgPChREvIckCUhpRSlGgVS/BoFkdAsPis7+1jRXV9lChoBmgJaA9DCMaFAyGZ+nBAlIaUUpRoFUvraBZHQLD43ACnxax1fZQoaAZoCWgPQwjoMcoz76ByQJSGlFKUaBVL4GgWR0Cw+PNLDhtMdX2UKGgGaAloD0MI22ysxHyDcUCUhpRSlGgVS9JoFkdAsPkl2V3Ux3V9lChoBmgJaA9DCNi4/l2fGXJAlIaUUpRoFUvfaBZHQLD5PZof0Vd1fZQoaAZoCWgPQwi4Pqw36nBzQJSGlFKUaBVL0GgWR0Cw+Vn6InBtdX2UKGgGaAloD0MIZoNMMnJZcUCUhpRSlGgVS79oFkdAsPlV2OhkAnV9lChoBmgJaA9DCCfBG9IogHJAlIaUUpRoFUvcaBZHQLD5bl4C6pZ1fZQoaAZoCWgPQwg1C7Q7JCpuQJSGlFKUaBVLt2gWR0Cw+Wm+49X+dX2UKGgGaAloD0MI3NYWntfycUCUhpRSlGgVS9VoFkdAsPmOWGATZnV9lChoBmgJaA9DCA9j0t8LO3NAlIaUUpRoFUvXaBZHQLD5jo5PuXx1fZQoaAZoCWgPQwj1hZDzvmhxQJSGlFKUaBVLq2gWR0Cw+YXnyNGWdX2UKGgGaAloD0MIwF/MlmwtdECUhpRSlGgVS7doFkdAsPnD1vl2eXV9lChoBmgJaA9DCKck63C063FAlIaUUpRoFUvHaBZHQLD5zd07r9l1fZQoaAZoCWgPQwg74/vi0gpyQJSGlFKUaBVLs2gWR0Cw+fyEDhcadX2UKGgGaAloD0MIliGOdfGXb0CUhpRSlGgVS8loFkdAsPoBMN+b3HV9lChoBmgJaA9DCJ8cBYjCa3JAlIaUUpRoFUuxaBZHQLD6HNFSbYt1fZQoaAZoCWgPQwiQSrGjMc1xQJSGlFKUaBVL/2gWR0Cw+ipJTVDsdX2UKGgGaAloD0MIqI3qdOCEc0CUhpRSlGgVS89oFkdAsPoqd8RcvHV9lChoBmgJaA9DCL2PozlyoHBAlIaUUpRoFUupaBZHQLD6UH58BuJ1fZQoaAZoCWgPQwieB3dn7VFyQJSGlFKUaBVNEwFoFkdAsPqBZHNHH3V9lChoBmgJaA9DCL2qs1ogr3FAlIaUUpRoFUvVaBZHQLD6lDyOJch1fZQoaAZoCWgPQwhWurvOhrdyQJSGlFKUaBVL02gWR0Cw+pNFOO81dX2UKGgGaAloD0MI7bjhd9O9cECUhpRSlGgVS6RoFkdAsPq00uUUwnV9lChoBmgJaA9DCFQ7w9QW6HJAlIaUUpRoFUvvaBZHQLD6zuwHJLd1fZQoaAZoCWgPQwirr64KVLVwQJSGlFKUaBVLxWgWR0Cw+u8c6vJSdX2UKGgGaAloD0MIOey+Y/gMc0CUhpRSlGgVS89oFkdAsPr5UR3/xXV9lChoBmgJaA9DCCOHiJtT0G1AlIaUUpRoFUvDaBZHQLD7ETGYKIB1fZQoaAZoCWgPQwgfK/htCFNxQJSGlFKUaBVL1GgWR0Cw+wg9eQdTdX2UKGgGaAloD0MIyXTo9DzXcUCUhpRSlGgVS/BoFkdAsPtJGLDQ7nV9lChoBmgJaA9DCERN9Pmo221AlIaUUpRoFUusaBZHQLD7QEDyOJd1fZQoaAZoCWgPQwjE7GXbKehyQJSGlFKUaBVLx2gWR0Cw+4Ds+mm+dWUu"
+    },
+    "ep_success_buffer": {
+        ":type:": "<class 'collections.deque'>",
+        ":serialized:": "gAWVIAAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKULg=="
+    },
+    "_n_updates": 195,
+    "observation_space": {
+        ":type:": "<class 'gym.spaces.box.Box'>",
+        ":serialized:": "gAWVnwEAAAAAAACMDmd5bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lGgFk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMBl9zaGFwZZRLCIWUjANsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWIAAAAAAAAAAAAID/AACA/wAAgP8AAID/AACA/wAAgP8AAID/AACA/5RoCksIhZSMAUOUdJRSlIwEaGlnaJRoEiiWIAAAAAAAAAAAAIB/AACAfwAAgH8AAIB/AACAfwAAgH8AAIB/AACAf5RoCksIhZRoFXSUUpSMDWJvdW5kZWRfYmVsb3eUaBIolggAAAAAAAAAAAAAAAAAAACUaAeMAmIxlImIh5RSlChLA4wBfJROTk5K/////0r/////SwB0lGJLCIWUaBV0lFKUjA1ib3VuZGVkX2Fib3ZllGgSKJYIAAAAAAAAAAAAAAAAAAAAlGghSwiFlGgVdJRSlIwKX25wX3JhbmRvbZROdWIu",
+        "dtype": "float32",
+        "_shape": [
+            8
+        ],
+        "low": "[-inf -inf -inf -inf -inf -inf -inf -inf]",
+        "high": "[inf inf inf inf inf inf inf inf]",
+        "bounded_below": "[False False False False False False False False]",
+        "bounded_above": "[False False False False False False False False]",
+        "_np_random": null
+    },
+    "action_space": {
+        ":type:": "<class 'gym.spaces.discrete.Discrete'>",
+        ":serialized:": "gAWVggAAAAAAAACME2d5bS5zcGFjZXMuZGlzY3JldGWUjAhEaXNjcmV0ZZSTlCmBlH2UKIwBbpRLBIwGX3NoYXBllCmMBWR0eXBllIwFbnVtcHmUaAeTlIwCaTiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYowKX25wX3JhbmRvbZROdWIu",
+        "n": 4,
+        "_shape": [],
+        "dtype": "int64",
+        "_np_random": null
+    },
+    "n_envs": 128,
+    "n_steps": 1024,
+    "gamma": 0.998,
+    "gae_lambda": 0.98,
+    "ent_coef": 0.01,
+    "vf_coef": 0.5,
+    "max_grad_norm": 0.5,
+    "batch_size": 128,
+    "n_epochs": 5,
+    "clip_range": {
+        ":type:": "<class 'function'>",
+        ":serialized:": "gAWVwwIAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLAUsTQwSIAFMAlE6FlCmMAV+UhZSMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZSMBGZ1bmOUS4JDAgABlIwDdmFslIWUKXSUUpR9lCiMC19fcGFja2FnZV9flIwYc3RhYmxlX2Jhc2VsaW5lczMuY29tbW9ulIwIX19uYW1lX1+UjB5zdGFibGVfYmFzZWxpbmVzMy5jb21tb24udXRpbHOUjAhfX2ZpbGVfX5SMSC91c3IvbG9jYWwvbGliL3B5dGhvbjMuOS9kaXN0LXBhY2thZ2VzL3N0YWJsZV9iYXNlbGluZXMzL2NvbW1vbi91dGlscy5weZR1Tk5oAIwQX21ha2VfZW1wdHlfY2VsbJSTlClSlIWUdJRSlIwcY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgffZR9lChoFmgNjAxfX3F1YWxuYW1lX1+UjBljb25zdGFudF9mbi48bG9jYWxzPi5mdW5jlIwPX19hbm5vdGF0aW9uc19flH2UjA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoF4wHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlEc/yZmZmZmZmoWUUpSFlIwXX2Nsb3VkcGlja2xlX3N1Ym1vZHVsZXOUXZSMC19fZ2xvYmFsc19flH2UdYaUhlIwLg=="
+    },
+    "clip_range_vf": null,
+    "normalize_advantage": true,
+    "target_kl": null
+}

ppo-LunarLander-v2/policy.optimizer.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1063d368a91ca8211376f5a900844b3b05cb5ef187ed2d0c0485ccf4edfb9e1a
+size 87929

ppo-LunarLander-v2/policy.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d8f1f281475f03e86823e694dffc8caa4c5c554aab677a281f5c45b45710494
+size 43329

ppo-LunarLander-v2/pytorch_variables.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d030ad8db708280fcae77d87e973102039acd23a11bdecc3db8eb6c0ac940ee1
+size 431

ppo-LunarLander-v2/system_info.txt

@@ -0,0 +1,7 @@
+- OS: Linux-5.10.147+-x86_64-with-glibc2.31 # 1 SMP Sat Dec 10 16:00:40 UTC 2022
+- Python: 3.9.16
+- Stable-Baselines3: 1.8.0
+- PyTorch: 2.0.0+cu118
+- GPU Enabled: True
+- Numpy: 1.22.4
+- Gym: 0.21.0

results.json

@@ -0,0 +1 @@
+{"mean_reward": 277.09558204262675, "std_reward": 19.281885997314, "is_deterministic": true, "n_eval_episodes": 10, "eval_datetime": "2023-04-20T01:02:07.633888"}