dgenes commited on
Commit
9ea8965
·
verified ·
1 Parent(s): 0d2e7cc

Push agent to the Hub

Browse files
README.md CHANGED
@@ -17,7 +17,7 @@ model-index:
17
  type: CartPole-v1
18
  metrics:
19
  - type: mean_reward
20
- value: 216.00 +/- 104.80
21
  name: mean_reward
22
  verified: false
23
  ---
@@ -25,37 +25,6 @@ model-index:
25
  # PPO Agent Playing CartPole-v1
26
 
27
  This is a trained model of a PPO agent playing CartPole-v1.
28
-
29
  # Hyperparameters
30
- ```python
31
- {'exp_name': 'ppo'
32
- 'seed': 1
33
- 'torch_deterministic': True
34
- 'cuda': True
35
- 'track': False
36
- 'wandb_project_name': 'cleanRL'
37
- 'wandb_entity': None
38
- 'capture_video': False
39
- 'env_id': 'CartPole-v1'
40
- 'total_timesteps': 50000
41
- 'learning_rate': 0.00025
42
- 'num_envs': 4
43
- 'num_steps': 128
44
- 'anneal_lr': True
45
- 'gae': True
46
- 'gamma': 0.99
47
- 'gae_lambda': 0.95
48
- 'num_minibatches': 4
49
- 'update_epochs': 4
50
- 'norm_adv': True
51
- 'clip_coef': 0.2
52
- 'clip_vloss': True
53
- 'ent_coef': 0.01
54
- 'vf_coef': 0.5
55
- 'max_grad_norm': 0.5
56
- 'target_kl': None
57
- 'batch_size': 512
58
- 'minibatch_size': 128
59
- 'repo_id': 'dgenes/ppo-CartPole-v1'}
60
- ```
61
 
 
17
  type: CartPole-v1
18
  metrics:
19
  - type: mean_reward
20
+ value: 226.40 +/- 70.72
21
  name: mean_reward
22
  verified: false
23
  ---
 
25
  # PPO Agent Playing CartPole-v1
26
 
27
  This is a trained model of a PPO agent playing CartPole-v1.
28
+
29
  # Hyperparameters
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
 
logs/events.out.tfevents.1771948255.30feefec134f.2975.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cebc306be07239873a9da6620fca988d6ce91c22f01797eff95ab710c7044c6
3
+ size 50365
model.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8865abc247bff256128181f16fb7ad9798aea79e02fa427e38546352a52a5c85
3
  size 40859
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:254c93ec02a378dc348204e61579272db90c3aadd50f83fdb92e38b4e11261c9
3
  size 40859
replay.mp4 CHANGED
Binary files a/replay.mp4 and b/replay.mp4 differ
 
results.json CHANGED
@@ -1 +1 @@
1
- {"env_id": "CartPole-v1", "mean_reward": 216.0, "std_reward": 104.79790074233358, "n_evaluation_episodes": 10, "eval_datetime": "2026-02-24T13:59:53.012947"}
 
1
+ {"env_id": "CartPole-v1", "mean_reward": 226.4, "std_reward": 70.71944569918517, "n_evaluation_episodes": 10, "eval_datetime": "2026-02-24T16:15:57.215960"}