pravsels commited on
Commit
5bb6607
·
verified ·
1 Parent(s): 82fc979

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +82 -0
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - arx5
5
+ - mujoco
6
+ - world-model
7
+ - nanoGPT
8
+ - dynamics
9
+ ---
10
+
11
+ # ARX5 MuJoCo World Model - nanoGPT h32
12
+
13
+ State-only world model for the ARX5 7-DOF robot arm in MuJoCo. Predicts next state (14D: 7 qpos + 7 qvel) from state history and action.
14
+
15
+ ## Architecture
16
+
17
+ | Parameter | Value |
18
+ |-----------|-------|
19
+ | Type | nanoGPT (causal transformer) |
20
+ | Layers | 6 |
21
+ | Heads | 12 |
22
+ | Embedding dim | 384 |
23
+ | Context length | 32 (history_horizon=31) |
24
+ | Parameters | ~10.7M |
25
+ | Ensemble size | 2 |
26
+ | State dim | 14 (7 qpos + 7 qvel) |
27
+ | Action dim | 7 (joint position targets) |
28
+
29
+ ## Training
30
+
31
+ | Metric | Value |
32
+ |--------|-------|
33
+ | best_val_loss | 0.1058 (step 50,000) |
34
+ | train_loss | 0.129 (step 50,000) |
35
+ | Steps completed | 75,000 (early stopped) |
36
+ | Batch size | 64 |
37
+ | Learning rate | 3e-4 (cosine decay to 3e-5) |
38
+ | Runtime | ~2h 42m on NVIDIA L4 (GCloud) |
39
+ | Dataset | 1,024 episodes, 3.5M frames |
40
+
41
+ Trained on [pravsels/arx5-mujoco-trajectories](https://huggingface.co/datasets/pravsels/arx5-mujoco-trajectories).
42
+
43
+ ## Files
44
+
45
+ checkpoints/step_50000/params/params.pt # Model weights (84MB)
46
+ checkpoints/step_50000/train_state/train_state.pt # Optimizer state (86MB)
47
+ assets/normalization_stats.json # z-score mean/std
48
+ TRAINING_LOG.md # Training log
49
+
50
+ ## Checkpoint Hashes
51
+
52
+ Verify integrity after download:
53
+
54
+ cd checkpoints/step_50000
55
+ find params -type f | sort | xargs sha256sum | sha256sum
56
+ # Expected: c27e9b11f1d5d1291a96d305fc0d846c28e91dfc66f578a66942e9a71ae74b32
57
+
58
+ find train_state -type f | sort | xargs sha256sum | sha256sum
59
+ # Expected: 05ec0450208e92822f10c6f4c14e80131a92eeef550793e01e8c50e315c9370a
60
+
61
+ ## Usage
62
+
63
+ import torch
64
+ from rsl_rl.modules.system_dynamics import SystemDynamicsEnsemble
65
+
66
+ ckpt = torch.load("checkpoints/step_50000/params/params.pt", map_location="cuda")
67
+
68
+ model = SystemDynamicsEnsemble(
69
+ state_dim=14, action_dim=7, device="cuda",
70
+ ensemble_size=2, history_horizon=31,
71
+ architecture_config={"type": "gpt", "n_embd": 384, "n_head": 12, "n_layer": 6,
72
+ "block_size": 32, "bias": False, "dropout": 0.0,
73
+ "state_mean_shape": [384], "state_logstd_shape": [384]},
74
+ )
75
+ model.load_state_dict(ckpt["model_state_dict"])
76
+ model.eval()
77
+
78
+ ## Source
79
+
80
+ - Repo: github.com/pravsels/rsl_rwm (branch: feat/arx5_mujoco_wm)
81
+ - Config: config/arx5_mujoco/arx5_mujoco_rsl_rwm_h32_gpt_gcloud.yaml
82
+ - Commit: 1842346