Files changed (1) hide show
  1. README.md +32 -2
README.md CHANGED
@@ -56,7 +56,7 @@ Mr. Balance uses a shared Actor-Critic MLP designed for continuous-control reinf
56
  * Number of Episodes: `12756`
57
  * Maximum Episode Steps: `10000`
58
 
59
- ## Training Objects
60
 
61
  - Sphere
62
  - Egg
@@ -95,4 +95,34 @@ Mr. Balance excels at balancing all the objects he was trained on, but does he g
95
  | heavy_ball | 24,310.68 | 10,000.0 | 100.0% | 0.0401m |
96
  | offcenter_block | 21,408.22 | 10,000.0 | 100.0% | 0.1395m |
97
 
98
- The answer is yes; Mr. Balance excels at balancing a wide range of objects, not just the three he was trained on.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
  * Number of Episodes: `12756`
57
  * Maximum Episode Steps: `10000`
58
 
59
+ ### Training Objects
60
 
61
  - Sphere
62
  - Egg
 
95
  | heavy_ball | 24,310.68 | 10,000.0 | 100.0% | 0.0401m |
96
  | offcenter_block | 21,408.22 | 10,000.0 | 100.0% | 0.1395m |
97
 
98
+ The answer is yes; Mr. Balance excels at balancing a wide range of objects, not just the three he was trained on.
99
+
100
+ ## Inference
101
+
102
+ First install the required dependencies:
103
+
104
+ ```bash
105
+ pip install torch transformers safetensors "mujoco==3.10.0" numpy
106
+ ```
107
+
108
+ Windows users also might need the Microsoft C++ Build Tools:
109
+
110
+ [https://visualstudio.microsoft.com/visual-cpp-build-tools/](https://visualstudio.microsoft.com/visual-cpp-build-tools/)
111
+
112
+ Next, download both `inference.py` and `balance_plate_rl.py` and run:
113
+
114
+ ```bash
115
+ python inference.py
116
+ ```
117
+
118
+ Add `--render` for live visual rendering or/and `--object` to choose a specific object.
119
+
120
+ ## License
121
+
122
+ Apache 2.0.
123
+
124
+ ## Citation
125
+
126
+ ```
127
+
128
+ ```