Update README.md
#1
by Harley-ml - opened
README.md
CHANGED
|
@@ -56,7 +56,7 @@ Mr. Balance uses a shared Actor-Critic MLP designed for continuous-control reinf
|
|
| 56 |
* Number of Episodes: `12756`
|
| 57 |
* Maximum Episode Steps: `10000`
|
| 58 |
|
| 59 |
-
## Training Objects
|
| 60 |
|
| 61 |
- Sphere
|
| 62 |
- Egg
|
|
@@ -95,4 +95,34 @@ Mr. Balance excels at balancing all the objects he was trained on, but does he g
|
|
| 95 |
| heavy_ball | 24,310.68 | 10,000.0 | 100.0% | 0.0401m |
|
| 96 |
| offcenter_block | 21,408.22 | 10,000.0 | 100.0% | 0.1395m |
|
| 97 |
|
| 98 |
-
The answer is yes; Mr. Balance excels at balancing a wide range of objects, not just the three he was trained on.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
* Number of Episodes: `12756`
|
| 57 |
* Maximum Episode Steps: `10000`
|
| 58 |
|
| 59 |
+
### Training Objects
|
| 60 |
|
| 61 |
- Sphere
|
| 62 |
- Egg
|
|
|
|
| 95 |
| heavy_ball | 24,310.68 | 10,000.0 | 100.0% | 0.0401m |
|
| 96 |
| offcenter_block | 21,408.22 | 10,000.0 | 100.0% | 0.1395m |
|
| 97 |
|
| 98 |
+
The answer is yes; Mr. Balance excels at balancing a wide range of objects, not just the three he was trained on.
|
| 99 |
+
|
| 100 |
+
## Inference
|
| 101 |
+
|
| 102 |
+
First install the required dependencies:
|
| 103 |
+
|
| 104 |
+
```bash
|
| 105 |
+
pip install torch transformers safetensors "mujoco==3.10.0" numpy
|
| 106 |
+
```
|
| 107 |
+
|
| 108 |
+
Windows users also might need the Microsoft C++ Build Tools:
|
| 109 |
+
|
| 110 |
+
[https://visualstudio.microsoft.com/visual-cpp-build-tools/](https://visualstudio.microsoft.com/visual-cpp-build-tools/)
|
| 111 |
+
|
| 112 |
+
Next, download both `inference.py` and `balance_plate_rl.py` and run:
|
| 113 |
+
|
| 114 |
+
```bash
|
| 115 |
+
python inference.py
|
| 116 |
+
```
|
| 117 |
+
|
| 118 |
+
Add `--render` for live visual rendering or/and `--object` to choose a specific object.
|
| 119 |
+
|
| 120 |
+
## License
|
| 121 |
+
|
| 122 |
+
Apache 2.0.
|
| 123 |
+
|
| 124 |
+
## Citation
|
| 125 |
+
|
| 126 |
+
```
|
| 127 |
+
|
| 128 |
+
```
|