Update README.md
Browse files
README.md
CHANGED
|
@@ -1,35 +1,51 @@
|
|
| 1 |
-
---
|
| 2 |
-
library_name: ml-agents
|
| 3 |
-
tags:
|
| 4 |
-
-
|
| 5 |
-
-
|
| 6 |
-
- reinforcement-learning
|
| 7 |
-
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: ml-agents
|
| 3 |
+
tags:
|
| 4 |
+
- SolarTracker
|
| 5 |
+
- PyTorcj
|
| 6 |
+
- deep-reinforcement-learning
|
| 7 |
+
- reinforcement-learning
|
| 8 |
+
- ML-Agents-SearcherBrain
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# **ppo** Agent playing **SearcherBrain**
|
| 12 |
+
This is a trained model of a **ppo Solar Tracker** searching and tracking the sun
|
| 13 |
+
using the [Unity ML-Agents Library](https://github.com/Unity-Technologies/ml-agents).
|
| 14 |
+
|
| 15 |
+
## Usage (with ML-Agents)
|
| 16 |
+
The Documentation: https://unity-technologies.github.io/ml-agents/ML-Agents-Toolkit-Documentation/
|
| 17 |
+
|
| 18 |
+
We wrote a complete tutorial to learn to train your first agent using ML-Agents and publish it to the Hub:
|
| 19 |
+
- A *short tutorial* where you teach Huggy the Dog 🐶 to fetch the stick and then play with him directly in your
|
| 20 |
+
browser: https://huggingface.co/learn/deep-rl-course/unitbonus1/introduction
|
| 21 |
+
- A *longer tutorial* to understand how works ML-Agents:
|
| 22 |
+
https://huggingface.co/learn/deep-rl-course/unit5/introduction
|
| 23 |
+
|
| 24 |
+
### Resume the training
|
| 25 |
+
```bash
|
| 26 |
+
mlagents-learn <your_configuration_file_path.yaml> --run-id=<run_id> --resume
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
### Watch your Agent play
|
| 30 |
+
You can watch this agent in action **directly in your browser**
|
| 31 |
+
|
| 32 |
+
1. If the environment is part of ML-Agents official environments, go to [this](https://huggingface.co/spaces/SamuelM0422/SolarTracker) space
|
| 33 |
+
2. Watch the agent in action! 👀
|
| 34 |
+
|
| 35 |
+
### Input of the model
|
| 36 |
+
|
| 37 |
+
The action space size is a tensor of 7 elements:
|
| 38 |
+
|
| 39 |
+
1. The coordinates of the sun in the camera ```bash[x, y]``` normalized
|
| 40 |
+
2. A one-hot-encoded vector representing if the sun is visible or not ```bash[0 or 1]```
|
| 41 |
+
3. The quaternion vector representing the rotation of the solar panel.
|
| 42 |
+
|
| 43 |
+
```bash
|
| 44 |
+
input = [x, y, visibility, qx, qy, qz, qw]
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
e.g.
|
| 48 |
+
```bash
|
| 49 |
+
input = [0.4, 0.5, 1, 0.98, 0, -0.32, -0.99]
|
| 50 |
+
```
|
| 51 |
|