Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,76 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Unit 1: Introduction to Deep Reinforcement Learning
|
| 2 |
+
|
| 3 |
+
In this Unit, you'll learn the foundations of Deep RL. And **you’ll train your first lander agent 🚀 to land correctly on the Moon 🌕** using Stable-Baselines3 and share it with the community.
|
| 4 |
+
|
| 5 |
+
<img src="assets/img/LunarLander.gif" alt="LunarLander"/>
|
| 6 |
+
|
| 7 |
+
You'll then be able to **compare your agent’s results with other classmates thanks to a leaderboard** 🔥.
|
| 8 |
+
|
| 9 |
+
This course is **self-paced**, you can start whenever you want.
|
| 10 |
+
|
| 11 |
+
## Required time ⏱️
|
| 12 |
+
The required time for this unit is, approximately:
|
| 13 |
+
- 2 hours for the theory
|
| 14 |
+
- 1 hour for the hands-on.
|
| 15 |
+
|
| 16 |
+
## Start this Unit 🚀
|
| 17 |
+
Here are the steps for this Unit:
|
| 18 |
+
|
| 19 |
+
1️⃣ Sign up to our Discord Server. This is the place where you **can exchange with the community and with us, create study groups to grow each other and more**
|
| 20 |
+
|
| 21 |
+
👉🏻 [https://discord.gg/aYka4Yhff9](https://discord.gg/aYka4Yhff9).
|
| 22 |
+
|
| 23 |
+
Are you new to Discord? Check our **discord 101 to get the best practices** 👉 https://github.com/huggingface/deep-rl-class/blob/main/DISCORD.Md
|
| 24 |
+
|
| 25 |
+
2️⃣ **Introduce yourself on Discord in #introduce-yourself Discord channel 🤗 and check on the left the Reinforcement Learning section.**
|
| 26 |
+
|
| 27 |
+
- In #rl-announcements we give the last information about the course.
|
| 28 |
+
- #discussions is a place to exchange.
|
| 29 |
+
- #unity-ml-agents is to exchange about everything related to this library.
|
| 30 |
+
- #study-groups, to create study groups with your classmates.
|
| 31 |
+
|
| 32 |
+
<img src="assets/img/discord_channels.jpg" alt="Discord Channels"/>
|
| 33 |
+
|
| 34 |
+
3️⃣ 📖 Read An [Introduction to Deep Reinforcement Learning](), where you’ll learn the foundations of Deep RL. You can also watch the video version attached to the article. 👉 [ARTICLE LINK]
|
| 35 |
+
|
| 36 |
+
4️⃣ 👩💻 Then dive on the hands-on, where **you’ll train your first lander agent 🚀 to land correctly on the Moon 🌕 using Stable-Baselines3 and share it with the community.** Thanks to a leaderboard, **you'll be able to compare your results with other classmates** and exchange the best practices to improve your agent's scores Who will win the challenge for Unit 1 🏆?
|
| 37 |
+
|
| 38 |
+
The hands-on 👉
|
| 39 |
+
|
| 40 |
+
The leaderboard 👉
|
| 41 |
+
|
| 42 |
+
You can work directly **with the colab notebook, which allows you not to have to install everything on your machine (and it’s free)**.
|
| 43 |
+
|
| 44 |
+
5️⃣ The best way to learn **is to try things on your own**. That’s why we have a challenges section in the colab where we give you some ideas on how you can go further: using another environment, using another model etc.
|
| 45 |
+
|
| 46 |
+
## Additional readings 📚
|
| 47 |
+
- [Reinforcement Learning: An Introduction, Richard Sutton and Andrew G. Barto Chapter 1, 2 and 3](http://incompleteideas.net/book/RLbook2020.pdf)
|
| 48 |
+
- [Foundations of Deep RL Series, L1 MDPs, Exact Solution Methods, Max-ent RL by Pieter Abbeel](https://youtu.be/2GwBez0D20A)
|
| 49 |
+
- [Spinning Up RL by OpenAI Part 1: Key concepts of RL](https://spinningup.openai.com/en/latest/spinningup/rl_intro.html)
|
| 50 |
+
|
| 51 |
+
- [Getting Started With OpenAI Gym: The Basic Building Blocks](https://blog.paperspace.com/getting-started-with-openai-gym/)
|
| 52 |
+
|
| 53 |
+
## How to make the most of this course
|
| 54 |
+
|
| 55 |
+
To make the most of the course, my advice is to:
|
| 56 |
+
|
| 57 |
+
- **Participate in Discord** and join a study group.
|
| 58 |
+
- **Read multiple times** the theory part and takes some notes
|
| 59 |
+
- Don’t just do the colab. When you learn something, try to change the environment, change the parameters and read the libraries' documentation. Have fun 🥳
|
| 60 |
+
- Struggling is **a good thing in learning**. It means that you start to build new skills. Deep RL is a complex topic and it takes time to understand. Try different approaches, use our additional readings, and exchange with classmates on discord.
|
| 61 |
+
|
| 62 |
+
## This is a course built with you 👷🏿♀️
|
| 63 |
+
|
| 64 |
+
We want to improve and update the course iteratively with your feedback. If you have some, please open an issue on the Github Repo: [https://github.com/huggingface/deep-rl-class/issues](https://github.com/huggingface/deep-rl-class/issues)
|
| 65 |
+
|
| 66 |
+
## Don’t forget to join the Community 📢
|
| 67 |
+
|
| 68 |
+
We have a discord server where you **can exchange with the community and with us, create study groups to grow each other and more**
|
| 69 |
+
|
| 70 |
+
👉🏻 [https://discord.gg/aYka4Yhff9](https://discord.gg/aYka4Yhff9).
|
| 71 |
+
|
| 72 |
+
Don’t forget to **introduce yourself when you sign up 🤗**
|
| 73 |
+
|
| 74 |
+
❓If you have other questions, [please check our FAQ](https://github.com/huggingface/deep-rl-class#faq)
|
| 75 |
+
|
| 76 |
+
Keep learning, stay awesome,
|