kweimann's picture
Update README.md
6bf5a65
---
license: mit
---
# Learning layouts in Path of Exile with Vision Transformers: A proof of concept
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/650c55bc9169ea73315b6c22/sPAPvqDH6s2wMucl41pW_.mp4"></video>
Where's the exit? This question often crosses the minds of both newcomers and seasoned players alike. The key lies in understanding the game's layouts, especially during the campaign when taking a wrong turn can significantly slow you down. Our project aims to solve this challenge through machine learning.
We've developed a proof-of-concept for learning layouts in Path of Exile using Vision Transformers. We trained a Vision Transformer to predict the direction of the exit in the A3 Marketplace, relying solely on a video of the minimap. You can see the model in action in the video above: the red arrow indicates the predicted exit direction, while the green arrow shows the actual direction.
Project page: https://github.com/kweimann/poe-learning-layouts