license:mit region:us
---
license: mit
---
# Learning layouts in Path of Exile with Vision Transformers: A proof of concept

<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/650c55bc9169ea73315b6c22/RJ-rTPWwOFUZlA3ydqhZ2.mp4"></video>

Where's the exit? This question often crosses the minds of both newcomers and seasoned players alike. The key lies in understanding the game's layouts, especially during the campaign when taking a wrong turn can significantly slow you down. Our project aims to solve this challenge through machine learning.

We've developed a proof-of-concept for learning layouts in Path of Exile using Vision Transformers. We trained a Vision Transformer to predict the direction of the exit in the A3 Marketplace, relying solely on a video of the minimap. You can see the model in action in the video above: the red arrow indicates the predicted exit direction, while the green arrow shows the actual direction.

Project page: https://github.com/kweimann/poe-learning-layouts