Simulating multi-exit evacuation using deep reinforcement learning
  Conventional simulations on multi-exit indoor evacuation focus primarily on
how to determine a reasonable exit based on numerous factors in a changing
environment. Results commonly include some congested and other under-utilized
exits, especially with massive pedestrians. We propose a multi-exit evacuation
simulation based on Deep Reinforcement Learning (DRL), referred to as the
MultiExit-DRL, which involves in a Deep Neural Network (DNN) framework to
facilitate state-to-action mapping. The DNN framework applies Rainbow Deep
Q-Network (DQN), a DRL algorithm that integrates several advanced DQN methods,
to improve data utilization and algorithm stability, and further divides the
action space into eight isometric directions for possible pedestrian choices.
We compare MultiExit-DRL with two conventional multi-exit evacuation simulation
models in three separate scenarios: 1) varying pedestrian distribution ratios,
2) varying exit width ratios, and 3) varying open schedules for an exit. The
results show that MultiExit-DRL presents great learning efficiency while
reducing the total number of evacuation frames in all designed experiments. In
addition, the integration of DRL allows pedestrians to explore other potential
exits and helps determine optimal directions, leading to the high efficiency of
exit utilization.
