Vehicle management in a modular production context using Deep Q-Learning
  We investigate the feasibility of deploying Deep-Q based deep reinforcement
learning agents to job-shop scheduling problems in the context of modular
production facilities, using discrete event simulations for the environment.
These environments are comprised of a source and sink for the parts to be
processed, as well as (several) workstations. The agents are trained to
schedule automated guided vehicles to transport the parts back and forth
between those stations in an optimal fashion. Starting from a very simplistic
setup, we increase the complexity of the environment and compare the agents'
performances with well established heuristic approaches, such as
first-in-first-out based agents, cost tables and a nearest-neighbor approach.
We furthermore seek particular configurations of the environments in which the
heuristic approaches struggle, to investigate to what degree the Deep-Q agents
are affected by these challenges. We find that Deep-Q based agents show
comparable performance as the heuristic baselines. Furthermore, our findings
suggest that the DRL agents exhibit an increased robustness to noise, as
compared to the conventional approaches. Overall, we find that DRL agents
constitute a valuable approach for this type of scheduling problems.
