Learning to Herd Agents Amongst Obstacles: Training Robust Shepherding
  Behaviors using Deep Reinforcement Learning
  Robotic shepherding problem considers the control and navigation of a group
of coherent agents (e.g., a flock of bird or a fleet of drones) through the
motion of an external robot, called shepherd. Machine learning based methods
have successfully solved this problem in an empty environment with no
obstacles. Rule-based methods, on the other hand, can handle more complex
scenarios in which environments are cluttered with obstacles and allow multiple
shepherds to work collaboratively. However, these rule-based methods are
fragile due to the difficulty in defining a comprehensive set of rules that can
handle all possible cases. To overcome these limitations, we propose the first
known learning-based method that can herd agents amongst obstacles. By using
deep reinforcement learning techniques combined with the probabilistic
roadmaps, we train a shepherding model using noisy but controlled environmental
and behavioral parameters. Our experimental results show that the proposed
method is robust, namely, it is insensitive to the uncertainties originated
from both environmental and behavioral models. Consequently, the proposed
method has a higher success rate, shorter completion time and path length than
the rule-based behavioral methods have. These advantages are particularly
prominent in more challenging scenarios involving more difficult groups and
strenuous passages.
