Group-Agent Reinforcement Learning
  It can largely benefit the reinforcement learning process of each agent if
multiple agents perform their separate reinforcement learning tasks
cooperatively. Different from multi-agent reinforcement learning where multiple
agents are in a common environment and should learn to cooperate or compete
with each other, in this case each agent has its separate environment and only
communicate with others to share knowledge without any cooperative or
competitive behaviour as a learning outcome. In fact, this learning scenario is
not well understood yet and not well formulated. As the first effort, we
propose group-agent reinforcement learning as a formulation of this scenario
and the third type of reinforcement learning problem with respect to
single-agent and multi-agent reinforcement learning. We then propose the first
distributed reinforcement learning framework called DDAL (Decentralised
Distributed Asynchronous Learning) designed for group-agent reinforcement
learning. We show through experiments that DDAL achieved desirable performance
with very stable training and has good scalability.
