Distributed Learning in Ad-Hoc Networks: A Multi-player Multi-armed
  Bandit Framework
  Next-generation networks are expected to be ultra-dense with a very high peak
rate but relatively lower expected traffic per user. For such scenario,
existing central controller based resource allocation may incur substantial
signaling (control communications) leading to a negative effect on the quality
of service (e.g. drop calls), energy and spectrum efficiency. To overcome this
problem, cognitive ad-hoc networks (CAHN) that share spectrum with other
networks are being envisioned. They allow some users to identify and
communicate in `free slots' thereby reducing signaling load and allowing the
higher number of users per base stations (dense networks). Such networks open
up many interesting challenges such as resource identification, coordination,
dynamic and context-aware adaptation for which Machine Learning and Artificial
Intelligence framework offers novel solutions. In this paper, we discuss
state-of-the-art multi-armed multi-player bandit based distributed learning
algorithms that allow users to adapt to the environment and coordinate with
other players/users. We also discuss various open research problems for
feasible realization of CAHN and interesting applications in other domains such
as energy harvesting, Internet of Things, and Smart grids.
