Distributed Learning for Channel Allocation Over a Shared Spectrum
  Channel allocation is the task of assigning channels to users such that some
objective (e.g., sum-rate) is maximized. In centralized networks such as
cellular networks, this task is carried by the base station which gathers the
channel state information (CSI) from the users and computes the optimal
solution. In distributed networks such as ad-hoc and device-to-device (D2D)
networks, no base station exists and conveying global CSI between users is
costly or simply impractical. When the CSI is time varying and unknown to the
users, the users face the challenge of both learning the channel statistics
online and converge to a good channel allocation. This introduces a multi-armed
bandit (MAB) scenario with multiple decision makers. If two users or more
choose the same channel, a collision occurs and they all receive zero reward.
We propose a distributed channel allocation algorithm that each user runs and
converges to the optimal allocation while achieving an order optimal regret of
O\left(\log T\right). The algorithm is based on a carrier sensing multiple
access (CSMA) implementation of the distributed auction algorithm. It does not
require any exchange of information between users. Users need only to observe a
single channel at a time and sense if there is a transmission on that channel,
without decoding the transmissions or identifying the transmitting users. We
demonstrate the performance of our algorithm using simulated LTE and 5G
channels.
