Finite-Bit Quantization For Distributed Algorithms With Linear
  Convergence
  This paper studies distributed algorithms for (strongly convex) composite
optimization problems over mesh networks, subject to quantized communications.
Instead of focusing on a specific algorithmic design, a black-box model is
proposed, casting linearly convergent distributed algorithms in the form of
fixed-point iterates. The algorithmic model is equipped with a novel random or
deterministic Biased Compression (BC) rule on the quantizer design, and a new
Adaptive encoding Nonuniform Quantizer (ANQ) coupled with a
communication-efficient encoding scheme, which implements the BC-rule using a
finite number of bits (below machine precision). This fills a gap existing in
most state-of-the-art quantization schemes, such as those based on the popular
compression rule, which rely on communication of some scalar signals with
negligible quantization error (in practice quantized at the machine precision).
A unified communication complexity analysis is developed for the black-box
model, determining the average number of bits required to reach a solution of
the optimization problem within a target accuracy. It is shown that the
proposed BC-rule preserves linear convergence of the unquantized algorithms,
and a trade-off between convergence rate and communication cost under ANQ-based
quantization is characterized. Numerical results validate our theoretical
findings and show that distributed algorithms equipped with the proposed ANQ
have more favorable communication cost than algorithms using state-of-the-art
quantization rules.
