Any-Width Networks
  Despite remarkable improvements in speed and accuracy, convolutional neural
networks (CNNs) still typically operate as monolithic entities at inference
time. This poses a challenge for resource-constrained practical applications,
where both computational budgets and performance needs can vary with the
situation. To address these constraints, we propose the Any-Width Network
(AWN), an adjustable-width CNN architecture and associated training routine
that allow for fine-grained control over speed and accuracy during inference.
Our key innovation is the use of lower-triangular weight matrices which
explicitly address width-varying batch statistics while being naturally suited
for multi-width operations. We also show that this design facilitates an
efficient training routine based on random width sampling. We empirically
demonstrate that our proposed AWNs compare favorably to existing methods while
providing maximally granular control during inference.
