Wavelet Networks: Scale Equivariant Learning From Raw Waveforms
  Inducing symmetry equivariance in deep neural architectures has resolved into
improved data efficiency and generalization. In this work, we utilize the
concept of scale and translation equivariance to tackle the problem of learning
on time-series from raw waveforms. As a result, we obtain representations that
largely resemble those of the wavelet transform at the first layer, but that
evolve into much more descriptive ones as a function of depth. Our empirical
results support the suitability of our Wavelet Networks which with a simple
architecture design perform consistently better than CNNs on raw waveforms and
on par with spectrogram-based methods.
