Compression of Acoustic Event Detection Models With Quantized
  Distillation
  Acoustic Event Detection (AED), aiming at detecting categories of events
based on audio signals, has found application in many intelligent systems.
Recently deep neural network significantly advances this field and reduces
detection errors to a large scale. However how to efficiently execute deep
models in AED has received much less attention. Meanwhile state-of-the-art AED
models are based on large deep models, which are computational demanding and
challenging to deploy on devices with constrained computational resources. In
this paper, we present a simple yet effective compression approach which
jointly leverages knowledge distillation and quantization to compress larger
network (teacher model) into compact network (student model). Experimental
results show proposed technique not only lowers error rate of original compact
network by 15% through distillation but also further reduces its model size to
a large extent (2% of teacher, 12% of full-precision student) through
quantization.
