Nix-TTS: An Incredibly Lightweight End-to-End Text-to-Speech Model via
  Non End-to-End Distillation
  We propose Nix-TTS, a lightweight neural TTS (Text-to-Speech) model achieved
by applying knowledge distillation to a powerful yet large-sized generative TTS
teacher model. Distilling a TTS model might sound unintuitive due to the
generative and disjointed nature of TTS architectures, but pre-trained TTS
models can be simplified into encoder and decoder structures, where the former
encodes text into some latent representation and the latter decodes the latent
into speech data. We devise a framework to distill each component in a non
end-to-end fashion. Nix-TTS is end-to-end (vocoder-free) with only 5.23M
parameters or up to 82\% reduction of the teacher model, it achieves over
3.26$\times$ and 8.36$\times$ inference speedup on Intel-i7 CPU and Raspberry
Pi respectively, and still retains a fair voice naturalness and intelligibility
compared to the teacher model. We publicly release Nix-TTS pretrained models
and audio samples in English (https://github.com/rendchevi/nix-tts).
