Generative Spoken Dialogue Language Modeling
  We introduce dGSLM, the first "textless" model able to generate audio samples
of naturalistic spoken dialogues. It uses recent work on unsupervised spoken
unit discovery coupled with a dual-tower transformer architecture with
cross-attention trained on 2000 hours of two-channel raw conversational audio
(Fisher dataset) without any text or labels. It is able to generate speech,
laughter and other paralinguistic signals in the two channels simultaneously
and reproduces naturalistic turn taking. Generation samples can be found at:
https://speechbot.github.io/dgslm.
