InceptionXML: A Lightweight Framework with Synchronized Negative
  Sampling for Short Text Extreme Classification
  Automatic annotation of short-text data to a large number of target labels,
referred to as Short Text Extreme Classification, has found numerous
applications including prediction of related searches and product
recommendation tasks. In this paper, we propose a convolutional architecture
InceptionXML which is light-weight, yet powerful, and robust to the inherent
lack of word-order in short-text queries encountered in search and
recommendation tasks. We demonstrate the efficacy of applying convolutions by
recasting the operation along the embedding dimension instead of the word
dimension as applied in conventional CNNs for text classification. Towards
scaling our model to datasets with millions of labels, we also propose
InceptionXML+ framework which improves upon the shortcomings of the recently
proposed dynamic hard-negative mining technique for label shortlisting by
synchronizing the label-shortlister and extreme classifier. InceptionXML+ not
only reduces the inference time to half but is also an order of magnitude
smaller than previous state-of-the-art Astec in terms of model size. Through
our proposed models, we outperform all existing approaches on popular benchmark
datasets.
