Monotonic Cardinality Estimation of Similarity Selection: A Deep
  Learning Approach
  Due to the outstanding capability of capturing underlying data distributions,
deep learning techniques have been recently utilized for a series of
traditional database problems. In this paper, we investigate the possibilities
of utilizing deep learning for cardinality estimation of similarity selection.
Answering this problem accurately and efficiently is essential to many data
management applications, especially for query optimization. Moreover, in some
applications the estimated cardinality is supposed to be consistent and
interpretable. Hence a monotonic estimation w.r.t. the query threshold is
preferred. We propose a novel and generic method that can be applied to any
data type and distance function. Our method consists of a feature extraction
model and a regression model. The feature extraction model transforms original
data and threshold to a Hamming space, in which a deep learning-based
regression model is utilized to exploit the incremental property of cardinality
w.r.t. the threshold for both accuracy and monotonicity. We develop a training
strategy tailored to our model as well as techniques for fast estimation. We
also discuss how to handle updates. We demonstrate the accuracy and the
efficiency of our method through experiments, and show how it improves the
performance of a query optimizer.
