AEFE: Automatic Embedded Feature Engineering for Categorical Features
  The challenge of solving data mining problems in e-commerce applications such
as recommendation system (RS) and click-through rate (CTR) prediction is how to
make inferences by constructing combinatorial features from a large number of
categorical features while preserving the interpretability of the method. In
this paper, we propose Automatic Embedded Feature Engineering(AEFE), an
automatic feature engineering framework for representing categorical features,
which consists of various components including custom paradigm feature
construction and multiple feature selection. By selecting the potential field
pairs intelligently and generating a series of interpretable combinatorial
features, our framework can provide a set of unseen generated features for
enhancing model performance and then assist data analysts in discovering the
feature importance for particular data mining tasks. Furthermore, AEFE is
distributed implemented by task-parallelism, data sampling, and searching
schema based on Matrix Factorization field combination, to optimize the
performance and enhance the efficiency and scalability of the framework.
Experiments conducted on some typical e-commerce datasets indicate that our
method outperforms the classical machine learning models and state-of-the-art
deep learning models.
