Real-time Attention Based Look-alike Model for Recommender System
  Recently, deep learning models play more and more important roles in contents
recommender systems. However, although the performance of recommendations is
greatly improved, the "Matthew effect" becomes increasingly evident. While the
head contents get more and more popular, many competitive long-tail contents
are difficult to achieve timely exposure because of lacking behavior features.
This issue has badly impacted the quality and diversity of recommendations. To
solve this problem, look-alike algorithm is a good choice to extend audience
for high quality long-tail contents. But the traditional look-alike models
which widely used in online advertising are not suitable for recommender
systems because of the strict requirement of both real-time and effectiveness.
This paper introduces a real-time attention based look-alike model (RALM) for
recommender systems, which tackles the challenge of conflict between real-time
and effectiveness. RALM realizes real-time look-alike audience extension
benefiting from seeds-to-user similarity prediction and improves the
effectiveness through optimizing user representation learning and look-alike
learning modeling. For user representation learning, we propose a novel neural
network structure named attention merge layer to replace the concatenation
layer, which significantly improves the expressive ability of multi-fields
feature learning. On the other hand, considering the various members of seeds,
we design global attention unit and local attention unit to learn robust and
adaptive seeds representation with respect to a certain target user. At last,
we introduce seeds clustering mechanism which not only reduces the time
complexity of attention units prediction but also minimizes the loss of seeds
information at the same time. According to our experiments, RALM shows superior
effectiveness and performance than popular look-alike models.
