Handling Position Bias for Unbiased Learning to Rank in Hotels Search
  Nowadays, search ranking and recommendation systems rely on a lot of data to
train machine learning models such as Learning-to-Rank (LTR) models to rank
results for a given query, and implicit user feedbacks (e.g. click data) have
become the dominant source of data collection due to its abundance and low
cost, especially for major Internet companies. However, a drawback of this data
collection approach is the data could be highly biased, and one of the most
significant biases is the position bias, where users are biased towards
clicking on higher ranked results. In this work, we will investigate the
marginal importance of properly handling the position bias in an online test
environment in Tripadvisor Hotels search. We propose an empirically effective
method of handling the position bias that fully leverages the user action data.
We take advantage of the fact that when user clicks a result, he has almost
certainly observed all the results above, and the propensities of the results
below the clicked result will be estimated by a simple but effective position
bias model. The online A/B test results show that this method leads to an
improved search ranking model.
