Predict and Optimize: Through the Lens of Learning to Rank
  In the last years predict-and-optimize approaches, also known as
decision-focussed learning, have received increasing attention. In this
setting, the predictions of machine learning models are used as estimated cost
coefficients in the objective function of a discrete combinatorial optimization
problems for decision making. Predict-and-optimize approaches propose to train
the ML models, often neural network models, by directly optimizing the quality
of decisions made by the optimization solvers. Based on recent work that
proposed a Noise Contrastive Estimation loss over a subset of the solution
space, we observe that predict-and-optimize can more generally be seen as a
learning-to-rank problem. That is, the goal is to learn an objective function
that ranks the feasible points correctly. This approach is independent of the
optimization method used and of the form of the objective function. We develop
pointwise, pairwise and listwise ranking loss functions, which can be
differentiated in closed form given a subset of solutions. We empirically
investigate the quality of our generic method compared to existing
predict-and-optimize approaches with competitive results. Furthermore,
controlling the subset of solutions allows controlling the runtime
considerably, with limited effect on regret.
