Projection based Active Gaussian Process Regression for Pareto Front
  Modeling
  Pareto Front (PF) modeling is essential in decision making problems across
all domains such as economics, medicine or engineering. In Operation Research
literature, this task has been addressed based on multi-objective optimization
algorithms. However, without learning models for PF, these methods cannot
examine whether a new provided point locates on PF or not. In this paper, we
reconsider the task from Data Mining perspective. A novel projection based
active Gaussian process regression (P- aGPR) method is proposed for efficient
PF modeling. First, P- aGPR chooses a series of projection spaces with
dimensionalities ranking from low to high. Next, in each projection space, a
Gaussian process regression (GPR) model is trained to represent the constraint
that PF should satisfy in that space. Moreover, in order to improve modeling
efficacy and stability, an active learning framework has been developed by
exploiting the uncertainty information obtained in the GPR models. Different
from all existing methods, our proposed P-aGPR method can not only provide a
generative PF model, but also fast examine whether a provided point locates on
PF or not. The numerical results demonstrate that compared to state-of-the-art
passive learning methods the proposed P-aGPR method can achieve higher modeling
accuracy and stability.
