A framework for probabilistic weather forecast post-processing across
  models and lead times using machine learning
  Forecasting the weather is an increasingly data intensive exercise. Numerical
Weather Prediction (NWP) models are becoming more complex, with higher
resolutions, and there are increasing numbers of different models in operation.
While the forecasting skill of NWP models continues to improve, the number and
complexity of these models poses a new challenge for the operational
meteorologist: how should the information from all available models, each with
their own unique biases and limitations, be combined in order to provide
stakeholders with well-calibrated probabilistic forecasts to use in decision
making? In this paper, we use a road surface temperature example to demonstrate
a three-stage framework that uses machine learning to bridge the gap between
sets of separate forecasts from NWP models and the 'ideal' forecast for
decision support: probabilities of future weather outcomes. First, we use
Quantile Regression Forests to learn the error profile of each numerical model,
and use these to apply empirically-derived probability distributions to
forecasts. Second, we combine these probabilistic forecasts using quantile
averaging. Third, we interpolate between the aggregate quantiles in order to
generate a full predictive distribution, which we demonstrate has properties
suitable for decision support. Our results suggest that this approach provides
an effective and operationally viable framework for the cohesive
post-processing of weather forecasts across multiple models and lead times to
produce a well-calibrated probabilistic output.
