Battery Model Calibration with Deep Reinforcement Learning
  Lithium-Ion (Li-I) batteries have recently become pervasive and are used in
many physical assets. To enable a good prediction of the end of discharge of
batteries, detailed electrochemical Li-I battery models have been developed.
Their parameters are typically calibrated before they are taken into operation
and are typically not re-calibrated during operation. However, since battery
performance is affected by aging, the reality gap between the computational
battery models and the real physical systems leads to inaccurate predictions. A
supervised machine learning algorithm would require an extensive representative
training dataset mapping the observation to the ground truth calibration
parameters. This may be infeasible for many practical applications. In this
paper, we implement a Reinforcement Learning-based framework for reliably and
efficiently inferring calibration parameters of battery models. The framework
enables real-time inference of the computational model parameters in order to
compensate the reality-gap from the observations. Most importantly, the
proposed methodology does not need any labeled data samples, (samples of
observations and the ground truth calibration parameters). Furthermore, the
framework does not require any information on the underlying physical model.
The experimental results demonstrate that the proposed methodology is capable
of inferring the model parameters with high accuracy and high robustness. While
the achieved results are comparable to those obtained with supervised machine
learning, they do not rely on the ground truth information during training.
