Deep Koopman Operator with Control for Nonlinear Systems
  Recently Koopman operator has become a promising data-driven tool to
facilitate real-time control for unknown nonlinear systems. It maps nonlinear
systems into equivalent linear systems in embedding space, ready for real-time
linear control methods. However, designing an appropriate Koopman embedding
function remains a challenging task. Furthermore, most Koopman-based algorithms
only consider nonlinear systems with linear control input, resulting in lousy
prediction and control performance when the system is fully nonlinear with the
control input. In this work, we propose an end-to-end deep learning framework
to learn the Koopman embedding function and Koopman Operator together to
alleviate such difficulties. We first parameterize the embedding function and
Koopman Operator with the neural network and train them end-to-end with the
K-steps loss function. Then, an auxiliary control network is augmented to
encode the nonlinear state-dependent control term to model the nonlinearity in
the control input. This encoded term is considered the new control variable
instead to ensure linearity of the modeled system in the embedding system.We
next deploy Linear Quadratic Regulator (LQR) on the linear embedding space to
derive the optimal control policy and decode the actual control input from the
control net. Experimental results demonstrate that our approach outperforms
other existing methods, reducing the prediction error by order of magnitude and
achieving superior control performance in several nonlinear dynamic systems
like damping pendulum, CartPole, and the seven DOF robotic manipulator.
