Learning over All Stabilizing Nonlinear Controllers for a
  Partially-Observed Linear System
  We propose a method for learning nonlinear output-feedback controllers for
linear dynamical systems. Our main contribution is an unconstrained
parameterisation of all such stabilizing controllers, based on a recently
developed class of neural network called the recurrent equilibrium network
(REN) and a nonlinear version of the Youla parameterization. This unconstrained
parameterization significantly simplifies controller learning as any
unconstrained optimization procedure can be applied. In the reinforcement
learning context in which gradients are unavailable, simple approximate
gradient methods based on random search can be used without risking
instability. In both cases stability is guaranteed by construction. Simulation
studies show that our method converges faster to better controllers and is more
scalable than existing methods.
