Policy Gradient Approach to Compilation of Variational Quantum Circuits
  We propose a method for finding approximate compilations of quantum unitary
transformations, based on techniques from policy gradient reinforcement
learning. The choice of a stochastic policy allows us to rephrase the
optimization problem in terms of probability distributions, rather than
variational gates. In this framework, finding the optimal configuration is done
by optimizing over distribution parameters, rather than over free angles. We
show numerically that this approach can be more competitive than gradient-free
methods, for comparable amounts of resources (i.e. quantum circuit runs).
Another interesting feature of this approach to variational compilation is that
it does not need a separate register and long-range interactions to estimate
the end-point fidelity, which is an improvement over methods which rely on the
Hilbert-Schmidt test. We expect these techniques to be relevant for training
variational circuits in other contexts.
