Edge modes in self-gravitating disc-planet interactions
  We study the stability of gaps opened by a giant planet in a self-gravitating protoplanetary disc. We find a linear instability associated with both the self-gravity of the disc and local vortensity maxima which coincide with gap edges. For our models, these edge modes develop and extend to twice the orbital radius of a Saturn mass planet in discs with disc-to-star mass ratio >0.06, corresponding to a Toomre Q < 1.5 at the outer disc boundary. Unlike the local vortex-forming instabilities associated with gap edges in weakly or non-self-gravitating low viscosity discs, the edge modes are global and exist only in sufficiently massive discs, but for the typical viscosity values adopted for protoplanetary discs. Analytic modelling and linear calculations show edge modes may be interpreted as a localised disturbance associated with a gap edge inducing activity in the extended disc, through the launching of density waves excited at Lindblad resonances. Nonlinear hydrodynamic simulations are performed to investigate the evolution of edge modes in disc-planet systems. The form and growth rates of unstable modes are consistent with linear theory. Their dependence on viscosity and gravitational softening is also explored. We also performed a first study of the effect of edge modes on planetary migration. We found that if edge modes develop, then the average disc-on-planet torque becomes more positive with increasing disc mass. In simulations where the planet was allowed to migrate, although a fast type III migration could be seen that was similar to that seen in non-self-gravitating discs, we found that it was possible for the planet to interact gravitationally with the spiral arms associated with an edge mode and that this could result in the planet being scattered outwards. Thus orbital migration is likely to be complex and non monotonic in massive discs of the type we consider. 
Min-Kai Lin, John Papaloizou
astro-ph.EP