Stochastic Saddle Point Problems with Decision-Dependent Distributions
  This paper focuses on stochastic saddle point problems with
decision-dependent distributions. These are problems whose objective is the
expected value of a stochastic payoff function, where random variables are
drawn from a distribution induced by a distributional map. For general
distributional maps, the problem of finding saddle points is in general
computationally burdensome, even if the distribution is known. To enable a
tractable solution approach, we introduce the notion of equilibrium points --
which are saddle points for the stationary stochastic minimax problem that they
induce -- and provide conditions for their existence and uniqueness. We
demonstrate that the distance between the two solution types is bounded
provided that the objective has a strongly-convex-strongly-concave payoff and a
Lipschitz continuous distributional map. We develop deterministic and
stochastic primal-dual algorithms and demonstrate their convergence to the
equilibrium point. In particular, by modeling errors emerging from a stochastic
gradient estimator as sub-Weibull random variables, we provide error bounds in
expectation and in high probability that hold for each iteration. Moreover, we
show convergence to a neighborhood almost surely. Finally, we investigate a
condition on the distributional map -- which we call opposing mixture dominance
-- that ensures that the objective is strongly-convex-strongly-concave. We
tailor the convergence results for the primal-dual algorithms to this opposing
mixture dominance setup.
