Averting A Crisis In Simulation-Based Inference
  We present extensive empirical evidence showing that current Bayesian
simulation-based inference algorithms are inadequate for the falsificationist
methodology of scientific inquiry. Our results collected through months of
experimental computations show that all benchmarked algorithms -- (S)NPE,
(S)NRE, SNL and variants of ABC -- may produce overconfident posterior
approximations, which makes them demonstrably unreliable and dangerous if one's
scientific goal is to constrain parameters of interest. We believe that failing
to address this issue will lead to a well-founded trust crisis in
simulation-based inference. For this reason, we argue that research efforts
should now consider theoretical and methodological developments of conservative
approximate inference algorithms and present research directions towards this
objective. In this regard, we show empirical evidence that ensembles are
consistently more reliable.
