Joint Shapley values: a measure of joint feature importance
  The Shapley value is one of the most widely used measures of feature
importance partly as it measures a feature's average effect on a model's
prediction. We introduce joint Shapley values, which directly extend Shapley's
axioms and intuitions: joint Shapley values measure a set of features' average
contribution to a model's prediction. We prove the uniqueness of joint Shapley
values, for any order of explanation. Results for games show that joint Shapley
values present different insights from existing interaction indices, which
assess the effect of a feature within a set of features. The joint Shapley
values provide intuitive results in ML attribution problems. With binary
features, we present a presence-adjusted global value that is more consistent
with local intuitions than the usual approach.
