Towards Security Threats of Deep Learning Systems: A Survey
  Deep learning has gained tremendous success and great popularity in the past
few years. However, deep learning systems are suffering several inherent
weaknesses, which can threaten the security of learning models. Deep learning's
wide use further magnifies the impact and consequences. To this end, lots of
research has been conducted with the purpose of exhaustively identifying
intrinsic weaknesses and subsequently proposing feasible mitigation. Yet few
are clear about how these weaknesses are incurred and how effective these
attack approaches are in assaulting deep learning. In order to unveil the
security weaknesses and aid in the development of a robust deep learning
system, we undertake an investigation on attacks towards deep learning, and
analyze these attacks to conclude some findings in multiple views. In
particular, we focus on four types of attacks associated with security threats
of deep learning: model extraction attack, model inversion attack, poisoning
attack and adversarial attack. For each type of attack, we construct its
essential workflow as well as adversary capabilities and attack goals. Pivot
metrics are devised for comparing the attack approaches, by which we perform
quantitative and qualitative analyses. From the analysis, we have identified
significant and indispensable factors in an attack vector, e.g., how to reduce
queries to target models, what distance should be used for measuring
perturbation. We shed light on 18 findings covering these approaches' merits
and demerits, success probability, deployment complexity and prospects.
Moreover, we discuss other potential security weaknesses and possible
mitigation which can inspire relevant research in this area.
