ClusterFace: Joint Clustering and Classification for Set-Based Face
  Recognition
  Deep learning technology has enabled successful modeling of complex facial
features when high quality images are available. Nonetheless, accurate modeling
and recognition of human faces in real world scenarios `on the wild' or under
adverse conditions remains an open problem. When unconstrained faces are mapped
into deep features, variations such as illumination, pose, occlusion, etc., can
create inconsistencies in the resultant feature space. Hence, deriving
conclusions based on direct associations could lead to degraded performance.
This rises the requirement for a basic feature space analysis prior to face
recognition. This paper devises a joint clustering and classification scheme
which learns deep face associations in an easy-to-hard way. Our method is based
on hierarchical clustering where the early iterations tend to preserve high
reliability. The rationale of our method is that a reliable clustering result
can provide insights on the distribution of the feature space, that can guide
the classification that follows. Experimental evaluations on three tasks, face
verification, face identification and rank-order search, demonstrates better or
competitive performance compared to the state-of-the-art, on all three
experiments.
