{'fraction_non_alphanumeric': 0.03407870924204779, 'fraction_numerical': 0.014846170362872304, 'mean_word_length': 5.063232285661149, 'pattern_counts': {'":': 0, '<': 1, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Pose Attention-Guided Profile-to-Frontal Face Recognition

In recent years, face recognition systems have achieved exceptional success due to promising advances in deep learning architectures. However, they still fail to achieve expected accuracy when matching profile images against a gallery of frontal images. Current approaches either perform pose normalization (i.e., frontalization) or disentangle pose information for face recognition. We instead propose a new approach to utilize pose as an auxiliary information via an attention mechanism. In this paper, we hypothesize that pose attended information using an attention mechanism can guide contextual and distinctive feature extraction from profile faces, which further benefits a better representation learning in an embedded domain. To achieve this, first, we design a unified coupled profile-to-frontal face recognition network. It learns the mapping from faces to a compact embedding subspace via a class-specific contrastive loss. Second, we develop a novel pose attention block (PAB) to specially guide the pose-agnostic feature extraction from profile faces. To be more specific, PAB is designed to explicitly help the network to focus on important features along both channel and spatial dimension while learning discriminative yet pose invariant features in an embedding subspace. To validate the effectiveness of our proposed method, we conduct experiments on both controlled and in the wild benchmarks including Multi-PIE, CFP, IJBC, and show superiority over the state of the arts.


Introduction
The advent of deep convolutional neural networks (CNNs) has led to promising achievement in unconstrained face recognition and verification techniques [36,39]. It has even surpassed the human performance on several benchmark datasets [32]. However, a challenge that still remains to be solved, is that of extreme pose variations in profile faces. It degrade frontal-to-profile face verification accuracy by more than 10% compared to frontal-to-frontal matching accuracy [33]. The most prominent factors contributing to this performance degradation can be classified into three categories: • Facial appearance distortion: In comparison to controlled environment, real world profile faces have different imaging conditions besides pose such as expression, occlusion and illumination variations as shown in Figure 1. These variations cause substantial changes in facial appearance, which indicates loss of consistent information useful for face recognition. • Missing semantic consistency: When a face view is changed from frontal to profile, the position and shape of facial texture varies nonlinearly. It inevitably introduces loss of semantic correspondence in 2D images along with confusion in interpersonal texture differences [10]. In consequence, extracted features from two images at different poses are no longer similar and cannot provide high matching accuracy as expected in conventional face recognition methods. • Imbalance pose distributions: Deep learning based face recognition algorithms extensively rely on very large datasets, which usually suffer from uneven pose distributions. This data imbalance continues to force the model to lean towards frontal images than profile face image of a person. It results in poor matching accuracy during frontal-to-profile verification. In contrast, human can easily identify faces with extreme pose variations without significant drop in accuracy.
To address this performance gap between human and automatic models, traditional methods apply several local descriptors such as Gabor [9], Haar [42], and LBP [1] to measure local distortions and then adopt metric learning techniques [5,43]. On the other hand, another research com-munity emphasizes on frontal view synthesis across poses. They utilize 3D geometrical transformations [15,39,55] to reduce pose variations. Moreover, multiple novel architectures have been proposed [?, 28,53] for face normalization, which aligns faces to a canonical pose. Although, they show impressive performance at normalizing small pose faces, their accuracy drops severely under extreme pose conditions. To handle this problem, some researchers opt on learning pose-robust features [2,34,50] for multi-view face images. Among them, Cao et al. [2] propose a lightweight DREAM block to perform "frontalization" in feature space, while others explore multi-task learning to perform poseinvariant face recognition (PIFR) [12,50].
In this paper, we introduce a novel method to learn discriminative pose-invariant representation in a deep feature embedding subspace without performing profile face normalization (frontalization) or learning disentangled features. Instead, we explicitly deal with the pose variability by incorporating it as an "auxiliary information" via an attention mechanism to the feature extraction network. We hypothesize that learning with pose information allows for better generalization of the primary task by assisting it to focus on the current context and ignore unnecessary information. To this end, we first develop a deep coupled profile to frontal network using the contrastive loss, which is able to learn to map faces into a common compact 512dimensional latent embedding subspace. Second, to incorporate pose as an auxiliary signal, we propose an easy-toimplement pose attention block (PAB), which automatically infers significant features from profile faces along channel and spatial axes in deeper layers of the network. In other words, PAB is designed to empirically guide to learn discriminative and pose-invariant features in an embedding subspace. Moreover, we also investigate the capability of these learned embedding features via a generative adversarial network (GAN) to synthesize a canonical (frontal) view. In a summary, this paper offers the following contributions: • A novel coupled profile to frontal PIFR model utilizing pose as an auxiliary information (i.e., pose attention) is developed.
• A pose attention block (PAB) using a pretrained poseestimation network is proposed to guide a discriminative and pose-invariant feature learning framework in an embedding subspace.
• Extensive experiments on different benchmark datasets and comparison to other state-of-the-art methods have been performed to validate the effectiveness of our proposed method.
• Capability of the embedding features learned in our proposed network is explored for frontal face synthesis via a GAN model, which indicates its usefulness in different face analysis tasks apart from face recognition.

Face Frontalization
Face frontalization has become an extremely challenging task due to the self-occlusion that exists in 2D projections of the input face with large pose variations. To address this problem, traditional methods use 3D based models [15,24,55], statistical approaches [30], and deep learning based methods [21,48,49,57] for face frontalization. Hassner et al. [15] used a 3D face model to generate frontal shape of all input faces. Although it is proved to be efficient in face frontalization task, it cannot achieve expected accuracy for profile and near profile faces, specifically faces with yaw angle greater than 60 • . A statistical model is proposed in [30], which solves a constrained low-rank minimization problem to jointly perform frontal view reconstruction and landmark detection. Recently, deep learning based methods have shown outstanding performances in frontal face synthesis. In [48], a recurrent transform unit is proposed to reconstruct discrete 3D views. Yim et al. [49] applied a concatenated network structure to rotate a non-frontal face, where they regularize the output by image level reconstruction loss. With the emergence of GAN, researchers have concentrated more on GAN-based methods, which has advanced the performance of face frontalization methods. However, face frontalization is considered as an image-level pose-invariant representation, which can improve PIFR performance mostly for face images at near frontal or half profile.

Pose Invariant Representation Learning
Pose-invariant feature representation has been recently used as a mainstay of many face recognition tasks. Earlier works apply canonical correlation analysis (CCA) [14] to analyze the shared characteristics among pose-invariant samples. Recent deep learning based approaches focus on several aspects while training a network. To name, in [57], a deep neural network is trained to separate face identity from viewpoints. Kan et al. [22] propose feature pooling across different poses to allow a single network structure for inputs at multiple pose views. To disentangle poses in feature representation, several methods [50,56] carefully factorize out the non-identity part. Authors in [6,25] mostly consider fusing information at the feature level or distance metric level. On the other hand, Cao et al. [2] propose a pose discrepancy corrector module. Recently many researchers [17,41] followed them to empirically perform frontalization in feature space. Contrary to these approaches, we mostly concentrate to utilize pose as side information via an attention mechanism and guide the network to learn discriminative, and pose-invariant features in an embedding subspace.

Proposed Method
Here, we describe our proposed method which offers a new perspective of learning pose-invariant feature representation via incorporating pose specific auxiliary information into our deep profile to frontal face verification network. Inspired by the success of FaceNet face recognition system [32], we develop a deep coupled framework as shown in Figure 2. It learns mapping from both frontal and profile faces to a compact feature embedding subspace. Since profile faces have large pose variations, we use this angular knowledge to explore how auxiliary pose information can improve the embedding feature representation for profile faces. To implement this perspective, we propose the PAB module, which sequentially refine features in both channel and spatial dimension. In this section, first we discuss the implementation technique of our PAB module, and then we detail how we integrate the auxiliary pose information to our deep coupled network via a channel and spatial attention mechanism.

Pose Attention Block (PAB)
We adopt a robust pose estimation network, i.e., Hopenet [29], which has been trained on a large synthetically expanded dataset 300W-LP [54]. Hopenet uses ResNet50 as the backbone of their architecture and adds three fully connected layers to predict the intrinsic Euler angles (yaw, pitch and roll) directly from input off-angle face images as illustrated in Figure 2. To implement our proposed PAB module, we do not use these angles, instead we take the feature map of size 2048×7×7 from the last convolutional layer of Hopenet. It already provides us with more complex abstract Our proposed PAB module consists of two sequential attention modules: adaptive channel attention module (ACAM), and spatial attention module (SpAM), which aggregate pose information through inferring a 1D channel attention map and a 2D spatial attention map. Figure 3 illustrates the framework of the proposed PAB, which is integrated with our deep coupled learning framework in Figure  2. We now discuss each component in detail.

Adaptive Channel Attention Module (ACAM)
Given an input feature map, x R C×H×W of size 2, 048 × 7×7, ACAM applies an average-pooling and a max-pooling operation like in CBAM [45] to learn inter-channel dependencies and generates two different spatial context descriptors: x c avg , and x c max , respectively. To integrate spatial information, they are forwarded to a shared multilayer perceptron (M LP 1 ), which is typically a two layer fully connected network as shown in Figure 3(a). Since our ultimate goal is to distill features for the face recognition task along the channel dimension in order to highlight "which of the feature maps are relevant to shape", we set hidden-layer size to 128 and output in a way that it can generate a 1D channel attention map of 1, 792 consistent with the feature map depth size in profile network. After that, we use elementwise summation to merge feature vectors obtained from the shared M LP 1 network. In a summary, the channel attention is computed as follows: where σ is the non-linear activation function.

Spatial Attention Module (SpAM)
Following CBAM [45], we design our spatial attention module (SpAM) to focus on the informative region in the spatial domain. In our SpAM, we compute a 2D spatial attention map of size 3 × 3 to be consistent with the feature map size of our FR network as follows: where F c (x) denotes channel refined features in Figure  3(b), which is obtained using another shared M LP 2 . conv2D refers to the convolution on the concatenation of the average pooled feature map, F s c (x) avg , and max pooled feature map, F s c (x) max , along the channel axes, which ensures inter-spatial relationship of features.

Profile to Frontal Coupled Subspace Learning Network
Our goal is to learn a discriminative, pose-invariant feature representation from a pair of face images to a compact embedding subspace such that we can perform matching of profile face images with respect to a gallery of frontal face images in the embedded domain. Therefore, to learn a rich feature representation, we propose a coupled deep convolutional network guided by a pose attention module. Our method adopts a variant of InceptionResnet [37] architecture that is used in FaceNet [32] as the core element of our network. It is pretrained on VGGFace2 [3].
The model structure in Figure 2 illustrates that a pair of images goes through the coupled network consisting of two dedicated branches to extract features from both frontal and profile images. Since there exists pose variations in profile faces, we hypothesize that we can leverage pose as an auxiliary information to improve the ability of extracting highly discriminative features from these profile faces. To accomplish this, the profile image is also fed to a pretrained Hopenet pose estimation network. It provides a pose attended information via our PAB module to sequentially distills features along both channel and spatial dimension of our profile encoder.
Previous section explains the block design of our PAB module. It consists of two sub-modules: (1) ACAM, that generates a 1D channel attention map of 1, 792 to refine the feature maps (1, 792 × 3 × 3) of our profile coupled network along the channel dimension, and (2) SpAM, which produces a 2D spatial attention map of size 3x3 to spatially attend the informative region in the feature maps of our profile network as in Figure 2. For more details note that, both 1D and 2D attention maps are multiplied with the feature maps of the profile network for adaptive feature refinement.
Such sharing of pose as an auxiliary information during feature extraction from profile faces results in informative and task relevant features, which otherwise would not have been attained from training only with a massive labelled faces. In addition, it also allows for better generalization of the PIFR task by looking at new interpretations of the features. Once the embeddings are established as feature vectors, we optimize the network via class-specific contrastive loss. It tries to minimize squared Euclidean distance between the features of positive pairs (i.e., when profile and frontal image share the same identity) and maximize it for negative pairs (i.e., when profile and frontal image comes from different identities).

Loss Function
Our goal is to learn a compact 512-D embedding subspace by coupling two mapping networks, one for frontal and another one for profile face image, via contrastive loss, L cont [7]. We compute this loss metric, L cont over a set of genuine (i.e., a profile face image of a subject with its corresponding frontal face image) and imposter (i.e., a profile face image of a subject and a frontal face image of a different subject) pairs such that images belonging to the same identity (genuine pair) are embedded as close as possible. Simultaneously, images of different identities are pushed away from each other in the common embedded subspace. The contrastive loss function is formulated as: where x i p and x j f denote the input profile and frontal face images, respectively. The variable Y is a binary label, which is equal to 0 if x i p and x j f belong to the same class (i.e., genuine pair), and equal to 1 if x i p and x j f belong to the different class (i.e., impostor pair). z(.) is used to denote the mapping function for x i p and x j f into a compact embedding subspace. To "tighten" the constraint, m is used as contrastive margin.
The Euclidean distance, D z , between the embedding features, z(x i p ) and z(x j f ), is given by: Therefore, if Y = 0 (i.e., genuine pair), then the contrastive loss function (L cont ) is given as: and if Y = 1 (i.e., impostor pair), then contrastive loss function (L cont ) is : Thus, the total loss to optimize the entire network is denoted by L total for coupling both the profile and frontal face in the embedded domain: where N is the number of training samples. The main purpose of using the contrastive loss is to be able to use the class labels, and margin to ensure discriminative embedding subspace, which may not be obtained with some other metric such as the Euclidean distance. Finally, we use this pose attended discriminative embedding subspace for matching of the profile images with the frontal images.

Experiments
In this section, we describe our implementation details and the datasets that we have used to conduct our experiments. To evaluate the performance of our proposed PIFR network, we experiment under two settings: (1) face identification on controlled Multi-PIE [13] face dataset, and (2) face verification/identification on in-the-wild datasets including CFP [33] and IJB-C [26] with their official evaluation protocols. In addition, we also report face recognition accuracy compared to several state-of-the-art results on these datasets.

Datasets
Multi-PIE: The Multi-PIE dataset is the largest dataset released for multi-view face recognition with respect to controlled variations in illumination and expressions across different poses. It contains 7,54,204 images of 337 identities, captured at 15 view points ranging from −90 • ∼ +90 • , over 20 illumination conditions. To evaluate our proposed method for identification task, we conduct experiments under two settings following protocol used in [53] for fair comparison. Setting 1 includes images only from session 1 in the Multi-PIE dataset, which has 250 subjects. For training, we choose first 150 identities with 11 poses within ±90 • and 20 illuminations. During testing, one frontal view with neutral expression and illumination (i.e., ID 07) is used in the gallery for each of the remaining 100 identities and other images are considered as probe images. Setting 2 includes images only with neutral expression over all four sessions providing 337 identities. To train our network, we use first 200 identities, while rest of the 137 IDs have been used for testing. We maintain similar setup as setting 1 for our gallery and probe. CFP: The Celebrities in Frontal-Profile (CFP) dataset is introduced to handle large-pose variations. It contains identities of 500 celebrities, which have been collected under constrained (i.e., images at different pose, illumination and expression) and unconstrained (i.e., images collected from the Internet) settings. For each celebrity, it includes 10 frontal and 4 profile images. Following their standard 10-fold evaluation protocol [33], we split the dataset into 10 folds, each with 350 genuine and 350 impostor pairs to perform both frontal-to-frontal (FF), and frontal-to-profile (FP) verification task. IJB-C: The IARPA Janus Benchmark-C (IJB-C) [26] face dataset has been released to advance the unconstrained face recognition by modeling more practical face recognition use cases. It is an extension to the publicly available IJB-B [44] dataset, which contains 3, 531 subjects with extreme variations in expression, illumination, geographic origin, and more. In total, it has 31, 334 still images and 1, 17, 542 video frames collected in unconstrained settings with different protocols. To evaluate our algorithm's ability, we perform both face verification (1:1), and identification (1:N) tasks following their protocol.

Implementation Details
To implement our proposed coupled learning framework, we have used InceptionResnet-v1 [37] pretrained on VGG-Face2 dataset. Since it is difficult to train the entire network from scratch, we freeze all the trained layers before average pooling for both frontal and profile mapping modules as shown in Figure 2. At the same time, our PAB module provides a pose attended 1D channel attention map, and a 2D spatial attention map to assist the profile network to use only the relevant features while extracting deep features from the profile faces. Therefore, the gradient also flows back through this PAB module to update its weights during optimization. Note that, since misleading pose information can misguide the training, we don't train Hopenet, which has been already trained on a very large dataset, and proved to be an efficient pose estimation model. The entire framework has been implemented in Pytorch. We used a batch size of 32 and the Adam optimizer [23] with first-order momentum of 0.5, and learning rate of 10 −3 . For training, we generate same number of genuine, and impostor pairs from frontal, and profile images of the same/different subjects to avoid biasness towards positive pairs.

Evaluations on the Multi-PIE Benchmark
To show the effectiveness of our proposed method, first we evaluate our model on a controlled database, Multi-PIE for profile-to-frontal face recognition task under two different settings. We compare our method with several state-ofthe-art PIFR algorithms including HPN [11], c-CNN [47], PIM [53], FNM [53], and competitive GAN-based methods : TP-GAN [18], CAPG-GAN [16], and PF-cpGAN [38]. Table 1 shows our rank-1 recognition accuracy compared to other approaches across full yaw variations and illuminations under setting-1. For this experimental setup, we consistently achieve 100% accuracy over yaw angles < 75 • , while outperforming other baselines. Even under extreme pose (i.e., ±75 • , and ±90 • ), when compared to CAPG-GAN, and PF-cpGAN, we significantly outperform them by achieving average 11.85%, and 3% higher accuracy, respectively. Compared to the performance of our backbone coupled network (without attention), we achieve 13.82% more recognition accuracy for full profile face (±90 • ). We also assess the performance of our proposed network on faces in Multi-PIE under setting-2, which consists of more challenging face identities than setting-1. Evaluation results, shown in Table 2 suggests that our proposed PAB module does assist the face recognition network to achieve 2.3%, and 2.7% increase over the best performing method, PIM [53] in the large pose variations; ±90 • , and ±75 • , respectively. Apart from this, our network achieves superior performance over the other baseline models [18,51,53] in all yaw angles. Similar to setting 1, we note 14.0% improvement on backbone (without attention) for ±90 • profile faces as well. These improvements indicate the efficacy of our method for PIFR in a constrained environment.

Evaluations on the CFP Benchmark
We evaluate our proposed method on the Celebrities in Frontal-Profile (CFP) dataset to analysis face verification in unconstrained environment. To perform evaluation, we follow the standard 10-fold protocol like other approaches in the literature. We report the mean and standard deviation of accuracy, and Equal Error Rate (EER) over the 10 splits for both frontal-frontal (FF) and frontal-profile (FP) face verification settings. Table 3 shows a comparison of our method with other state-of-the-art face recognition performance on the CFP benchmark datatset. For fair comparison, first, we consider three different hand-crafted feature extraction techniques: Hog [8], LBP [1], and Fisher Vector [35] along with metric learning techniques Sub-SML [4], and diagonal metric learning (DML) [4]. To compare against deep learning based approaches, we include Deep Features [6], Triplet Embedding [31], Light CNN-29 [46], and recently proposed GAN-based latent feature learning framework, PF-cpGAN [38].
From the results summarized in Table 3, we observe that our proposed method outperforms human performance for both FF and FP settings. It also makes substantial improvement over the conventional hand-crafted features by achieving average 18% higher accuracy with 24% decrease in EER for more challenging FP setting. In addition, when compared to best performing PF-cpGAN, our proposed method improves the accuracy by 1.89% and reduce EER significantly by 5% for FP verification. We also improve on the Table 4: Performance evaluation on IJB-C benchmark. Symbol '-' indicates that the metric is not available for that protocol.

Evaluations on the IJB-C Benchmark
We further evaluate face recognition (i.e., verification and identification) on another challenging benchmark IJB-C, to validate the superiority of our proposed method in unconstrained environment. We compare with the recent state-of-the-art algorithms CFR-GAN [20], FNM [28], and PR-REM [2], along with prior works [27,32] in [26] for fair evaluation. As shown in Table 4, for profile to frontal verification, we improve the genuine accept rate (GAR) by approximately 7.69%, and 2.1% at the false accept rate (FAR) of 0.001 compared to recent works [20,28]. Moreover, we also obtain outstanding performances on identification. Specifically, we achieve 1.73%, and 3.23% higher recognition accuracy for rank-1 in comparison to the FNM, and PR-REM, respectively. To show the significant contribution of our proposed PAB module, we compare our results with the backbone network (without attention). It shows our idea of incorporating pose information boosts FP verification performance by 2.60% at 0.001 FAR, and identification accuracy by 8.53% for rank-1.

Frontal Face Reconstruction from Pose-Invariant Features Learned in Deep Subspace
The purpose of our proposed PAB is to enhance the recognition performance of our coupled deep subspace learning framework via contributing in feature refinement. In addition, class-specific contrastive loss has been used to push the network achieve pose-invariance in the embedding feature domain. To validate our hypothesis, previous sections show comprehensive analysis on verification and identification task for both constrained and in the wild conditions. Apart from recognition task, there are many other scopes to utilize the feature vector learned in the deep subspace. For instance, if we could reconstruct frontal face from the deep features of its corresponding profile face, it can be used in many face analysis tasks including emotion detection, expression tracking etc. Moreover, it has broad applications in vision, graphics, and robotics. Therefore,  to demonstrate the usefulness of our proposed method, we adopt a GAN model [40] for reconstruction. To accomplish this task, we modify residual network used in the twopathway encode-decoder architecture proposed by Tian et al. [40]. We consider their decoder module with the discriminator network for frontal face synthesis. For training/testing, we select profile and corresponding frontal images from setting 1 of Multi-PIE dataset. First, we extract 512-D embedding feature vector from our proposed PAB guided pose-invariant face recognition network for each of the profile image in the trainset. After that, these profile feature vectors are given as input to the decoder and corresponding frontal faces with no expression and neutral illumination are used as target, which force the network adversarially learn the image distribution of the frontal faces.
To generate identity preserving, high visual quality frontal faces from its profile deep features, we incorporate pixelwise L 1 reconstruction error, VGG-16 based Perceptual loss [19], and Light CNN-29 [46] network for identification loss along with adversarial loss. In Figure 4, we show some representative results on Multi-PIE test samples. Reconstruction results indicate that our proposed pose attentionguided coupled framework is able to provide robust, and discriminative features in the deep subspace for multiple use of profile to frontal matching in the embedded domain as well as high-fidelity frontal face synthesis.

Embedding Dimensionality
To represent each face into a tightly compact embedding subspace, we explore different embedding dimensionalities:  128, 256, and 512. Experimental results reported in Table  5 illustrates that the network is able to extract features enriched with relevant information in 512 dimension.

Attention Map
In this section, we show the effective design approach of our proposed pose attention mechanism to efficiently guide the face recognition network. We first focus on computing different approaches of SpAM in the pose attention block, PAB. Finally, we observe different combination of channel and spatial attention in deep profile feature extraction. Each experiment has been explained in the following sections.

Spatial Attention
Given the channel-wise refined features, we explore two different approaches to generate a 2D spatial attention map: (1) first, we use average-and max-pooling across the channel axes, to generate two 2D descriptors, and then apply standard 1 × 1 convolution followed by a max pool layer.
(2) second, we similarly generate two 2D descriptors, and apply 3 × 3 convolution with stride 2, which proves to be outperforming the first approach. We report the comparison of two methods in Table 6.

Arrangement of Spatial and Channel Attention
In this experiment, we apply channel and spatial attention in two different ways. From a spatial viewpoint, the channel attention works to attend global information whereas the spatial attention focuses on local neighbourhood. However, the network response can be different upon the sequential order of each attention mechanism. Table 7 summarizes the recognition performance on Multi-PIE for different attention sequences. The results show that the we achieve better performance when we use channel-spatial order rather than the vise versa.

Visualization
As shown in Figure 5, when compared to the backbone network (without attention), the similarity distributions of the genuine pairs and the imposter pairs in our proposed coupled PIFR network are more compact and distinct for

Conclusion
In this paper, we propose a novel perspective of leveraging pose as auxiliary information to guide a coupled profile to frontal deep subspace learning framework for PIFR. A PAB module is designed to distill pose-specific useful features from profile faces in deep convolutional layers. To ensure discriminative, pose-invariant feature representation into a compact embedding subspace, we couple both profile and frontal face images via a contrastive loss, which maximizes the pair-wise similarity in the embedded domain. We perform a comprehensive experiments on several benchmark datasets both in controlled and uncontrolled environmental settings to evaluate the robustness of our model. The results indicate that our model remarkably outperform other state-of-the-art algorithms for profile-to-frontal poseinvariant face recognition. In addition, we conduct a quick experiment to explore the generative capability of the embedding features learned in deep subspace of our network. Moreover, we also investigate embedding dimensionality and attention mechanisms from different perspectives to offer an effective design choice of our proposed network.

Acknowledgements
This research is based upon work supported by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), via IARPA R&D Contract No. 2022-21102100001. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon.