{'fraction_non_alphanumeric': 0.03307992603246353, 'fraction_numerical': 0.012031139419674451, 'mean_word_length': 4.814947564051507, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Boosting Archimedes optimization algorithm using trigonometric operators based on feature selection for facial analysis

Due to technical advancements and the proliferation of mobile applications, facial analysis (FA) of humans has recently become an important area for computer vision research. FA investigates a variety of difficulties, including gender recognition, facial expression recognition, age and race recognition, with the goal of automatically comprehending social interactions. Due to the dimensional challenge posed by pre-trained CNN networks, the scientific community has developed numerous techniques inspired by biology, swarm intelligence theory, physics, and mathematical rules. This article presents a gender recognition system based on scAOA, that is a modified version of the Archimedes optimization algorithm (AOA). The latest variant (scAOA) enhances the exploitation stage by using trigonometric operators inspired by the sine cosine algorithm (SCA) in order to prevent local optima and to accelerate the convergence. The main purpose of this paper is to apply scAOA to select the relevant deep features provided by two pretrained models of CNN (AlexNet & ResNet) to recognize the gender of a human person categorized into two classes (men and women). Two datasets are used to evaluate the proposed approach (scAOA): the Brazilian FEI dataset and the Georgia Tech Face dataset (GT). In terms of accuracy, Fscore and statistical test, the comparison analysis demonstrates that scAOA outperforms other modern and competitive optimizers such as AOA, SCA, Ant lion optimizer (ALO), Salp swarm algorithm (SSA), Grey wolf optimizer (GWO), Simple genetic algorithm (SGA), Grasshopper optimization algorithm (GOA) and Particle swarm optimizer (PSO).


Introduction
Human vision enables the performance of multiple tasks concurrently and rapidly, most notably facial detection, gender recognition, and distinguishing the state of mind that distinguishes a human being from others.
Gender recognition automation is a key difficulty for scientists, and it has a considerable impact on the commercial sector and video surveillance. For example, shopping centers want to know the sales rate and the demographics of the individuals who purchase their items, notably their gender, age, and origins, in order to enhance sales. Additionally, another area necessitates the use of gender identification to identify suspicious individuals filmed by security cameras in broad locations such as airports, retail malls, and petrol stations. To help reduce the time spent searching for the suspected perpetrator, the gender identification application can make a significant contribution to resolving this issue, particularly in crucial scenarios such as suicide bombings or airport attacks. Additionally, the current scenario with the Covid-19 outbreak has compelled people to conceal the fact that gender identification automation plays a critical role in our lives.
According to the research, human detection rate is less than 95%, which complicates automatic gender recognition. Numerous problems are explored in this subject, including rotated, occluded faces and the human who resembles women with long hair, which has a significant impact on gender recognition performance.
Gender recognition, in general, necessitates two critical phases. The first stage extracts features from faces, while the second step performs classification using machine learning techniques.
In general, the extraction of characteristics falls into three broad categories: deep features, handcrafted techniques and combined methods.
The great number of attributes generated by both methods (Handcrafted and deep features) prompts researchers to develop new selection methods called wrapper feature selection based on meta-heuristics (MHs). MHs are derived from different subjects, allowing the development of a large number of optimization algorithms that can be merged with machine learning techniques. In the early 1990 s, Holland developed Genetic algorithms [14] (GA), Differential evolution (DE) is introduced by Storn and Price [15], more recently, Evolutionary strategies (ES) is designed by Rudolph [16], and Genetic programming (GP) proposed by Koza [18], that used a tree representation. Then, another axis interests scientists: replicating the behavior of swarming through the introduction of the hypothesis of swarm intelligence (SI). This category has expanded significantly in recent years, with the development of the Practical Swarm Optimizer (PSO) by Eberhart and Kennedy [19]. Recently, the pioneer Mirjalili developed several algorithms including the Gray Wolf Optimizer (GWO) [20], Ant Lion Optimizer (ALO) [21], the Whale Optimization Algorithm (WOA) [22] and Salp swarm algorithm (SSA) [23]. Furthermore, Saremi et al. [24] realized a novel optimizer called Grasshopper Optimization Algorithm (GOA). More recently, Heidari et al. [25] simulated the behavior of hawks, which allows to create a new algorithm called the Harris hawks optimization (HHO). Zhao et al. [28] simulated the foraging of manta-raies, which created Manta-ray Foraging Optimizer (MRFO).
Recently, AOA has been published by Hashim et al. [30], which simulates the Archimedes physical rule in the field of global optimization. This algorithm is widely used in several fields like design of vehicule structure [46] and optimization of deep belief network [47]. In addition, an enhanced variant of AOA has been processed by Desuky et al. [48] in the field of feature selection. Also, SCA is employed for enhancing several swarm algorithms-like SSA and HHO in the field of FS [49,50]. Also, Ewees et al. [51] investigated the use of SCA with artificial bee colony for image segmentation.
Due to the ''No Free Lunch'' theory, which states that no algorithm can solve all optimization problems, this work offers a novel variant of AOA dubbed scAOA for recognizing gender from faces. Thus, this approach seeks to improve upon the original AOA algorithm by employing sinusoidal operators in order to address some of its flaws, including delayed convergence, being trapped at local optima, and having an imbalanced algorithm. The major contributions of this paper are as follows: • Designing a novel wrapper physical algorithm scAOA for predicting gender identification using an automatic selection of the optimal trainable deep features of face images. • Comparing the performance of scAOA with several recent and robust optimizers as for facial analysis based on FS. • Evaluating the impact of deep features based on AlexNet and ResNet. • Testing the efficiency of scAOA for gender recognition (GR) over two datasets: FEI and GT.
This paper is structured around 5 sections. Section 2 explains some related work for gender recognition (GR) from faces. Section 3 describes trainable feature extractors based on AlexNet with 4096 features and ResNet with 2048 features. Section 4 gives details about the Archimedes optimizer algorithm and the concept of trigonometric operator (TO). In Sect. 5, we propose our system of GR using a modified version of AOA by employing TO as a mathematical operator to provide a new wrapper algorithm for feature selection called scAOA. Section 6 represents the kernel of our paper, which includes datasets description, parameters of algorithms, and quantitative and graphical results proved by statistical analysis using Rank Sum Wilcoxon's. The last Sect. 7 shows our conclusion with some future horizons.

Related work
Facial analysis includes several area of research-like age and gender recognition, emotion and ethnicity detection. Recently, deep CNN play an important role in computer vision area due to their double use, i.e., the deep CNN can provide the vector of characteristics (features ) and classification task.
This section highlights some works related to facial analysis, especially gender recognition. First, we review the trainable features with machine learning techniques for gender recognition. Second, we show some studies about gender identification based on handcrafted methods. Third, hybrid features are discussed. Finally, an outline of gender recognition via wrapper feature selection is presented.

Trainable features (Deep features)
Duan et al. [52] presented a novel synergy between convolutional neural network (CNN) and extrem learning machine (ELM) for age and gender identification. The CNN is employed as a feature extractor, while the ELM is used as a classifier to simultaneously estimate a person's age and discriminate between male and female face photos. The authors obtained higher performance compared to other studies in terms of accuracy for two popular datasets: Adience and Morph-II.
Acien et al. [53] measured ethnicity and gender using two pretrained-CNN architectures. For LFW dataset, VGG16 shown a good ability to recognize easily gender and race with a high performance compared to ResNet50.
Mane et al. [55] investigated three aspects of human facial analysis: face recognition, gender identification, and expression recognition. The experimental results indicated that the gender recognition rate is very higher to emotion recognition rate. The CNN achieved 96% as accuracy for gender identification task.
Recently, Agrawal and Dixit [56] used CNN as an extractor to predict the age and gender of individuals based on facial pictures. They further applied PCA to reduce the dimensional, however, the classification step is performed using a Feed-Forward Neural Network.
In 2019, Haider et al. [57] created a novel deep CNN architecture for real-time gender identification on smartphones. The design is comprised of four convolutional layers, three max-pooling layers, two fully connected layers, and a single regression layer. The training is conducted using two datasets: FEI and CAS-PEAL, which contain 200 persons with 2800 faces and 1040 individuals with 30,871 faces, respectively. The Deep-gender algorithm obtained 98.75% as accuracy on the FEI dataset by applying a novel strategy that includes alignment prior to shrinking the facial image. However, when applied to CAS-PEAL-R1 datasets, the proposed approach attained an accuracy of 97.73%

Handcrafted features
Recently, different sources dubbed handcrafted techniques have been created in the literature for human facial analysis, including face recognition, emotion recognition, age and gender estimation. The retrieved features are computed for the entire face or selected parts using a histogram of oriented gradients (HOGs) and a scale-invariant feature transform (SIFT) [58].
Surinta and Khamket [58] utilized a support vector machine (SVM) as a classifier to classify Color FERET samples into two classes: female and male. The authors conclude that when the size of the training data is decreased, HOG outperforms the SIFT descriptor based on SVM in the experimental investigation.
A few studies based on uncontrolled image conducted on Image of Groups dataset. As instance, the work of Zhang et al. [59] has been illustrated. The authors established an innovative method for gender recognition by fusing facial features. Combining local binary pattern (LBP), local phase quantization (LPQ), and a multiblock produces the vector of characteristics. The classification task is realized by SVMand validated on Image of Group datasets (IoG). The experimental results demonstrate that the proposed strategy outperforms existing fundamental variants (LBP and LPQ).
Moreover, an interesting study was published recently, dedicated to gender recognition [60]. In this work, Ghojogh Neural Computing and Applications et al. [60] created four frameworks for identifying a person's gender using facial photos. The first framework entails extracting features via a texturing approach based on LBP and reducing the dimension of vector features via PCA, which will then be used as input for a multi-layer perceptron (MLP). The second framework utilized Gabor filters to generate a vector of PCA-reduced features that was used as input to the kernel SVM classifier. The third framework extracts the lower portion of the face with a resolution of ð30 Â 30Þ, which is then molded into a column vector with a resolution of ð900 Â 1Þ and used as input for the kernel SVM classifier. The final framework extracts 34 landmarks from the face and classifies them using a linear discriminant method (LDA). All proposed frameworks are evaluated using FEI data, and experimental results indicate that the third framework surpasses the others by 90% in terms of accuracy. However, when a choice is made using the weighting vote, the accuracy jumps to 94%. Additionally, texture and geometric cues are used to identify gender, which can be detected using local binary patterns (LBP) and gray level co-occurrence matrices (GLCM).
Recent advances in face and gender identification have resulted in the development of various upgraded variants of LBP known as local directional pattern (LDP), local phase quantization, and local phase quantization (LPQ). In the same regard, Chen and Jeng. [61] proposed a novel variation of LBP dubbed Adaptive patch-weight LBP (APWLBP). Their method computed the gradient using a pyramid structure and weight parameters established by Eigen theory. The primary goal of (APWLBP) is to discover the best hyperplane projection with a high variance for gender recognition. On the 3D Adience and LFW datasets, the performance of APWLBP-based SVM is highly comparable to that of CNN.

Hybrid methods
Numerous studies have been conducted on deep-learned features and their impact on gender recognition when compared to handcrafted features and fused features [63].
Dwivedi and Singh [64] summarized first, some methods based on handcrafted data such as LBP, HOG, SIFT, weighted HOG, and CROSSFIRE Filter; and second, they discussed the role of CNN, which can be used for dual tasks, i.e., as a feature extractor and a classifier to recognize age and gender from the face.
More recently, Althnian et al. [65] presented three handcrafted features, which can be extracted from facial image using LBP, HOG, and PCA. Furthermore, the authors employed deep CNN features, and fused features based on three combinations dubbed LBP-DL, HOG-DL, and PCA-DL. After that, two classifiers, SVM and CNN, are used to accomplish the task of gender identification. The experimental results indicated that fused features (LBP-DL) and an SVM classifier achieved a high rate of average accuracy of 88.1% when tested on two datasets, LFW and Adience.
Alghaili et al. [66] designed a novel framework for gender recognition, which treats camouflaged faces. Their network combines inception with variational feature learning (VFL). The experiment is evaluated using five public datasets. Our interest is focused on FEI performance, which attains 99.51% in terms of accuracy.

Wrapper FS methods
A few work used bio-inspired algorithm for gender recognition based on feature selection. As example, the work of Zhou and Li [67] employed genetic algorithm (GA) to categorize faces depending on their gender automatically. GA is used to discover the optimal set of PCAextracted and neural network-classified eigenfeatures from faces. Two datasets FEI and FERET, are used to validate the experimental investigation. The obtained results attained accuracy rates of 96% and 94%, respectively. More recently, Neggaz and Fizazi [68] employed Archimedes optimization algorithm (AOA) for facial analysis. The authors used three handcrafted methods based on HOG, LBP and GLCM. Their idea consists to determine automatically the relevant blocs from face to recognize gender. The experimental results shown that AOA-LBP achieved a high performance in terms of accuracy with 96% for Gallagher dataset.

Features extraction using pre-trained CNN
CNNs are primarily composed of three types of layers: convolutional, pooling, and fully connected. The most critical layers are the convolutional and pooling layers. By convolving an image area with numerous filters, a convolution layer is utilized to extract features. Due to the higher layer count, a CNN can more precisely interpret the features in its input image. The pooling layer compresses the output mapping of the convolution. This section explains two types of pre-trained CNN: AlexNet and ResNet. It is important to highlight that Alexnet is chosen as a core component of the proposed model due to its capacity to perform rapid network training and its ability to reduce over-fitting. This model is more appropriate due to its straightforward structure, short training time, and low memory usage [69]. Additionally, ResNet was ranked first in ImageNet detection and localization [70].

AlexNet
AlexNet is a well-known image categorization model. The AlexNet architecture, as represented in Fig. 1, consists of five convolutional layers (Conv), three pooling layers (Pool), and three fully connected layers. The parameters of each layer are listed in Table 1.
• Convolution layer (CL) The convolution layer performs the convolution process on the original image by utilizing a special feature detector called the convolution kernel. During training, the image is scaled to 227 Â 227 Â3. In the first convolution layer, 96 number of 11 Â 11 Â3 convolution kernels are employed to generate new pixels via convolution. The second layer's input data is the 27 Â 27 Â96 pixel layer output by the previous layer. To aid in subsequent processing, each pixel's upper, bottom, left, and right margins are filled with two pixels. The second layer's convolution kernel has a size of 5 Â 5 and a stride of 1 pixel, which is identical to the first layer's computation formula. The third layer's input data is a collection of 13 Â 13 Â128 pixel layers output by the second layer. To facilitate subsequent processing, each pixel layer's upper, bottom, left, and right margins are filled with a single pixel. The fourth layer's input data is similar to the third layer's: sets of 13 Â 13 Â192 pixel layers output by the third layer. The fifth layer's input data is a collection of 13 Â 13 Â192 pixel layers output by the fourth layer.
To facilitate subsequent processing, each pixel layer's upper, bottom, left, and right margins are filled with a single pixel. The convolution layer's K S , S, and P parameters are used to determine the sizes of the input and output images. More precisely, the convolution layer's computation formula is defined by: • Pooling layer (PL) This architecture makes extensive use of max pooling, a technique that selects the matrix's maximum value. When an image is translated by a few pixels, the maximum pooling has little effect on the judgment. Max pooling's primary advantage is its efficacy in removing noise. After the first, second, and fifth convolution layers, the max pooling layers are added. • Fully connected layer (FCL) AlexNet is composed of three fully connected layers. The first and second completely connected layers each contain 4096 convolution kernels with a size of 6 Â 6 Â256. This is because the convolution kernel's size is identical to the size of the feature map being processed. Each coefficient in the convolution kernel is multiplied by the pixel value of the feature map's size, resulting in a one-to-one relationship. Thus, the pixel layer after convolution has a size of 4096 Â 1 Â1, indicating that there are 4096 neurons. Due to the fact that this study has two categories, two neurons in the third fully linked layer are set. Fig. 1 The design of AlexNet. [72] Neural Computing and Applications Figure 2 illustrates a ResNet residual block. As illustrated in the figure, stacked layers execute residual mapping in residual networks by establishing shortcut connections that perform identity mapping (x). Their outputs were added to the residual function F of the stacked layers (x). The gradient of error was determined and propagated to the shallow layers during the deep network's backpropagation training. This inaccuracy becomes smaller and smaller as one progresses deeper into the levels, until it eventually vanishes. This phenomenon is referred to as the gradient vanishing problem in really deep networks. As illustrated in Figs. 2 and 3, the problem can be handled via residual learning [71].

ResNet
The initial residual branch, or unit l, is depicted in Fig. 3 within the residual network. Weights, batch normalization (BN), and corrected linear unit are depicted in the figure (ReLU). The following equations were used to determine the input and output of a residual unit: where hðx l Þ represents the identity mapping, F represents the residual function, x l represents the input, and W l represents the weight coefficient. The identity mapping is denoted by the symbol hðx l Þ ¼ x l is the foundation of the ResNet architecture. The residual networks were created for networks with a layer count of 34, 50, 101, and 152. ResNet-50 was employed in this investigation. The network is made up of 50 layers.

Archimedes optimization algorithm (AOA)
AOA is a physics-inspired algorithm, more specifically Archimedes' law. Fatma Hashim invented this method in 2020 and it is classified as a meta-heuristic [30]. The uniqueness of this algorithm is in the solution's encoding, which includes three pieces of auditory information for the fundamental agents: Volume (V), Density (D), and Acceleration (Gamma). Thus, the first set of agents in Dim dimensions is formed randomly. We offer random values of V, D, and Gamma as additive data. Following that, an evaluation process is carried out on each object to decide which one is the best ðO bestÞ . During the AOA process,  Neural Computing and Applications density and volume are updated to adjust the acceleration based on the collision notion between objects, which is critical in determining the novel position of the current solution. The following are the general key steps in AOA: • The first stage -Initialization Using Eq. (3), this phase seeks to randomly initialize the real population of N objects. Additionally, each object's density ðD i Þ, volume ðV i Þ and acceleration ðC i Þ are randomly constructed using the given equations: Eqs. (4), (5) and (6): Where O i represents the i th object, O Max i and O Min i are the search-maximal space's and minimal bounds, respectively. r 1 ; r 2 ; r 3 and r 4 are a random vectors that belong to ½0; 1 Dim .
The population will be analyzed by assigning a score to each candidate in order to decide which object is the best ðO BestÞ by joining their best values of density ðD Best Þ, volume ðV Best Þ and acceleration ðC Best Þ.
• The second stage -Density and volume adjustments The density and volume values for each object are adjusted in this stage by controlling the best density and volume using Eqs. (7) and (8): Where s 1 ; s 2 are random scalars in [0, 1].
• The third stage -Transfer coefficient & density scalar This process involves colliding objects until the equilibrium state is reached. The transfer function ðT c Þ is primarily responsible for switching from exploration to exploitation phase, as defined by Eq. (9): The T c increases exponentially over time until reaching 1.
It is the current iteration, while It Max denotes the maximum number of iterations. In contrast, the density factor d s is supposed to gradually decrease in order to convert the global search to a local search using Eq.(10): • The fourth stage -Exploration phase IThe collision between agents occurs in this step via a random selection of material (Mr). Thus, when the transfer coefficient value is less than or equal to 0.5, the acceleration objects are updated using Eq. (11).
• The fifth stage -Exploitation phase This phase omits the possibility of agents colliding. Thus, when the transfer coefficient value is greater than 0.5, the acceleration objects are updated using Eq. (12) Where C Best is the acceleration of the optimal object O Best .
• The sixth stage -Normalization of acceleration This stage consists to normalize the acceleration in order to determine the rate of change using (13): Where k and l are fixed to 0.9 and 0.1, respectively. The C Itþ1 iÀnorm determines the percentage of step that each agent will change. A greater acceleration value indicates that the candidate is operating in the exploration mode; otherwise, the object is operating in the exploitation mode.
Where c 1 is equal to to 2.
where c 2 is fixed to 6. The parameter delta has a positive correlation with time and is proportional to the transfer coefficient T c , i.e., d ¼ 2 Â T c . This parameter's primary function is to maintain a good balance between exploration and exploitation operations. During the initial iterations, the margin between the best and worst objects is greater, resulting in a high random walk. However, in the final iterations, the margin will be lowered and a low random walk will be provided.
F is used for flagging, which regulates the direction of the search via Eq. (16): where f ¼ 2 Â rand À 0:5.
• The eighth stage -The evaluation This step, the novel population is evaluated using score index Sc in order to determine the best object O Best and the best additive information including D Best , V Best , and C Best .

Trigonometric operator (TO)
Trigonometric operator is inspired from SCA algorithm, developed by [36]. This operator can enhance deeply the exploitation step of AOA using sine and cosine functions, as shown in Eqs. (17) or (18), respectively: where O I t Best is the best object at It iteration, O t i is the current solution in i th dimension at t iteration, |.| denotes the absolute cost. a 1 , a 2 , a 3 and a 4 are random numbers.
The parameter a 1 regulates the ratio of exploration to exploitation. This parameter is updated using the following formula: where It is the current iteration, It Max , is the maximum number of iteration and s is fixed to 2. a 2 controls whether the following solution will move in the direction of the target or away from it. a 3 denotes the weight assigned to the optimal solution in order to stochastically emphasize it. ða 3 [ 1) or downplay ða 3 \1) the effect of the destination on the distance definition [73]. Using Eqs. (17) and (18), the parameter a 4 enables switching between sine and cosine or vice versa. The process of TO is illustrated in Algorithm 2

scAOA-based FS for gender recognition (GR)
To improve the exploitation phase of the original AOA method and avoid convergence to local minima, we developed a new approach called scAOA that incorporates the trigonometric operator (TO). By utilizing the sine and cosine mathematical functions, this operator ensures a more balanced approach to exploration and exploitation. The integration of this operator (TO) provides a good solution to escape from local optima. The design of GR based on scAOA is depicted in Fig. 4 and it contains five basic processes, which are detailed as follows: (1) Preprocessing data This stage consists to load the datasets of facial images, which will be divided it to k-folds. All images must be resized to 227 Â 227 Â3 for AlexNet and 224 Â 224 Â3 for ResNet.  ) and (6). The process of FS required to convert the real values to binary using the sigmoidal function, defined by the following equations: Where: Any solution is represented as a one-dimensional vector; the length is specified by the number of deep features. Any cell may have one of two values, 0 or 1, where 1 indicates that the appropriate feature has been selected and 0 indicates that it has not been selected. (4) Score (Fitness) evaluation Generally, feature selection seeks to decrease both the number of features and the error rate of classification. In other words, classification accuracy is maximized by deleting superfluous and redundant traits and maintaining only the most pertinent ones. The k-NN classifier was used in this investigation due to its ease in evaluating the score. So, the score (Fitness) for each object is evaluated by: where Cr, Sel f are the accuracy obtained by k-NN ðk ¼ 5Þ and the size of selected deep features, respectively. Tot f is the total number of trainable features provided by AlexNet/ResNet. (5) Updating process First, scAOA seeks to update the density, volume, transfer coefficient, and density scalar using Eqs. (7), (8), (9) and (10), respectively. Second, the update of objects is realized by the exploration mode (when T c 0:5), which applies the adjustment of acceleration using Eq. (11), the normalization of acceleration using Eq. (13) and the adjustment of position using Eq. (14). The exploitation mode is realized by the integration of trigonometric operators (TO), which ensures a good balance between exploration and exploitation modes. More exactely, TO utilized two strategies: sine and cosine strategies based on the condition (a 4 0:5), using Eqs. (17) and (18), respectively. This integration enhances deeply the convergence to global solution. The third step consists of evaluating the score for each object using Eq. (22), in order to find the best candidate O Best . The evaluating and updating stages are repeated indefinitely until the termination condition is satisfied. This condition is utilized in this study to determine the quality of the suggested approach for locating the optimal subset of features within the given number of iterations.
The process of gender recognition using scAOA algorithm is outlined in Algorithm 3.

Experimental results
In order to realize a fair analysis, the efficiency of AOA is compared with different and recent computational algorithms inspired from swarm intelligence, mathematical algorithm, genetic evolution and physical algorithms, tested on two datasets (GT & FEI datasets) in the same condition by employing two deep descriptors including AlexNet and ResNet.

Simulation setup
In this study, we set the population size and maximum number of iterations to 10 and 100, respectively. Due to the stochastic nature of the computational algorithms, each algorithm is run 30 times separately. To recognize GR using FS, we randomly split datasets using k-fold crossvalidation. The computer's CPU is an Intel(R) Core(TM) i7-5500U processor running at 2.40 GHz, and the RAM is 8 GB.

Statistical metrics
To confirm the efficiency of the scAOA algorithm in the field of facial analysis-based FS, 8 meta-heuristics, including GWO, SCA, GOA, ALO, PSO, SGA, SSA and basic AOA, were used to compare the performance of the proposed algorithm under the same conditions. In order to compute the conventional metrics as correct rate of gender classification (Cr), Recall (Re), precision (Pr) and F-scoreðF sc Þ, we define the confusion matrix, which is illustrated in Table 2. Also, other measures are shown as the score (Fitness), the selection ratio, and CPU time. As a result, all metrics are expressed in terms of the mean and standard deviation, which are described by: Where TP The classifier determines correctly the person knowing that their class is male , TN the classifier determines the person correctly knowing that their class is female, FP the classifier assigns the person to the male class knowing that the subject is female, FN: the classifier assigns the person to the female class knowing that the subject is male • Mean Correct rate of classification ðl Cr Þ: It represents the accuracy, which is defined by: l CR is measured as follows: • Average recall ðl Re Þ: It indicates the percentage of predicting positive patterns (TPR), that is defined by: The l Re is calculated from the best object ðO best Þ using: • Average precision ðl Pr Þ: It indicates the frequency of true expected samples as follows: and the mean precision( l Pr ) can be calculated as follows:: • Average cost value ðl Score Þ: The score is related to the error rate of classification and selection ratio measures, as shown in Eq. (22). A lower value of the score signifies better performance. Its average is computed by: • Average selection ratio ðl Sr Þ:This metric denotes the ratio of selected features compared to the total number of features. It is calculated as follows: where Sel best f r is the cardinal of the best agent's selected features for r th execution.
• Mean F-score ðl F Score Þ: This metric is used to calculate the harmonic average of recall and precision. It is already in use for balanced data, which can be calculated using Eq. (31): and the mean F-score can be calculated using: • Average CPU time ðl Cpu Þ:It is the average time required to compute each process, that is: • Standard deviation (r): is the algorithm's quality and the analysis of the obtained results through several executions and metrics. It is computed f for all previously mentioned steps.

Parameters settings
This subsection defines each optimizer's parameters. To ensure a fair comparison, it is necessary to enumerate the algorithms utilized to complete the task of gender recognition from faces. The suggested technique scAOA and other computational algorithms such as AOA, SCA, GOA, SSA, ALO, SGA, PSO, and GWO have their parameter settings defined in Table 3.

Results & discussion
-In terms of average fitness and average accuracy The average fitness and standard deviation results obtained by the scAOA approach and the other competitors algorithms are shown in Table 4. Two corpora and two pretrained CNN models (AlexNet & ResNet) were employed to extract the deep features. The deep analysis of results across the two corpora used, showed that the quantitative results obtained by the proposed approach scAOA achieved Maximum number of iterations (It Max ¼ 100) Maximal limit is fixed to 1 Minimal limit is fixed to 0 AOA c 1 ¼ 2 and c 2 ¼ 6 k ¼ 0:9 and l ¼ 0:1 scAOA c 1 ¼ 2 and c 2 ¼ 6 k ¼ 0:9 and l ¼ 0:1 s=2 GOA C max ¼ 0:1 and C min ¼ 4E À 05 SGA P c ¼ 0:8 and P m ¼ 0:1  Table 4, the pre-trained CNN models based on AlexNet provides a good performance of fitness indicated by Eq. (22), which ensure a compromise between lower rate of error classification and lower rate of selection ratio. Concerning the measurement of the standard deviation, we notice that the scAOA algorithm obtained lower values than other algorithms at the level of the base GT, while the PSO algorithm obtained low values at the level of the base FEI. It is important to mention that the second best place was obtained by AOA using Alexnet at the FEI base level, while SCA took the second place at the GT base. In addition, for ResNet deep features, AOA is ranked second for both databases (FEI & GT). The results of the gender categorization are summarized in Table 5 in terms of mean accuracy and standard deviation for both datasets (FEI and GT) utilizing two distinct types of deep characteristics (AlexNet and ResNet). When compared to other algorithms such as AOA, SCA, GOA, SSA, GWO, SGA, PSO, and ALO in terms of average accuracy, the suggested scAOA algorithm based on the two deep descriptors demonstrated a clear performance. We see that AlexNet-based scAOA is much superior for both corpora (FEI and GT datasets), with classification rates of 99.5% and 99.95% percent, respectively, for FEI and GT. This phenomenon is explained by the fact that trigonometric operators are integrated at the operational step level. Additionally, scAOA is ranked first in terms of STD for the GT base, whereas SCA is ranked first for the FEI dataset.
-In terms of recall and precision The recall and precision of the proposed method scAOA with eight wrapper FS algorithms using two deep descriptors (AlexNet & ResNet) are listed in Tables 6 and  7.
By inspecting the average recall and average precision values shown in Tables 6 and 7, we can see clearly that can observe that the performance of average recall and average precision obtained by scAOA based on AlexNet is more better than scAOA based on ResNet. In addition, SCA based on deep AlexNet descriptor ranked in second position in terms of average recall and average precision for both Datasets. It can be seen that scAOA based on deep descriptors has a strong stability for GT dataset due to the lower values of STD in terms of precision and recall metrics.
-In terms of F-score and selection ratio From Table 8, we can observe that the proposed method scAOA based on pretrained CNN (AlexNet & ResNet) outperforms all other competitors in terms of F-score. The value of F-sore is more significant when the data are unbalanced like the case of GT dataset. 99.89% of F-score for GT dataset indicated a good balance performance of both categories: male and female. Furthermore, a great competition between AOA based on ResNet and SCA based on AlexNet is highlighted for second rank. Also, GOA based on deep features reached lower values of F-score for both datasets (GT & FEI).
According to the results of Table 9, which displays the average rate of selection ratio along with its standard deviation. A wrapper FS-based SCA demonstrated a high performance in terms of selecting relevant deep features for both datasets (FEI & GT datasets). Also, we can observe that the the proposed method scAOA provides a good behavior to select the optimal set of relevant deep features. Its performance is ranked second with a difference of 0.92 and 3.64% for FEI and GT based on AlexNet deep features, respectively. Additionally, the conventional AOA is ranked in third position. So, the integration of trigonometric -In terms of CPU time The time consumed by the proposed scAOA method and the other competitors is recorded in Table 10. it is clear that the SCA algorithm is the fastest compared to other algorithms because SCA uses simple sine / cosine-based math functions to fit the solutions. Furthermore, scAOA takes more times compared to SCA but it consumes less time compared to the the conventional AOA for both datasets using deep features. Also, It can be seen that ALO consumed a lot of time to carry out the task of gender classification based on the selection of attributes. This is due to the complexity of the operators used in ALO.

Statistical analysis
A statistical analysis is necessary to compare the efficiency of scAOA to that of other competitive algorithms. Thus, the Wilcoxon ranksum test is used to compare the accuracy values acquired by scAOA and those obtained by other algorithms, such as basic AOA, SCA, GOA, SSA, ALO, SGA, PSO, and GWO. As shown in Table 11, scAOA is statistically significant for all competitors in both datasets in the case of the AlexNet deep descriptor. Additionally, AOA-based ResNet dominates scAOA for both datasets. In general, scAOA based on deep descriptor ResNet is statistically significant with 87.5% of algorithms.  For both datasets, we can see that scAOA and the conventional AOA based on ResNet descriptor highlight a great competition in the first iterations, but after 30 iterations scAOA start to be more efficient. This behavior can be interpreted by the use of trigonometric operators, which allow to enhance deeply the exploitation process. Additionally, as shown in Fig. 6, we have plotted the boxplot of the proposed method scAOA against other algorithms such as conventional AOA, SCA, GOA, SSA, ALO, SGA, PSO, and GWO in terms of accuracy. As illustrated in this figure, the suggested method scAOA based on deep features achieved greater mean and median accuracy values than other advanced algorithms for both datasets. The collected results demonstrate the proposed method's efficacy in maintaining the highest classification accuracy, especially for AlexNet deep features. According to the obtained results, we observe that the gender performance of the FEI dataset results in a proportionately lower quality than that of the GT dataset. This is due to the complexity of the datasets, which is dependent on several challenging factors, including highlighting variation, facial expressions, different poses, and the dataset's size.   This study aims to compare the efficiency of scAOA wrapper feature selection approach based on two deep features provided by AlexNet/ResNet and k-NN. From the results of Table 12, it can be seen that scAOA based on k-NN as classifier and AlexNet as deep features outperforms k-NN using AlexNet as deep features with a margin of 2.21% i.e., 99.50% for FEI dataset and a margin of 1.91% for GT dataset i.e., 99.95%.

Comparative study with the existing works
To demonstrate the efficacy of the suggested technique scAOA, numerous algorithms from the literature were chosen for a fair comparison, including machine learning, deep learning, and genetic algorithms. Figs. 7 and 8 illustrate the proper rate of classification's performance across both datasets.
For FEI dataset -As illustrated in Fig. 7, the first four algorithms combined trainable deep features with a k-NN classifier. That includes VGG19, AlexNet, ResNet, and GoogleNet. The best performance is obtained by VGG19?k-NN with 99%, which is lower than the performance of the proposed method scAOA?AlexNet, which attains 99.5% in terms of   accuracy. Also, scAOA?k-NN outperforms Deepgender with a margin of 0.75% in terms of accuracy [57]. In addition, great competitiveness is shown between the proposed method scAOA and gender NN4VFL (combination between inception network and VFL) because the margin is insignificant with 0.01%. Concerning the performance of scAOA based on Alex-Net against ML and GA-based FS, scAOA still better than all previous algorithms illustrated in Fig. 7. The margin between scAOA?AlexNET and SVM based on 8-LDP ?LBP is equal to 0.5% [57], whereas, the margin reached 3.5% compared to GA-based FS [67].
For GT dataset -We start by comparing this dataset to pre-trained CNNs based on k-NN. Second, we compared the proposed scAOA ? AlexNet and scAOA ? ResNet approaches to machine learning methods in terms of performance. From the first comparison, we can see clearly that both proposed methods based on scAOA outperform all pre-trained CNN with k-NN including VGG19, AlexNet, ResNet and Goo-gleNet. The performance between scAOA? AlexNet and VGG19?k-NN is significant because the margin is equal to 0.5%, which means scAOA allows to eliminate perfectly the irrelevant features. Fig. 7 The comparative study between scAOA based on pretrained CNN with existing algorithms -FEI dataset Fig. 8 The comparative study between scAOA based on pretrained CNN with existing algorithms -GT dataset Concerning the second comparison, scAOA based on AlexNet and ResNet provide a high performance because the margins are 0.95% and 0.69% compared to the best ML classifier, which used SVM as classifier and Combined transform as DCT and DWT [?].

Conclusion
Deep gender has recently experienced wide use in the field of video surveillance. However, the high number of attributes produced by pre-trained CNNs, prompted us to integrate MHs to select the optimal set of deep learning attributes (AlexNet and ResNet). The majority of metaheuristics suffer from the problem of exploitation. We have solved this problem at the level of the AOA algorithm by integrating trigonometric operators inspired by the SCA algorithm, applied to facial analysis, in particular gender identification. By analyzing the results obtained, we noted that the proposed scAOA algorithm manages to improve the performance of gender classification in terms of accuracy for the two selected datasets, particularly for AlexNet deep features. A great competitiveness was underlined between the proposed scAOA approach and the SCA algorithm in terms of selected attributes and execution time. As a perspective, the self-checking of the parameters of the AOA algorithm can be considered as a new avenue to explore. Also, the process of large datasets and the choice of CNN architecture can be processed in future.

Declarations
Conflict of interest No conflict of interest is declared by all authors.