{'fraction_non_alphanumeric': 0.030105017502917154, 'fraction_numerical': 0.01396343835083625, 'mean_word_length': 5.127502383222116, 'pattern_counts': {'":': 0, '<': 2, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Entropy as Measure of Brain Networks’ Complexity in Eyes Open and Closed Conditions

: Brain complexity can be revealed even through a comparison between two trivial conditions, such as eyes open and eyes closed (EO and EC respectively) during resting. Electroencephalogram (EEG) has been widely used to investigate brain networks, and several non-linear approaches have been applied to investigate EO and EC signals modulation, both symmetric and not. Entropy is one of the approaches used to evaluate the system disorder. This study explores the differences in the EO and EC awake brain dynamics by measuring entropy. In particular, an approximate entropy (ApEn) was measured, focusing on the speciﬁc cerebral areas (frontal, central, parietal, occipital, temporal) on EEG data of 37 adult healthy subjects while resting. Each participant was submitted to an EO and an EC resting EEG recording in two separate sessions. The results showed that in the EO condition the cerebral networks of the subjects are characterized by higher values of entropy than in the EC condition. All the cerebral regions are subjected to this chaotic behavior, symmetrically in both hemispheres, proving the complexity of networks dynamics dependence from the subject brain state. Remarkable dynamics regarding cerebral networks during simple resting and awake brain states are shown by entropy. The application of this parameter can be also extended to neurological conditions, to establish and monitor personalized rehabilitation treatments.


Introduction
The first electroencephalographic (EEG) recording was performed in 1924 by the German neurologist Hans Berger, the inventor of this brain electrical activity recording technique. He demonstrated that a comparison between two apparently trivial conditions, such as eyes open and eyes closed (EO and EC respectively) while resting, can reveal the extent of human brain complexity; in particular he discovered that when a healthy subject opens the eyes, the amplitude of alpha waves (8)(9)(10)(11)(12)(13) Hz) decreases (the so-called alpha blockage) [1]. Since Berger published the first paper about scalp EEG, this technique has been widely applied to the study of the brain [2], both with the linear and nonlinear approach. His findings have been confirmed by several following theories: these demonstrate that alpha desynchronization (due to the visual input in EO condition) reveals the increment of functional innervation of the visual system, which leads to an activation of a larger area of cortex and reflects the interactions of cortical and thalamo-cortical systems that aid the information flow [3][4][5]. Several studies extended the observations to different bands of frequency: reductions have been found in the cerebral activity power from the EC to EO condition, both in young and older subjects, suggesting a preservation of the energetics of EEG reactivity in healthy aging [6].
Besides the power spectrum analysis, the two conditions and the related cerebral networks changes have been explored through brain connectivity techniques, namely the evaluation of the functional interactions among the different brain areas. In particular, a mathematical description of the cerebral architecture, the graph theory, is employed to analyze EEG data for the investigation of the neural network organization [7]. The small-world value, a parameter explaining the balance between brain networks local specialization and global integration [8,9], has been found as higher in alpha band and lower in beta2 and gamma (20)(21)(22)(23)(24)(25)(26)(27)(28)(29)(30) Hz and 30-45 Hz respectively) bands in the resting EO condition with respect to the EC one, in healthy elderly subjects [10]. The same applies to healthy young adults, in which the small-world value increases from EC to EO states in the alpha band and reduces slightly both in the theta and in the beta (4-7 Hz and 14-30 Hz respectively) band [11].
Even non-linear approaches have been extensively employed to explore the physiological mechanisms of cerebral functioning [12]: in fact, a dynamic and complex system such as the human brain is mostly characterized by transient and time-varying interaction phenomena among the topographically distributed neural networks, both symmetrically and asymmetrically. In particular, non-linear approaches have been used to explore the differences in terms of brain functional configuration between EO and EC conditions [13][14][15]. One of these approaches is represented by the chaotic statistics. Specifically, the brain chaotic behavior is explored through the entropy, a characteristic defined as the measurement of the changing complexity and disorder in any system; less ordered and more random systems are typically associated with higher entropy values.
Brain activity is studied by means of many entropy parameters starting from the hypothesis of the entropic brain that can be characterized by uncertainty and information contents [16]. Different works have investigated the differences between EO and EC resting state conditions. The Acceleration Spectrum Entropy (ASEn) has been found to increase significantly all over the scalp from the EC to EO condition, proving to be sensitive to desynchronization [17]. Other entropy indices, such as the Sample Entropy (SampEn) and the Normalized Corrected Shannon Entropy (NCSEn), have been shown to be higher in the EO than in the EC condition, the former in frontal, temporal, and parietal cerebral areas, and the latter over all the cortex, suggesting that entropy parameters are sensitive to increases during external stimuli processing [13,18]. One of the most used indices of the entropy in brain activity examination [19][20][21][22] is the approximate entropy (ApEn). It is known for the advantages related to its properties: it maintains a good reproducibility if used with the time series of at least 50 samples; it is mostly insensitive to noise; it is finite for composite, stochastic, and noisy deterministic processes [23]; and it reveals the underlying episodic behavior changes undetected by peak occurrences or amplitudes [22]. Within this theoretical framework, the aim of this study is to investigate the differences and the symmetry in the brain dynamics of healthy subjects in the passage from the EO to EC conditions by means of entropy applying ApEn parameter, as the ApEn would be very useful to understand brain complexity and dynamical characteristics.

Participants
A group of 37 healthy volunteers was recruited (18 females; age = 26.0 ± 0.5 (Mean ± Standard Error -SE-) years of age, education = 16.3 ± 0.3 (Mean ± SE) years), whose demographic data are shown in Table 1. The exclusion criteria consisted of current therapy with psychotropic or vasoactive medication, and psychiatric or neurological disorder history. All subjects were right-handed at the Handedness Questionnaire [24]. Participants were subjected to an EO and an EC EEG recording in two separate resting sessions of about 6 min each, for a total of 74 recordings. All experiments were undertaken after obtaining the informed and signed consent of all participants, in agreement to the Code of Ethics of the World Medical Association (1997), and the experimental methods were compliant with the Declaration of Helsinki. The EEG protocol was performed in accordance with Symmetry 2021, 13, 2178 3 of 9 safety guidelines procedures. To avoid possible behavioral effects, before starting the EEG recording the participants were instructed to stay as relaxed as possible and to avoid movements. During the eyes open condition they were asked to look at a fixed point in front of them in order to avoid the orienting network activation due to the visual stimulus selection operated by the subject.

Data Recordings and Preprocessing
A digital EEG device, BrainAmp (by Brain Products), was employed to carry out the EEG recordings, from 64 channels, placed following the International 10-20 system with the reference electrode positioned in FCz. In order to monitor eyes blinking, both vertical and horizontal EOGs were used. The sampling rate frequency was set up at 1000 Hz and the impedance of the electrodes was maintaned below 5 KΩ. EEG activity was assessed at rest, without any task to perform, in at least 6 min of eyes-closed and 6 min of eyes-open (EC and EO respectively) conditions, avoiding blinking, and staring at a fixation point without shifting the gaze during the EO condition. During the examination, participants were located in a sound-damped, dimly lit, and electrically shielded room and seated in a comfortable armchair. The Matlab software (MathWorks, Natick, MA, USA) was employed in order to process the data, using codes built on the EEGLAB toolbox (Swartz Center for Computational Neurosciences, La Jolla, CA, USA) [25,26]. The EEG signals were downsampled at 512 Hz and filtered from 0.2 to 47 Hz using a band-pass finite impulse response filter (FIR). A duration of 2 s epochs were extracted from continuous imported data, and EEG signals principal artifacts (i.e., scalp muscle contraction, eye movements and cardiac activity) were removed first by an EEG expert visual inspection, and later through the Infomax ICA algorithm [27], that allows the division of sources statistically independent from each other [28][29][30][31], as realized in the EEGLAB. After the cleaning procedure, at least 5 min remained for each session.

Entropy Analysis
An analysis of entropy was carried out on the epochs cleaned from the artifacts using a home-fabricated software created in Matlab. The software core computed the ApEn estimation using the algorithm implemented in Matlab and specifying two input parameters: a tolerance factor, r, and a pattern length, m, to compute it. r is also named as a similarity factor used to detect a similarity range between data points. The ApEn values generated by the software are unitless and range from 0 to 2, where 0 corresponds to a regular time series, and 2 to a random time series [32]. Summarizing, the calculation of ApEn works as follows:

1.
A point by point comparison between every m-long data sequence and all the other sequences are performed, and when all points are within r, a match is counted.

2.
The same process is performed on the next sequences of length m + 1, starting with the m + 1 points first sequence.

3.
The matches number is turned into a natural logarithm value, and later the normalization with regard to the data points number (N) is implemented.
The ApEn is calculated as ApEn = Φ m − Φ m + 1 , where: Moreover, N i represents the amount of points that are within r of their corresponding point in the original sequence Y, at the point i: In the present analysis, the Matlab default values for m and r were utilized: so, m was equal to 2 and r to 0.2 * variance (x) [33][34][35], with x that corresponds to a 2 s long epoch of a specific channel. A low ApEn of the investigated signal is suggestive of a high similarity between data sequences [19]. The values of ApEn calculated on each single epoch were averaged to obtain a value for each channel [36]. The ApEn values computed in each channel were thus averaged over ten regions of interest (ROIs), five for each hemisphere (frontal, central, parietal, occipital, temporal) [19,20], in order to obtain a single value of entropy for each ROI, as shown in Figure 1. The midline channels were not considered. Taking into account the modalities of evaluation of the ApEn, it may result as challenging to visually detect the differences in terms of complexity traced by the EEG. 3. The matches number is turned into a natural logarithm value, and later the normalization with regard to the data points number (N) is implemented.

∑ log
Moreover, Ni represents the amount of points that are within r of their corresponding point in the original sequence Y, at the point i: In the present analysis, the Matlab default values for m and r were utilized: so, m was equal to 2 and r to 0.2 * variance (x) [33][34][35], with x that corresponds to a 2 s long epoch of a specific channel. A low ApEn of the investigated signal is suggestive of a high similarity between data sequences [19]. The values of ApEn calculated on each single epoch were averaged to obtain a value for each channel [36]. The ApEn values computed in each channel were thus averaged over ten regions of interest (ROIs), five for each hemisphere (frontal, central, parietal, occipital, temporal) [19,20], in order to obtain a single value of entropy for each ROI, as shown in Figure 1. The midline channels were not considered. Taking into account the modalities of evaluation of the ApEn, it may result as challenging to visually detect the differences in terms of complexity traced by the EEG.

Statistical Evaluation
The analysis of variance (ANOVA) was employed to evaluate ApEn values calculated in the five ROIs for both the cerebral hemispheres for all the recordings. In order to avoid a possible violation of the sphericity assumption in the repeated ANOVA, the Geisser and Greenhouse correction was used. Moreover, the post-hoc analysis was performed by means of the Duncan's test and 0.05 significance level.

Results
The ANOVA for the ApEn evaluation exhibited a statistically significant main effect of Condition (F (1, 36) = 36.120, p = 0.0000), meaning that the brain networks are characterized by higher values of entropy while awake subjects voluntarily keep their eyes open rather than closed, regardless of the brain region and the hemisphere.

Statistical Evaluation
The analysis of variance (ANOVA) was employed to evaluate ApEn values calculated in the five ROIs for both the cerebral hemispheres for all the recordings. In order to avoid a possible violation of the sphericity assumption in the repeated ANOVA, the Geisser and Greenhouse correction was used. Moreover, the post-hoc analysis was performed by means of the Duncan's test and 0.05 significance level.

Results
The ANOVA for the ApEn evaluation exhibited a statistically significant main effect of Condition (F (1, 36) = 36.120, p = 0.0000), meaning that the brain networks are characterized by higher values of entropy while awake subjects voluntarily keep their eyes open rather than closed, regardless of the brain region and the hemisphere.
Furthermore, the ANOVA exhibited a statistically significant interaction (F (4, 144) = 4.7992, p = 0.0012) among the factors Condition (EO, EC) and ROI (frontal, central, parietal, occipital, temporal) as shown in Figure 2. The Duncan post-hoc testing (p < 0.001) revealed higher entropy values in the frontal, central, parietal, occipital and temporal ROIs during the EO condition compared with the EC one, thus for all the investigated brain areas. No statistically significant interaction among the factors condition and hemisphere was found.
Furthermore, the ANOVA exhibited a statistically significant interaction (F (4, 144) = 4.7992, p = 0.0012) among the factors Condition (EO, EC) and ROI (frontal, central, parietal, occipital, temporal) as shown in Figure 2. The Duncan post-hoc testing (p < 0.001) revealed higher entropy values in the frontal, central, parietal, occipital and temporal ROIs during the EO condition compared with the EC one, thus for all the investigated brain areas. No statistically significant interaction among the factors condition and hemisphere was found.

Discussion
This study aimed to investigate how the cerebral dynamics are modulated by the effect of a simple condition such as keeping the eyes open or closed; this chaotic behavior (of the brain) was revealed using the entropy non-linear parameter, the approximate entropy (ApEn), applied to EEG recordings in resting condition. The current study expands previous studies [13,17,18,37] investigating the complexity of brain activity in various areas and seeking eventual symmetric effects between hemispheres. To the best of our knowledge, with respect to the current literature, the main novel finding of the present study is the computation of ApEn selecting 10 cerebral networks, 5 in each brain hemispheres, to explore the effects of eyes open or closed information processes on EEG activity. Thus, the computation of ApEn in 10 brain ROIs by grouping 64 electrodes in the frontal, central, parietal, occipital and temporal areas for each hemisphere, allowed us to be as focal as possible, as well as more specific in the investigation of possible differences across the entire brain.
The current results revealed that a higher entropy characterizes human brain networks while subjects keep their eyes open. Compared with previous studies, we conducted a more detailed research into the entire brain, dividing it into focal regions. Even though the result does not particularly help us to explain our novel finding, we can dissert that there is not a specific region or hemisphere showing a different behavior from the entire brain between the two brain states studied (eyes open and eyes closed). In fact, this chaotic behavior of the brain emerges in all the explored cerebral regions and symmetrically in both the hemispheres, thus confirming the complexity of brain networks dynamics, which clearly changes while switching between two apparently trivial brain states. Furthermore, no differences were found between the two hemispheres with respect to the

Discussion
This study aimed to investigate how the cerebral dynamics are modulated by the effect of a simple condition such as keeping the eyes open or closed; this chaotic behavior (of the brain) was revealed using the entropy non-linear parameter, the approximate entropy (ApEn), applied to EEG recordings in resting condition. The current study expands previous studies [13,17,18,37] investigating the complexity of brain activity in various areas and seeking eventual symmetric effects between hemispheres. To the best of our knowledge, with respect to the current literature, the main novel finding of the present study is the computation of ApEn selecting 10 cerebral networks, 5 in each brain hemispheres, to explore the effects of eyes open or closed information processes on EEG activity. Thus, the computation of ApEn in 10 brain ROIs by grouping 64 electrodes in the frontal, central, parietal, occipital and temporal areas for each hemisphere, allowed us to be as focal as possible, as well as more specific in the investigation of possible differences across the entire brain.
The current results revealed that a higher entropy characterizes human brain networks while subjects keep their eyes open. Compared with previous studies, we conducted a more detailed research into the entire brain, dividing it into focal regions. Even though the result does not particularly help us to explain our novel finding, we can dissert that there is not a specific region or hemisphere showing a different behavior from the entire brain between the two brain states studied (eyes open and eyes closed). In fact, this chaotic behavior of the brain emerges in all the explored cerebral regions and symmetrically in both the hemispheres, thus confirming the complexity of brain networks dynamics, which clearly changes while switching between two apparently trivial brain states. Furthermore, no differences were found between the two hemispheres with respect to the two resting state conditions: this suggests that the modulation due to the opening of the eyes affects symmetrically both hemispheres.
Eyes closed and eyes open statuses are widely studied resting conditions: they can be discriminated by the computation of mathematical features [38]. Compared with the eyes closed state, during the eyes open state the brain is stressed with a higher number of external stimuli resulting, from a functional perspective, in a state of involuntary information Symmetry 2021, 13, 2178 6 of 9 processing and mental activity, although still at rest [39,40]. Consequently, the high entropy values are indicative of an increase in the EEG signal irregularity that characterizes the desynchronization of brain activity [17]. Entropy measures the predictability of a signal, thus a higher degree of randomness distributed all over the channels, even if considered separately, describes a reduction in brain synchronization of the neural networks' oscillatory activity: this activity represents the electrophysiological correlation of increased cortical excitability and brain generalized arousal [41,42]. A study applying transfer entropy to resting EEG recordings showed that the information that flows into the brain is greater during the EC than EO state, mainly from the posterior to the frontal lobe [43]. This finding supports the hypothesis that while keeping the eyes closed, the brain is mostly involved in internal processes rather than in external stimuli ones, resulting in an increase in cerebral synchronization. Summarizing, the desynchronized EEG activity reflects an information processing and mental activity state that particularly characterizes the EO condition compared with EC.
Numerous studies have suggested that brain activity desynchronization reflects the increased functions of the visual system caused by visual stimulus, which is mediated by the reticular activating system. This process involves different structural components resulting in a complex dynamic in the EO condition compared with the EC one [44,45]. Due to the distributed organization of cortical networks involved in the vision, the representation and the perception of visual objects requires the integration of responses across different brain regions [46]. In particular, the occipital and temporal areas play a crucial role in information receiving and objects' recognition [47], while the frontal ones are engaged in generating visual perception contents and supporting the perception of learned objects, events, and actions [48,49].
The visual information processing can be modulated by the attention paid by the subject to the surroundings, which may cause far away effects upon the visual cortex wielded by cerebral structures outside of the visual system [50]. The process of orienting to sensory objects, namely picking out information from sensory input, is called orienting attention. The orienting network, particularly for visual events, relies heavily on frontal eye fields and on parietal systems, comprising the temporal parietal junction and the superior parietal lobe [51]; the basal forebrain with its cholinergic systems also seems to play a fundamental role in controlling attentional orienting [52].
Based on the research, supposedly even during resting (state) the subject, sitting with the eyes open during the EEG recording, tends to pay attention to the surroundings, thus to all the available visual inputs.
In conclusion, the visual information processing and the attention paid to the visual environment, although involuntary, correlate with a symmetric EEG desynchronization spread almost over the whole brain, as revealed by the high entropy values in all the investigated cortical regions.

Limitations
Some potential methodology limitations of this study should be taken into account. Each EEG experiment is intrinsically affected by the volume conduction error. In order to solve this issue, in the current study we computed the common average of the data. Moreover, although the electrodes cannot be placed in the same fixed position for all the subjects, we can perform such an approximation. In fact, we computed the value of ApEn in each ROI as the average of the ApEn values of each electrode. Accordingly, the localization error was minimized as the values of the ApEn come from a set of averaged electrodes representative of a larger brain area and not only from a single electrode. For these reasons, we believe that the localization error across different subjects is minimized. Furthermore, the computation related to ApEn is limited to a partial knowledge of input parameters' values, using the default parameter of the Matlab function, although it is widely used in the literature. Remarkably, future studies should investigate how the variation in this parameter can affect the results.

Conclusions
In conclusion, the EO condition is characterized by higher values of entropy all throughout the brain compared with the EC one. This finding reflects the EEG desynchronization due to visual information receiving and processing, and to the attention of the subject to the surrounding. The results emphasize the interesting dynamics in the cerebral networks as revealed by the entropy parameter during resting conditions; in fact, entropy indices, including the one investigated in the present study, seem to be sensitive to information processing demands in all the ROIs considered and to be symmetric to the hemispheres. In future studies it would be interesting to employ this parameter to explore neurological and psychiatric disorders (i.e., Parkinson's disease, Alzheimer's disease, schizophrenia, Sleep Apnea, etc.) in order to detect biomarkers for an early diagnosis, as well as for monitoring the impact of eventual personalized pharmacological and rehabilitation treatments.

Institutional Review Board Statement:
The study was conducted according to the guidelines of the Declaration of Helsinki. Ethical review and approval were waived for this study, because it was conducted within IRCCS (scientific hospitalization and treatment institutes).

Informed Consent Statement:
Informed consent was obtained from all subjects involved in the study.

Data Availability Statement:
The data that support the findings of this study are available on request from the corresponding author.