{'fraction_non_alphanumeric': 0.04119294776734223, 'fraction_numerical': 0.01871807546548031, 'mean_word_length': 5.492511767222935, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Review on Sublethal Effects of Environmental Contaminants in Honey Bees (Apis mellifera), Knowledge Gaps and Future Perspectives

Honey bees and the pollination services they provide are fundamental for agriculture and biodiversity. Agrochemical products and other classes of contaminants, such as trace elements and polycyclic aromatic hydrocarbons, contribute to the general decline of bees’ populations. For this reason, effects, and particularly sublethal effects of contaminants need to be investigated. We conducted a review of the existing literature regarding the type of effects evaluated in Apis mellifera, collecting information about regions, methodological approaches, the type of contaminants, and honey bees’ life stages. Europe and North America are the regions in which A. mellifera biological responses were mostly studied and the most investigated compounds are insecticides. A. mellifera was studied more in the laboratory than in field conditions. Through the observation of the different responses examined, we found that there were several knowledge gaps that should be addressed, particularly within enzymatic and molecular responses, such as those regarding the immune system and genotoxicity. The importance of developing an integrated approach that combines responses at different levels, from molecular to organism and population, needs to be highlighted in order to evaluate the impact of anthropogenic contamination on this pollinator species.


Introduction
Honey bees (Apis mellifera) are essential organisms for the environment, in particular for their critical roles in the pollination of crops, flowers, and fruit trees [1][2][3]. It has been estimated that honey bees are responsible for providing a pollination service to 96% of animal-pollinated crops [4,5]. Bees are also indirectly responsible for the reproduction and maintenance of wild plant communities and biodiversity [6][7][8]. Their value to global food crops is estimated at €153 billion per year [9]. In addition, honey bees provide honey, pollen, wax, propolis, and royal jelly to humans [10]. Throughout the last decade, declines in bees and other pollinators have been observed globally [11][12][13]; important honey bee colony losses have been reported, particularly in North America and Western Europe [14][15][16]. It was beekeepers who alerted the scientific community of this vital colony mortality, since they monitor bee colonies worldwide and are immediately aware of any kind of changes to the bees' colony [17]. This decline has led to concerns over there being a sustainable food supply and the health of natural ecosystems [18]. The causes of pollinator decline may be complex and subject to disagreement. However, the general weakening and death of bee colonies has been observed to be mainly caused by the combined effects of multiple stressors [3,[19][20][21], such as biological factors [22,23], environmental factors [19,24,25], chemical and nutritional stressors [26,27], chemical and biological factors [28][29][30][31][32][33] and multiple chemicals [34][35][36]. In particular, this last kind of stressor is a matter of great concern since bees can be exposed to a wide range of chemical mixtures, including anthropogenic compounds, such as plant protection products (PPPs) or veterinary drugs, and those of natural origin, such as mycotoxins, flavonoids and plant toxins [20,37,38]. Although PPPs, such as insecticides, acaricides, herbicides, and fungicides, have many benefits for agriculture [39], there are also several potential risks associated with their use, such as pest resistance, resurgence, and secondary pest outbreaks, as well as wider environmental contamination and human health concerns [40][41][42]. Although insecticides are applied to target insect pests, their use in agriculture can affect non-target insects that provide beneficial services to agriculture. Among these beneficial insects, the focus was on social bees, with a particular interest in neonicotinoid insecticides and their lethal and sublethal effects at colony and population levels. Nonetheless, other PPPs used in modern agriculture, such as fungicides and herbicides, were demonstrated to affect honey bee's health status [43][44][45][46].
The sublethal effects of PPPs and other anthropogenic contaminants in Apis mellifera need to be investigated. A wide range of studies investigated mortality and accumulation in honey bees, in order to obtain data related to contamination that may affect these organisms [33,[47][48][49]. Moreover, studies concerning the general fitness of honey bees, which examined their behaviour, flight activity, and sensory ability, were conducted over the years to observe the macroscopic effects of contaminants [48,[50][51][52]. To a lesser extent, enzymatic and molecular responses have also been studied, using genomic, metabolomic, and transcriptomic techniques and biomarkers [43,[53][54][55][56], in order to increase understanding of the anthropogenic impact on these insects.
The current manuscript aims to provide a review of the available toxicological studies about the biological responses of honey bees to external stressors. In particular, we focused on where studies were carried out, we examined the contaminants involved, methodological approaches, honey bees' life stages, and the different kind of responses considered in each paper, with the purpose to determine and identify knowledge gaps. This review could also provide indications regarding possible improvements in the monitoring approach, both in a scientific and regulatory way.

Materials and Methods
The search for scientific papers was conducted on ScienceDirect, Google Scholar, and One search database, using the following search terms to find relevant literature: "Apis mellifera", "honey bees", "biomarkers", "ecotoxicology", "toxicology", "sublethal effects", and "biochemical analysis". To extend the collection of the relevant literature, the bibliographical references of each article were also examined. The selected articles were written in English and the full text version is available. Grey literature and non-accessible peer-reviewed articles were not included in our work, and this resulted in a primary dataset of 846 publications.
Papers considered for this review included investigations into toxicity effects, sublethal behavioural effects, impacts on bees at a genetic, molecular, or physiological level. Studies that reported only LC50 and LD50 were omitted from our analysis. The final dataset included a total of 106 research papers. For each paper, we extracted the following information: a complete bibliographical reference, a methodological approach, the investigated compounds, the life stage, and the studied responses. Where multiple categories of any variable were reported in the same paper, all were included in the final analyses. Methodological approaches were divided into three categories: "laboratory", "semi-field" and "field". "Laboratory" studies were defined as those carried out within the laboratory, with the exposure of honey bees to contaminants. "Semi-field" studies were defined as those that were conducted outdoors, but confined to bees, e.g., using exclusion cages. "Field" studies were defined as studies conducted outdoors with no restriction on the bees' movements and the data were collected in the field.
The following life stages were considered: "Brood", "Pupae", "Larvae", "Adults" and "Queens". If the life stages at which bees were exposed to pesticides differed from the life stage at which the effects were measured, then both were included in the final analyses.
Examining the existing literature, we described fifteen different "effect types" that were assessed, including morphology, apoptosis and necrosis, histopathology, cytotoxicity, consumption, foraging activity, and fitness, learning ability, other behaviours, physiological function and morphology, reproduction, sensory (gustatory or olfactory), flight activity, growth and development and, accumulation. Research studies were placed into multiple categories if they contained more than one effect type.
Moreover, we isolated more specific responses, mostly characterized by biomarkers and transcriptomic, metabolomic, proteomic approaches, in nine endpoints: detoxification, neurotoxicity, immunity, metabolism, oxidative stress, genotoxicity, primary stress response, carbohydrates assay, and protein amounts. Where studies included more than one option in any of the variables measured, it was included in analyses of both.

Where Studies Took Place
Most studies examined for this review were carried out in Europe (48) and North America (35), followed by Asia (11) and South America (9), Africa (8) and Australia (3) (Figure 1). The compounds studied in the papers were divided into insecticides, herbicides, fungicides, acaricides, trace elements, polycyclic aromatic hydrocarbons (PAHs), parasites, radioactivity, mixtures, and other compounds.
The following life stages were considered: "Brood", "Pupae", "Larvae", "Adults" and "Queens". If the life stages at which bees were exposed to pesticides differed from the life stage at which the effects were measured, then both were included in the final analyses.
Examining the existing literature, we described fifteen different "effect types" that were assessed, including morphology, apoptosis and necrosis, histopathology, cytotoxicity, consumption, foraging activity, and fitness, learning ability, other behaviours, physiological function and morphology, reproduction, sensory (gustatory or olfactory), flight activity, growth and development and, accumulation. Research studies were placed into multiple categories if they contained more than one effect type.
Moreover, we isolated more specific responses, mostly characterized by biomarkers and transcriptomic, metabolomic, proteomic approaches, in nine endpoints: detoxification, neurotoxicity, immunity, metabolism, oxidative stress, genotoxicity, primary stress response, carbohydrates assay, and protein amounts. Where studies included more than one option in any of the variables measured, it was included in analyses of both.

Where Studies Took Place
Most studies examined for this review were carried out in Europe (48) and North America (35), followed by Asia (11) and South America (9), Africa (8) and Australia (3) (Figure 1).

Methodological Approaches
As shown in Figure 2, most studies were carried out under laboratory conditions (63), with 14 studies carried out in semi-field conditions, and 25 at the full field scale.

Methodological Approaches
As shown in Figure 2, most studies were carried out under laboratory conditions (63), with 14 studies carried out in semi-field conditions, and 25 at the full field scale.

Life Stages
The bibliographical research highlighted that most of the studies, as shown in Figure 3, were conducted on adult bees (99), followed by larvae (9), brood (7), and pupae stage (4). Only 2 studies, that met the criteria of this work, were about queen bees.

Studied Compounds
Insecticides were investigated in 71 studies, followed by trace elements, in 15 papers. Studies on acaricides (12), herbicides (12), and fungicides (11) were present with a similar number. Mixtures and PAHs are still poorly studied, respectively with 8 and 2 papers ( Figure 4). In the "other compounds" category, SO 2 , ethyl methane-sulfonate (EMS), ethanol and pharmaceutical compounds were included. In the category "parasites" are present not only papers that examined reactions to parasites but also other contaminants; there are not any papers that studied only parasites since they did not satisfy the criteria used for this review.

Life Stages
The bibliographical research highlighted that most of the studies, as shown in Figure  3, were conducted on adult bees (99), followed by larvae (9), brood (7), and pupae stage (4). Only 2 studies, that met the criteria of this work, were about queen bees.

Studied Compounds
Insecticides were investigated in 71 studies, followed by trace elements, in 15 papers. Studies on acaricides (12), herbicides (12), and fungicides (11) were present with a similar number. Mixtures and PAHs are still poorly studied, respectively with 8 and 2 papers ( Figure 4). In the "other compounds" category, SO2, ethyl methane-sulfonate (EMS), ethanol and pharmaceutical compounds were included. In the category "parasites" are present not only papers that examined reactions to parasites but also other contaminants;

Life Stages
The bibliographical research highlighted that most of the studies, as shown in Figure  3, were conducted on adult bees (99), followed by larvae (9), brood (7), and pupae stage (4). Only 2 studies, that met the criteria of this work, were about queen bees.

Studied Compounds
Insecticides were investigated in 71 studies, followed by trace elements, in 15 papers. Studies on acaricides (12), herbicides (12), and fungicides (11) were present with a similar number. Mixtures and PAHs are still poorly studied, respectively with 8 and 2 papers ( Figure 4). In the "other compounds" category, SO2, ethyl methane-sulfonate (EMS), ethanol and pharmaceutical compounds were included. In the category "parasites" are present not only papers that examined reactions to parasites but also other contaminants; there are not any papers that studied only parasites since they did not satisfy the criteria used for this review.

Effect Type
Most studies used for this review investigated more than one effect (64 studies) on honey bees but 42 studies concentrated on investigating just one effect. The most widely studied single effect type was accumulation (20) followed by foraging activity (15) studies ( Figure 5). Figure 6 shows studies regarding enzymatic and molecular responses (58): the effects that were studied in more depth were detoxification (27) and neurotoxicity (26), followed by metabolic responses (21), immunity (17), and oxidative stress (15).

Effect Type
Most studies used for this review investigated more than one effect (64 studies) on honey bees but 42 studies concentrated on investigating just one effect. The most widely studied single effect type was accumulation (20) followed by foraging activity (15) studies ( Figure 5). Figure 6 shows studies regarding enzymatic and molecular responses (58): the effects that were studied in more depth were detoxification (27) and neurotoxicity (26), followed by metabolic responses (21), immunity (17), and oxidative stress (15).

Effect Type
Most studies used for this review investigated more than one effect (64 studies) on honey bees but 42 studies concentrated on investigating just one effect. The most widely studied single effect type was accumulation (20) followed by foraging activity (15) studies ( Figure 5). Figure 6 shows studies regarding enzymatic and molecular responses (58): the effects that were studied in more depth were detoxification (27) and neurotoxicity (26), followed by metabolic responses (21), immunity (17), and oxidative stress (15).  In the following tables, all the examined papers are summarized by endpoint; there are two tables for each methodological approach, one for cellular to whole organism and population endpoints, and one for molecular and enzymatic endpoints.
Endpoints examined in laboratory studies are summarized in Tables 1 and 2. Table 1 shows two endpoints were most used in laboratory studies, "foraging activity/fitness/production of matrixes" and "sensory (gustatory or olfactory)", both with a total of 12 papers. Table 2 shows the molecular and enzymatic endpoints examined in laboratory studies. The most studied effect concerned "neurotoxicity" (24 studies) and the test that was applied most frequently was the acetylcholinesterase (AChE) activity; only two papers examined the presence of trembling, hyperactivity, and paralysis in the organisms exposed mostly to insecticides. The second most investigated endpoint was "detoxification", with studies mostly concerning the activity of glutathione-S-transferase (GST) or CYP450. Another endpoint with a considerable number of papers (17) was "metabolism", in which alkaline phosphatase (ALP) and ATPase were mostly examined. "Oxidative stress" endpoint was examined only in 14 papers, evaluating the activity of antioxidant enzymes such as catalase (CAT) and superoxide dismutase (SOD). Insecticides, fungicides, Figure 6. Number of studies, divided by molecular and enzymatic responses, on Apis mellifera, that met the criteria for inclusion in this review.
In the following tables, all the examined papers are summarized by endpoint; there are two tables for each methodological approach, one for cellular to whole organism and population endpoints, and one for molecular and enzymatic endpoints.
Endpoints examined in laboratory studies are summarized in Tables 1 and 2. Table 1 shows two endpoints were most used in laboratory studies, "foraging activity/fitness/ production of matrixes" and "sensory (gustatory or olfactory)", both with a total of 12 papers. Table 2 shows the molecular and enzymatic endpoints examined in laboratory studies. The most studied effect concerned "neurotoxicity" (24 studies) and the test that was applied most frequently was the acetylcholinesterase (AChE) activity; only two papers examined the presence of trembling, hyperactivity, and paralysis in the organisms exposed mostly to insecticides. The second most investigated endpoint was "detoxification", with studies mostly concerning the activity of glutathione-S-transferase (GST) or CYP450. Another endpoint with a considerable number of papers (17) was "metabolism", in which alkaline phosphatase (ALP) and ATPase were mostly examined. "Oxidative stress" endpoint was examined only in 14 papers, evaluating the activity of antioxidant enzymes such as catalase (CAT) and superoxide dismutase (SOD).
In semi-field studies, the most frequently studied endpoints are "foraging activity/fitness/production of matrixes" and "other behaviors", both with 6 studies (Table 3). In Table 4 the molecular endpoints are summarized; in this case the most examined endpoints (3 studies) were "protein amount" and "immunity", followed by "detoxification", with 2 papers.
The endpoints examined in field studies are summarized in Tables 5 and 6. Table 5 shows that 16 studies observed "accumulation" in the honey bees sampled in sites with different levels of anthropogenic pressure. In general, herbicides and insecticides were the contaminants that tended to be observed more in these accumulation studies.          Table 6 shows molecular endpoints examined in field studies. The effect that was studied with the highest degree of frequency concerned "detoxification" and "metabolism", both with 5 papers. The next two endpoints that were examined with a good degree of frequency were "neurotoxicity" and "oxidative stress"; the first was observed through the evaluation of AChE activity, the second mostly with the observation of CAT and SOD activity.

Discussion
The exposure of honey bees to environmental pollutants, especially agrochemical products, is causing a decline in their colonies [11,144], leading also to consequences for crop production, food security, and environmental health. For this reason, it is important to understand primarily both the benefits and the risks that the use of PPPs pose to the environment in order to make decisions about agricultural management. To determine the role of pesticides and other contaminants and their impact on honey bees it is essential to understand the kind of studies that have been conducted until now.
The majority of studies into the effects of pollutants on bees have been undertaken in North America and Europe, where important honey bee colony losses have been reported [14][15][16]. However, this phenomenon should be studied globally, in order to ascertain a better understanding of its causes. Although, PPPs tend to be most widely used in developed countries, they are increasingly being used in other parts of the world where regulations and best practices around their environmental impacts may not be as stringent [145].
The great majority of examined papers were about adult honey bees; it would be useful for there to be an improvement in the studies conducted related to other life stages, in order to have a better understanding of whether and how environmental contaminants may affect every stage of a honey bee's life cycle.
This review underlined that the majority of studies on honey bees are carried out in a laboratory more than in semi-field and field conditions, in a controlled environment and with controlled environmental exposure to the selected substances. The vast majority of papers about laboratory experiments reviewed focused on the sublethal effects, mostly about foraging activity, sensorial ability, neurotoxicity, detoxification, metabolism, and oxidative stress. In semi-field studies different responses both at macroscopic and microscopic levels were considered; however, in this review, only 14 papers of this kind were found. Honey bees, in the field, are exposed to multiple stressors and most of the field papers were monitoring studies where accumulation of various contaminants in Apis mellifera were investigated; only 8 papers [28,33,50,57,62,71,83,95] analysed the sublethal effects of the contaminant mixtures on Apis mellifera. All these studies highlighted that honey bees are sensitive bioindicators of environmental pollution. Therefore, it is only through context monitoring that the honey bees decline should be examined, in order to understand its causes and to provide effective prevention tools to administrations.
In this review, it is highlighted that the most widely investigated PPPs are insecticides, because they were demonstrated to be harmful to non-target organisms, such as honey bees. Different authors observed that neonicotinoid insecticides, such as imidacloprid, thiamethoxam, acetamiprid, dinotefuran, thiacloprid, nitenpyram, and clothianidin, are able to damage honey bees olfactory learning performances [65,76,78], foraging activity [65,68,69], and homing flight abilities [119]. This kind of compounds may cause neurotoxicity in honey bees, by altering AChEactivity which may be induced [97] or inhibited [84], and by modulating carboxylesterase (CaE) activity [53,82]. Furthermore, detoxification and antioxidant enzymes activities seem to be altered by neonicotinoids, such GST [53,81,82], CAT [53], PPO [84], ALP [53] and CYP450 [94] activities. Moreover, these compounds may affect the immune system for instance, by modulating the content of vitellogenin [47,101], by reducing the hemocytes density, encapsulation response and antimicrobial activity [83], and by modulating the relative abundance of several key gut microbial molecules [66]. Several authors studied the effects of pyrethroid insecticides, such as deltamethrin, bifenthrin, cypermethrin, permethrin, and λ-cyhalotrin, on honey bees; these compounds seems to cause neurotoxicity by increasing AChE activity [59,91], modulating CaE activity [55]. Pyrethroids caused variations in lipid [107] and carbohydrates [96], reduced learning, memory performances [62,72] and foraging activity [67], and influenced bees locomotion and social interaction [117]. This class of insecticides is also able to cause variations in metabolic and detoxification activities, such as increasing GST activity [89,136], modulating ALP activity [107], inducing the expression of CYP450 monooxygenase [86], and inhibiting Na + , K + -ATPase activity [96]. Moreover, they may induce immune responses, cause changes in the activity of POD and in the content of MDA and LPO and induce oxidative stress [59]. Authors, who studied organophosphorus insecticides effects, observed an inhibition in the odour learning [79], a modulation of AChE activity [75,77,84,95], a modulation of different immune system related genes and an induction of vitellogenin transcript [86]. El-Saad et al. (2017) [56] observed midguts ultrastructural modifications, a reduction of GSH levels, an inhibition of SOD, CAT and GPx activities, and an increase in MDA levels.
A recent review [146] underlined that other PPPs, such as fungicides and herbicides, that are not designed to target insects, may be factors that influence honey bees decline. For this reason, it would be important to increase the number of studies conducted related to their effects on these pollinators. Papers included in this review showed that the most frequently studied herbicide was glyphosate; it seems to cause a more indirect homing flight [122], to reduce sensitivity to sucrose and learning performance [69], to delay worker brood development [120], to have effects on the expression of CYP isoforms genes [87], and to slightly inhibit AChE activity [97].
Moreover, we believe that studies regarding other pollutants, such as PAHs and trace elements, should be improved, because of their presence in the environment that could cause honey bees exposure and adverse effects. Studies on trace elements underlined that pollutants, like aluminum, cadmium, selenium, lead, and copper, are able to influence foraging behavior [63,70] and the development time [51,66], to cause histopathological alterations [57], to alter AChE, ALP, GST [43,54], CAT and SOD [107,140] activities. The European Food Safety Authority (EFSA) pointed out that the study of the impact of mixtures of chemicals also compared to non-chemical stressors, like Varroa destructor and viruses, on honey bee health are of great relevance, in view to support the implementation of a holistic risk assessment method [147,148].
In field studies, it is more difficult to understand the effects caused by single contaminants, due to the presence of multiple stressors. Up to now, few papers have investigated the sublethal effects on honey bees in their natural conditions and habitats. Badiou-Bénéteau et al. (2013) [54] and Nikolić et al. (2015) [135] highlighted the presence of sublethal effects, characterized by oxidative stress and the induction of detoxification processes, in honey bees from more anthropized areas, due to the presence of neurotoxic pollutants, such as metals. Lupi et al. (2020) [44] observed that pesticide mixtures, characterized by the combination of fungicides, insecticides, and plant regulators, could cause an increase in Reactive Oxygen Species (ROS) that can inhibit AChE and CAT activities. An inhibition of some antioxidant stress biomarkers (GSH, SOD, CAT, GST) was also observed in specimens collected from anthropized areas [56]. Nicewicz et al. (2020) [141] observed the importance of defensin and HSP70 levels as indicators of urban multistress both at individual and colony levels. Further studies are needed to investigate the ecotoxicological status of honey bee colonies.
Another aspect to be pointed out is that in all three types of experimental conditions (laboratory, semi-filed and field), research studies have focused their attention on the development of some biomarkers to assess exposure to and the effects of contaminants on honey bees, such as esterases activity to evaluate neurotoxic effects, antioxidant enzymes activity, and predominantly CAT and SOD, together with detoxification reactions and metabolic activity. However, several responses, such as genotoxicity and immune system alteration, remain poorly explored and require an increased interest and a significant degree of effort to ensure that research studies are conducted. Colin et al. (2004) [116] observed, for example, that the suppression of the immune system may lead to a decrease in the individual performance and consequently in the population dynamics and the degree of disorders present in the colony. Moreover, Lazarov and Zhelyazkova (2019) [149] observed that Varroa destructor infestations are responsible for the weakening of honey bees' immune system, which may lead to a pronounced susceptibility of honey bees to contaminant exposure. To the best of our knowledge, Caliani et al. (2021) [43] is the only study that has been conducted into genotoxicity and that has examined Apis mellifera; in this study, it was observed that there are not only compounds such as EMS, with known genotoxic effects; indeed, there are also Cd and fungicides that have effects on the presence of hemocytes nuclear abnormalities.
While we have investigated the range of research approaches that have been used to study potential effects of contaminants on honey bees and provided a summary of main investigated effects (Tables 1-6), a full evaluation of effects direction was beyond the scope of this research. As there are 106 papers included in this review it is clear that there is an increasing corpus of literature that examines the effects of a wide range of compounds on bees. Only when certain research gaps are addressed, may this area benefit from a meta-analysis in the future to establish a clearer picture of the magnitude and direction of each effect.

Conclusions
The current review highlighted that Apis mellifera biological responses to external stressors were studied mostly in Europe and North America; consequently, there is a notable need to increase monitoring in other regions. Insecticides are widely studied compounds compared to other PPPs, or other classes such as e PAHs and trace elements. Laboratory studies are useful in order to determine the effects of specific compounds; however, field studies should be implemented, in order to gain a better understanding of the ecotoxicological status of A. mellifera in relation to environmental contamination patterns. Through the observation of the different responses examined by the authors, several gaps have been identified that should be addressed, particularly within enzymatic and molecular responses, such as those regarding immune system and genotoxicity. The development of an integrated approach, supported by statistical models could be vital, in order to combine responses at different levels, from molecular ones to the organism and the population. This could be a valid tool to evaluate the impact of contamination on these organisms and to support monitoring strategies not only at a scientific level, but also at a regulatory one.