{'fraction_non_alphanumeric': 0.03235757866593542, 'fraction_numerical': 0.015698909988345788, 'mean_word_length': 4.690462258630778, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An Artificial Neural Network-based Prediction Model for Utilization of Coal Ash in Production of Fired Clay Bricks: A review

: This study analyzed the last 20 years` data available on power plant coal ashes used in clay brick production. The statistical analysis has been carried out for a total of 302 cases based on the relevant parameters reported in the literature. The chemical composition of the clays and coal ashes, percentage incorporation and maximum particle size of ash, size of fired samples, peak firing temperature, and the corresponding soaking time were selected as inputs for modeling. The product characteristics i.e. open porosity, water absorption, and compressive strength was taken as output parameters. An artificial neural network model has been developed and showed a satisfactory fit to experimental data and predicted the observed output variables with the overall coefficient of determination (r 2 ) of 0.972 during the training period. Besides, the reduced chi-square, mean bias error, root mean square error, and mean percentage error were utilized to check the correctness of the obtained model, which proved the network generalization capability. The sensitivity analysis of the model suggested that the quantity of Na 2 O coming from brick clays, the percentages of SiO 2 and K 2 O coming from ashes, and MgO coming from clays were the most influential parameters in descending order for the ash-clay composite bricks` quality, mostly owing to the influence of fluxes during firing.


Introduction
Coal ash (CA) is the major waste generated in thermal power plants. Its` quantity is constantly growing with the increase in the number of thermal power plants to meet the huge electricity demand. Coal ashes contain significant concentrations of heavy metals; however, they are not hazardous according to the United States Environmental Protection Agency. The main problems concerning the ashes are their troublesome and costly disposal. They are mostly being used as secondary raw materials in the road embankments, the building construction, and the cement industry [1][2][3].
The properties of CAs significantly depend on the quality of coal used and the combustion process. At first sight, the ashes can be broadly divided into two categories: fly ashes (rich in fine particle fraction) and bottom ashes (rich in coarse particle fraction). Fly ash (FA) is gathered from exhaust gases through a dust collector, bag filter, and an electrostatic precipitator. The bottom ash (BA) is gathered from the furnace bottom after incineration. Generally, the thermal power plant generates about 20-80 % of BA, depending on the process conditions and the type of furnace used. BA is considered to be of lower quality since the pozzolanic ability is relatively lower. FA and BA are directly provided to the industries for their effective end-utilization. However, the excess quantities of FA and BA are commonly disposed of in nearby water ponds to minimize the air pollution caused due to fine particles of coal ashes. The mixture of FA and BA found at the disposal ponds is known as pond ash (PA), and is often not a uniform material. The coal ashes differ significantly in physical properties, but may also differ in chemical compositions due to significant variation in unburnt particles [4]. One of the most significant problems for utilization of the ashes arises due to the widely differing quantities of silica and alumina contents [5,6]. Besides, the quality of CA also depends on the type and the age of coal used and the leftover quantity of calcium after the burning process. For example, the anthracite, as the older deposit, gives the ash containing about 10 wt.% of CaO when burnt, whereas, in the case of the younger sediments (sub-bituminous coal), the coal ash possesses more than 20 wt.% of CaO [5].
The macro-oxides content in coal ashes is somewhat similar to that of brick clays; the main constituents of both materials are silica, aluminum oxide, and iron oxide. This allows the coal ashes to be used in large quantities in the brick industry. In addition to incorporating the waste itself, there are several other environmental advantages concerning the implementation in the brick industry. Coal ash-clay bricks require less energy in the firing phase since most of the ashes` material is already burnt in the thermal power plants. Also, these products are of lower unit weight than traditional ones (up to 10-20 %) which decreases the transport costs, facilitates easier handling, and improve the thermal insulation properties [1]. Intensive research studies were carried out to evaluate the potential of coal ash utilization in the formulations of ash-clay bricks in the last decades [2,5,[7][8][9][10][11][12][13][14][15][16][17]. Since the chemical composition of the brick clays and coal ashes vary, the present investigation is aimed to summarize all the available results and identify the most influential factors affecting the quality of common clay bricks and coal ash bricks, through a mathematical model. The work explores the suitability of coal ashes in the production of bricks depending on their chemical composition. The database used in the present study consisted of the 302 cases obtained from the available literature for the period from the year 2001 to 2020. In the previous studies [4,13,14], Artificial Neural Network was used successfully to predict the mechanical properties of building construction materials. In this study, the parameters of interest concerning the relevant raw materials` and process` parameters were tested using Analysis of Variance, and 25 inputs were chosen to describe 6 outputs (as described in the next section). The Artificial Neural Network (ANN) model was built, and its predictive properties were tested on many levels. The developed model has a practical application by using it as software to predict open porosity, water absorption, and compressive strength of the clay-ash bricks. The model can be updated in the future by including the new data on the same subject, when available. Further, the global sensitivity method was used for determining the influence of the input parameters on the outputs. The important and crucial parameters in defining the final product`s characteristics could be concluded based on this analysis.
Artificial Neural Networks (ANN) modeling was applied in this study to describe the characteristics of clay bricks (sign b in indexes) and bricks made of coal ash-clay mixtures (sign m in indexes).

Input and output parameters
The list of inputs included the parameters related to clay and ash characteristics, resultant blended mix, and the other parameters related to the brick manufacturing process as shown in Table I. The parameters related to clay characteristics were the percentage content of major oxides and the loss on ignition of the clay used for brick production. Similarly, the parameters related to ash characteristics were the percentage content of commonly occurring oxides and the loss on ignition of the ash used for brick formulations. The other input parameters were the percentage weight of ash in the resultant blended mix (w/w), maximum particle sizes of the ash (PS max ), peak firing temperature (FT), corresponding soaking time at peak firing temperature (StFT), and the bearing surface of samples (S). The output parameters considered were the open porosity (OP b and OP m ), the water absorption (WA b and WA m ), and the compressive strength (CS b and CS m ) for clay bricks and coal ash-clay mixture bricks respectively as shown in Table I The considered input parameters, obtained from the literature, were measured using different methods and techniques. Macro-oxides contents in brick clays and coal ashes were determined by different techniques such as classical silicate analysis [6], X-ray fluorescence spectrometer [1, 3, 9, 11-15, 18, 19, 21, 27, 29, 30], Scanning Electron Microscopy with energy-dispersive X-ray spectroscopy [2], and Inductively Coupled Plasma mass spectroscopy [10]. The results are summarized in Table II.
Particle size distributions of coal ashes were determined by wet [5,6,13,14,22,24,28,30], and dry sieving [8], while in some studies [1,3,9,11,12,25,29], the samples were sieved or ground and certain fractions were used for the brick production. In the present study, the maximum particle size of the ash (PS max ) used for brick production was considered as the input parameter.
The samples were cast by hand in a mold [25,26,31], hydraulically pressed [2,3,5,8,11,18,22,29,30], or shaped in a vacuum extruder [1, 9, 10, 13-15, 19, 21, 27, 30]. In most of the studies considered, dimensions of the samples were determined by caliper, and the sample's bearing surface was calculated. In the present study, the bearing surface of the specimen (S) was considered as representative of size in the list of input parameters. Index c refers to the brick clays, and the index a refers to the ashes.
Similarly, the considered output parameters were measured using different methods and techniques. The open porosity (OP b and OP m ) of bricks was calculated after measuring the weight of dry samples, and saturated wet samples in the air and water according to the standard procedure [1, 2, 3-5, 12-14, 20, 29, 30]. The water absorption (WA b and WA m ) of bricks was determined in a standard way using the water-saturated weight and the oven-dried weight. The samples were soaked in distilled water in ambient conditions, whereas, in some studies [1-3, 5, 9, 11, 12-15, 21, 23-31], the water absorption was determined by the boiling method. The bricks were tested for compressive strength (CS b and CS m ) using a hydraulic press and by following the standard procedure [1-5, 9, 10-15, 18, 20, 22-26, 28-31].

Statistical analysis and Artificial Neural Network modeling
The STATISTICA 10.0 (StatSoft Inc. Tulsa, OK, USA) software was used for testing the data and the ANN modeling. The gathered database of the considered 302 cases is first examined using Principal Components Analysis to test the variability of the parameters, and then, the input and output parameters (as previously shown in Table I) were selected for ANN modeling. Artificial Neural Networks were built following the procedure which was the most efficient as per the previous studies on a similar subject [13,14,[32][33][34][35]. A multilayer perceptron model consisting of three layers was used for building the network, while constantly minimizing the differences between the network predicted and experimental results. Thus, Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithm is utilized within the program. The coefficient of determination (r 2 ), reduced chi-square (χ 2 ), mean bias error, and also root mean square and mean percentage errors were used to check the correctness of the obtained model [34,36].

Global sensitivity analysis
This study consisted of 25 input variables, which would make the classical sensitivity analysis very complex [37], so the influence of the input parameters on the output parameters (properties of final brick products) was simultaneously analyzed using the global sensitivity method for establishing the relative importance of each variable on the model output [38]. The relative importance of the input variables is estimated using Equation 1, according to the methodology previously proposed for global sensitivity analysis [39]: where RI ij presents the relative importance of the i th input variable on the j th output, w ik means the weight between the i th input and the k th hidden neuron, and w kj is the weight between the k th hidden neuron and the j th output, while abs represent the absolute value. The first-hand analysis of the database was done by observing the percentual differences of clay bricks and coal ash-clay bricks characteristics (open porosities, water absorptions, and compressive strengths). The highest average changes in coal ash-clay bricks were observed in water absorption values (+17.44 %), while changes in open porosities were a bit lower (+12.57 %). The compressive strengths were lowered with the addition of coal ashes for 4.63 % on average. The general rule is that the unburned parts of the ashes introduced the new pores in the system while decreasing the strength of the fired products [8,28,30]. In some of the studies, the changes in product quality were vice-versa (improved compressive strength or/and lowered water absorption in coal ash-clay bricks compared to clay bricks) [2,6,26,40]. Besides, with the addition of coal ashes up to 60 %, WA m was up to about 20 %, and with a higher share of coal ashes, it went up to over 40 %. Generally, the amounts of waste higher than 50 % introduced more significant changes to the outputs. However, the higher contents of CA in the mixtures are not a constraint in the quality of products [14]. It must be emphasized that the increased content of the ashes lowers the plasticity and makes the extrusion process difficult if the plasticizer is not added [2]. In the case of maximally increased values of CS m and OP m , it seems that the reason behind is not the content of the ash, but the chemical composition (mostly the quantity of CaO, MgO, Al 2 O 3 , and SiO 2 ). WA maximally decreased in the cases when there was more or equal to 65 % of SiO 2 and up to about 6 % of CaO and MgO in the clay-ash mix [1,9,18,25]. These general remarks were further checked and analyzed in-depth with the use of mathematical modeling and analysis. The literature-gathered database was at first checked using Analysis of Variance to test the variability of the input parameters. The parameters that showed low variability were the contents of SO 3 in brick clays (0.65 % on average) and the contents of MnO in the ashes (0.11 % on average), and thus they were excluded from the modeling. Box & Whisker plots for the output parameters are shown in Fig. 1. The performance of the bricks fired in different furnaces is compared in Fig. 1a and Fig. 1b. The compressive strengths were found to be the highest for the samples fired in tunnel kilns as compared to products fired in electric furnaces and chamber kilns for both clay bricks and coal ash-clay bricks. When the coal ash with a higher CaO content (the ash of class C) was used, the values of WA m were found higher than the cases using class F ashes. The compressive strength, CS m was also lower in the case of the ash of class C (Fig. 1). This indicated that class F ashes are more favorable to be used in the brick industry, which is already observed earlier [21].

Results and Discussion
Principal components analysis is done to present the positions of the samples and output parameters in an orthogonal space. The used methodology was in more details explained in the previous study [14]. Based on the statistical analysis of the observed outputs, it is seen that there were two statistically significant factor coordinates. In factor 1, the variances that participated the most were of OP c , OP m , WA c , and WA m . The factor 2 constituted mostly of CS c and CS m . Eigenvalues of these two factors contributed to a high ability to describe the chosen parameters since they covered about 84 % of the system variability. It is evident from Fig. 2   To sum the effects of the observed inputs over the outputs, the contour plots were made and shown in Fig. 3 and Fig. 4. The weight percent of the added ashes considerably increased water absorption and decreased compressive strength, but the firing temperature is more influential then w/w (Fig. 3b). CSm increased with the rise of FT and StFT, as seen in Fig. 3c. The researchers used peak temperatures between 1140 and 1300 °C in the case of higher w/w (in between 60 and 90 %) when WAm was up to 10 % (Fig. 3d). Considering the chemical content, more calcite in clay and lower amounts of K 2 O in the ashes increased the water absorption (Fig. 4a), the complicated relationships of silica and K 2 O from the ashes and (Na 2 O) c are seen in Fig. 4b, Fig. 4c, and Fig. 4d. It is concluded that the relationships between the followed parameters are very complex and that mathematical modeling must be employed.

ANN modeling
Artificial Neural Networks (ANN) modeling was applied in this study to describe the characteristics of common clay bricks and bricks made of coal ash-clay mixtures. Since there was no sufficient data in the literature regarding firing in a tunnel and chamber furnaces, the variable that could distinguish the type of the furnace used was not considered as an input parameter. However, it is indirectly contained in the parameter describing the soaking time at peak temperature. A similar situation was with the categorical parameter that would describe the type of coal ashes. However, that information was again included indirectly in the chemical analysis. It must be emphasized that introducing the parameter that is already contained in the inputs lowers the quality of the developed network.
According to the ANN performance, the optimal number of neurons in the hidden layer for the six output parameters (OP b , OP m , WA b , WA m , CS b , and CS m ) was 17 (network MLP 25-17-6). The network gave high values of r 2 (overall 0.972, during the training period) and low values of SOS (Table III). The goodness of fit between experimental measurements and model calculated outputs, represented as ANN performance (sum of r 2 between measured and calculated output parameters OP b , OP m , WA b , WA m , CS b , and CS m ), during training, testing, and validation steps, are shown in Table IV. Samples for these steps were chosen using the random function, by dividing the collected database to 60 % for training, and 20 % each for testing and validation [37].
Tab. III Summary of the parameters related to the developed ANN model. ANN models predicted the output values (OP b , OP m , WA b , WA m , CS b , and CS m ) satisfactorily for a broad range of the chosen parameters. This conclusion can be seen in Fig.  5, where the experimentally measured and the ANN model`s predicted values of the outputs are presented as r 2 values. The least scattering of the results was observed with the standard bricks. CS m showed the lowest accuracy during prediction, which means that the high variability of the results is obtained, which may be caused by the different dimensions of the samples. ANN models were highly complex (720 weights-biases) because of the intensive nonlinearity of the developed system [37]. The values of r 2 between experimental and ANN model outputs were between 0.951-0.991 during the training period (Table IV).
The quality of the model fit and the residual analysis were tested and presented in Table V. The ANN model showed a minor lack of fit tests, which means the model satisfactorily predicted the ANN outputs. To test the accuracy of the models, several methodologies were used (the coefficient of determination, r 2 ; the sum of squares, SOS; reduced chi-square, χ 2 ; mean bias error, MBE; root mean square error, RMSE; and mean percentage error, MPE) [37]. The predicted values were very close to the desired values (Table IV and Fig. 5). Error functions (SOS) obtained with the ANN models were of the same order of magnitude as in experimental errors.

The matrix for prediction of the quality of bricks
The computation of the outputs using the obtained ANN model is presented in the following Equation: where W 1 and B 1 represent the matrices associated with the hidden layer (weights and biases), while the output layer is presented with W 2 and B 2 . Y is the matrix of the output variables, f 1 and f 2 are transfer functions in the hidden and output layers, respectively, X is the matrix of the input variables. An exponential function was used in the hidden layer, while the logistic function is used as a transfer function in the output layer. Output variables can be calculated by applying transfer functions f 1 and f 2 in the hidden and output layers, respectively, onto the matrix of input variables X using Eq. (1).

Global sensitivity analysis -the relative importance of parameters
The method of weights partitioning [39] allows for determining the relative importance of the input parameters over the output parameters of ANN. The weights between the input, hidden, and output layers are used to calculate the relative importance of each of the input parameters (Fig. 6).
The highest influence on a global model behavior is determined in the case of concentration of fluxes in the mixtures. The highest relative importance was found in the case of concentration of Na 2 O in brick clays, then the quantity of SiO 2 and K 2 O in the coal ashes, and at last the concentration of calcite and magnesite in the clays. Na 2 O in clays is found mainly in the form of feldspar albite (NaAlSi 3 O 8 ), which is made up of particles larger than 10 μm. Since plasticity increases with the increase in finer particle fraction (below 2 μm), the coarser fraction not only lowers the plasticity, susceptibility to drying, and drying shrinkage, but also the water absorption and the open porosity. Free Na 2 O is also an important flux in these systems, that lower the melting point of the matrix. Besides, the remaining amorphous phase in the fired products also depends on the content of feldspars [41]. The importance of SiO 2 is ascertained by the fact that the ashes contain silica partly as quartz and partly in the form of other compounds such as mullite, anorthite, or cristobalite. Since silica was found in higher concentrations in clays than the ashes, the higher contents of the ashes decreased the overall percentage content of silica in the mixtures, and especially quartz [2], which increased water absorption and decreased compressive strength of the products. Quartz in ceramic bodies is important as its higher quantity can lower the matrix strength and decrease the melting point [36,41]. The quantity of large-sized particles, which lowers the strength during the cooling phase and increases the open porosity, is decreased with the addition of the ashes [36]. The addition of coal ashes lowered the contents of SiO 2 , K 2 O, CaO, and MgO in the matrix, which means that the fluxing characteristics are weaker when compared to the primary clay material [36,43]. Also, calcium-oxide can react with quartz or alumina/silica from clay minerals during high-temperature decomposition and form silicates, which increase compressive strength. In here present cases, it seems that this reaction rarely occurred since the clays were not rich in clay minerals or the carbonate grains were large. Grains of CaO larger than 1 mm increase porosity. The decreased content of (CaO) c influenced the drop in WA of the ash-clay bricks, as shown in Fig. 4.
The next in the line by the importance is the maximum particle size of the ashes. It is known that brick quality depends on the particle size of the raw materials as smaller particles enable faster sintering while forming more of a glassy phase, improving compressive strength, and eliminating the pores. Fine particles of CA reduce the final firing temperature, while the coarse particles promote crystallization, increase porosity, and lower the strength of the products [29].
LOI of CAs was higher than that of brick clays on average. Its importance is reflected in the fact that the ashes contain the remaining combustible components that give additional energy to the system. It is known that this parameter defers the low (high LOI results) and high (low LOI values) grade fly ash. Besides, the newly-introduced pores improve the insulating properties of the final bricks. The increased LOI generally influenced higher WA m values, but this parameter also showed a combined effect with the other, such as the origin of the burnt matter (carbonates or organic compounds).
TiO 2 in clays is considered as somewhat impassive. Titanium can be present in the form of oxide or titanate, as a constituent of hematite or rutile. Rutile is one of the most widely recognized minerals of titanium which appears as a supporting mineral in mica, granite, limestone, dolomite, quartz, hematite, and feldspar, which explains its` importance.
The soaking time at the final temperature was found to be the important input parameter [41]. It contained the information on the type of furnace used since industrial conditions require long soaking times. In the references included in this study, the soaking times in electrical furnaces varied from 0-10 h. There was only one variant for the soaking time (40 h) in the tunnel kiln, while in the chamber kilns the times varied from 72-360 h. TiO 2 introduced with the ashes showed an opposite influence compared to that of clays, since its` increased contents decreased open porosity and water absorption.
CaO was present in the ashes in higher quantities than that in brick clays, and it greatly affected the compressive strength of the products by lowering it. The calcite in clays was probably present in finer particle sizes, while in the ashes the grains were coarser. As mentioned before, the high CA quantities (above 50 %) significantly lower the quality of bricks in terms of compressive strength [45].
Class F ashes contain low SO 3 concentrations [46], but the higher contents are seen in ashes of Class C. The impact of sulfates from CAs was much more important than that of brick clays. The average content of SO 3 in CAs was 3.46 %, while clays contained 0.68 %.
With the higher addition of CAs, in the reduction atmosphere, there is a possibility of calcium sulfide occurrence. A black reduction core in the product lowers the compressive strength and the frost resistance [47].
The importance of the composition of Al 2 O 3 in the ashes reflected probably in the presence of mullite, which slightly lowered compressive strength and intensively increased water absorption [48].
Firing temperature, the surface of the samples, and the quantity of the added ashes were not as significant parameters as the others. It seems that the chemical composition of the two raw materials plays the greatest role in the final product quality.
This study can be improved, when more valuable data is available. The more numerous data concerning the firing of coal ash clay bricks in tunnel and chamber kilns are needed. Also, there is a lack of research studies related to bottom and pond ash usage in clay brick production. Besides the usually followed parameters that characterize the final brick products, more information is needed regarding their durability and frost resistance [48].

Conclusion
The leading idea of this study was to systematically analyze the usage of coal ashes generated in thermal power plants in clay bricks production. The database consisted of 302 cases incorporating 1 wt.% -90 wt.% of different types of coal ashes (fly, bottom, and pond ashes). The raw materials (clays and ashes) were characterized by the major oxides contents. Besides, the other ashes` characteristics i.e. particle size and quantity of ash incorporated were considered for modeling. The manufacturing parameters such as the size of the fired products, firing temperature, and the corresponding soaking time were also accounted for in the model. The product`s quality was described by open porosity, water absorption, and compressive strength for both the common clay bricks and the ash-clay bricks. The mathematical model is developed using Artificial Neural Networks which, by their high values of coefficients of determination and satisfactory fitting to the experimental data, can be used as software for predicting the quality of the products based on the raw material characteristics, composition, and processing conditions. Taking into account that a considerable amount and wide variety of data had been used to obtain the ANN models, it is expected to be very useful as a simple way to preliminary decide the product characteristics. The simulated values obtained from the ANN model were close to the actual values, thus the ANN model can act as a decision support system to attain the desired objective in the production of coal ash-clay bricks.
A global sensitivity analysis of the obtained models followed, which highlighted the greatest impacts of the studied parameters. It was found that the composition of the fluxes (Na 2 O, CaO, and MgO originating from the clay, and K 2 O introduced with the ashes) played the most important role in the quality of final products. Besides, silica introduced with the coal ashes showed up to be influential since lowering its total content in the matrix and thus demoting the appearance of silicates during firing.
Most of the literature is focused on the viability of making bricks from mixtures of clay and coal combustion residues with emphasis on the resulting physical and mechanical properties, but further investigations on the durability of products are needed. Besides, more experiments on firing coal ash clay bricks in tunnel and chamber kilns would be valuable in enriching the database, which would improve the model and consequent conclusions.