{'fraction_non_alphanumeric': 0.049976027300674054, 'fraction_numerical': 0.011365879798065262, 'mean_word_length': 4.238292214507313, 'pattern_counts': {'":': 0, '<': 1, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 9, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Identifying the Influential Inputs for Network Output Variance Using Sparse Polynomial Chaos Expansion

Sensitivity analysis (SA) is an important aspect of process automation. It often aims to identify the process inputs that influence the process output's variance significantly. Existing SA approaches typically consider the input-output relationship as a black-box and conduct extensive random sampling from the actual process or its high-fidelity simulation model to identify the influential inputs. In this paper, an alternate, novel approach is proposed using a sparse polynomial chaos expansion-based model for a class of input-output relationships represented as directed acyclic networks. The model exploits the relationship structure by recursively relating a network node to its direct predecessors to trace the output variance back to the inputs. It, thereby, estimates the Sobol indices, which measure the influence of each input on the output variance, accurately and efficiently. Theoretical analysis establishes the validity of the model as the prediction of the network output converges in probability to the true output under certain regularity conditions. Empirical evaluation on two manufacturing processes shows that the model estimates the Sobol indices accurately with far fewer observations than a state-of-the-art Monte Carlo sampling method.


I. INTRODUCTION
U NCERTAINTY quantification plays a critical role in controlling the uncertainties in process automation [1,2]. Automated processes that neglect important uncertainties are, at minimum, unstable, and, in the worst case, have catastrophic process outcomes in terms of both quality and productivity. To quantify how such uncertainties propagate through the process, sensitivity analysis is widely used in process automation. The sensitivity analysis of this study focuses on characterizing how the process output's variance is propagated from the inputs. This type of analysis is ubiquitous in different areas of automation science and engineering, such as thermodynamics [3], electromagnetism [4], power systems [5], building systems [6], and manufacturing [7].
How sensitive a random variable (e.g., process output) is with respect to another random variable (e.g., process input) is measured using a sensitivity index. Arguably, the most widely used sensitivity indices are the Sobol indices [8], which quantify how the independent inputs apportion the variance of the output. In practice, simple random sampling (from the actual process) or Monte Carlo sampling (from the simulation model of the process) is most commonly used to estimate the Sobol indices, where many observations of the inputs and output are available. A more resource-efficient alternative is to construct a model (or, metamodel) of the actual process (or, its simulation model when the computational cost is expensive), and use the model (or, metamodel) to estimate the Sobol indices [9].
Among such models, polynomial chaos expansion (PCE) is particularly conducive to estimating the Sobol indices, as detailed in Sec. II. In essence, the PCE expands a random variable (e.g., process output) in terms of orthonormal polynomials in other random variables (e.g., process inputs), and the expansion's coefficients directly yield convergent estimators of the Sobol indices thanks to the orthogonality of the polynomials in a Hilbert space.
However, such models, including PCE, typically consider the input-output relationship of a process as a blackbox for sensitivity analysis. This approach, while generally applicable to many processes, misses the opportunity to leverage the scientific/engineering knowledge of how the process actually works. Opening the black-box and utilizing the knowledge of the inner working can enable more effective modeling of the process, leading to more accurate and efficient sensitivity analysis.
To this end, this study considers a broad class of processes whose input-output relationships are expressed as directed acyclic graphs (DAGs), also known as directed acyclic networks. Since network-structured processes are ubiquitous in practice, several real-world systems can potentially benefit from this study, such as biological networks [10], supply chain systems [11], manufacturing operations [12], and process industries, in general [13]. In particular, this study uses two manufacturing processes (welding and injection molding) for illustration purposes in Sec. V.
Consequently, the main contribution of this paper is in the development of a novel model, called the sparse network PCE (SN-PCE), to accurately estimate the Sobol indices of the process output (sink node in the DAG) with respect to the process inputs (source nodes in the DAG). The estimated Sobol indices allow us to identify the inputs that significantly influence the output variance. The proposed model is validated through a theoretical analysis, which establishes that the prediction of the output converges in probability to the true output under certain regularity conditions (without imposing impractical restrictions such as parametric relationships among the network variables). The model is also empirically validated through sensitivity analysis of the two manufacturing processes, where it is shown to accurately estimate the Sobol indices with much fewer observations of the process inputs and output as compared to a state-of-the-art Monte Carlo method.
The remainder of this paper is organized as follows. Sec. II briefly reviews the technical background on the PCE and Sobol indices. Sec. III starts with formal definitions regrading the DAG and presents the following three PCEs to model a process represented as a DAG: naïve PCE, network PCE, and SN-PCE. Sec. IV discusses the theoretical properties of the PCEs. In Sec. V, the PCEs are applied to analyze the two manufacturing processes. Sec. VI concludes the paper with a discussion on future research directions.

II. Technical Background
In this section, we first formally define process inputs and output that bear uncertainties. Then, we present the PCE and sparse PCE. We review the construction of orthonormal polynomials for the PCE, the Hoeffding decomposition, and the Sobol indices. We also review how to estimate the Sobol indices using the PCE.

A. Input random vector and output random variable
In this paper, we generally use the same notations as [14], including N 0 := N ∪ {0}. A n ⊆ R n , n ∈ N, denotes a bounded or unbounded subdomain of R n . Let Ω be a sample space, and F be a σ-algebra on Ω. (Ω, F, P) is a probability space with a probability measure P : F → [0, 1]. The Borel σ-algebra on A n ⊆ R n is represented as B n := B(A n ). An A n -valued input random vector x := (x 1 , . . . , x n ) : (Ω, F) → (A n , B n ) describes the uncertainties of n process inputs of interest.
To model a process output y using the PCE in x, we assume that y is a function of x and is a square-integrable random variable defined on the same probability space (Ω, F, P), written y(x) ∈ L 2 (Ω, F, P).

B. Polynomial chaos expansion (PCE)
PCE approximates y using a finite number of orthonormal polynomials in x as follows: where θ i and ψ i (x), i = 0, 1, 2, . . . , P , denote the PCE coefficients and orthonormal polynomials in x, respectively. P + 1 is the number of the orthonormal polynomials and equals n+p n for the pre-specified highest polynomial order p and the dimension of x, dim(x) = n. Thus, P + 1 increases exponentially in n and p. As P increases, the approximation error in eq. (1) tends to zero [15].
In this paper, we adopt a regression-based method to obtain the PCE coefficients by solving an overdetermined linear system of equations in the least-squares sense as follows [16]: where θ denotes (θ 0 , θ 1 , . . . , θ P ). Y j and X j represent the output and the input vector of the j th observation, j = 1, . . . , m, respectively. Note that in contrast to typical regression models whose coefficients explain how the expectation of the output would conditionally change when the inputs are varied, the PCE coefficients are used to interpret how the variance of the output is apportioned to the inputs.
Thanks to the orthogonality of the orthonormal polynomials, the lower order moments of the output y are approximated using the PCE coefficients in eq. (1) as follows: where E is the expectation operator with respect to the probability measure P. The approximation errors in eq. (3) tend to zero as P in the PCE in eq. (1) increases.

C. Sparse PCE
The sparse PCE is extensively studied in the recent literature [17][18][19][20][21]. In this paper, we use l 1 minimization, specifically the least absolute shrinkage and selection operator (LASSO), to obtain a more parsimonious model than the model from eq. (2), by solving the following problem: whereȲ = m j=1 Y j /m. The parameter Γ constrains the goodness-of-fit for the sparse PCE (e.g., Γ = 0 requires a perfectly fitting model and Γ = 1 allows the model to be as simple as a constant model). The two application examples in Sec. V use Γ of 0.001.

D. Construction of multivariate orthonormal polynomials
A variety of PCEs have been proposed to construct orthonormal polynomials considering different types of input distributions. The Wiener chaos expansion, known as the first PCE, uses Hermite polynomials for independent Gaussian-distributed inputs [22]. Later PCEs allow for different input distributions and include the generalized PCE (gPCE) [23], the multi-element gPCE (ME-gPCE) [24], the moment-based arbitrary PCE (aPCE) [25], and the Gram-Schmidt based PCE (GS-PCE) [26]. In particular, the GS-PCE, which accounts for dependent inputs following arbitrary distributions [27], provides the basis for constructing the proposed model in this paper.
In this work, process inputs are assumed to be mutually independent. However, the other variables in the process (represented as a network) are allowed to be dependent on others. When the variables in x are mutually independent, the orthonormal polynomials are directly constructed as the tensor products of the univariate orthonormal polynomials as follows: where α i := (α i1 , α i2 , . . . , α in ). ψ α ij (x j ) represents the α ij -th order orthonormal polynomial in input x j . α i is the i-th arbitrary vector satisfying |α i | := n j=1 α ij ≤ p, where p is the highest order of the polynomials in the PCE. When variables are dependent on each other, we construct orthonormal polynomials using the modified Gram-Schmidt algorithm, as proposed in [28].

E. Hoeffding decomposition and Sobol indices
Suppose the inputs in the n-dimensional vector x are mutually independent and y = f (x) ∈ L 2 (Ω, F, P). Denote the probability density function of x as µ(x). The Hoeffding decomposition of f (x) is then defined as follows [8,29]: where f ∅ := f 0 is a constant and x u := (x j ) j∈u for u = ∅. Such decomposition is unique if and only if the summands in eq. (6) are orthogonal to each other as follows [8]: Due to the orthogonal property in eq. (7), the functional decomposition of V ar(y) is expressed as follows [30]: Based on the decomposition, our sensitivity analysis considers the first-order Sobol index S x j and total Sobol index ST x j of y with respect to x j defined as follows: where S u := D u (y)/V ar(y). The first-order Sobol index S x j measures the main effect of input x j on the output variance V ar(y). The total Sobol index ST x j measures the total contribution of x j to V ar(y) including its main effect and interactions with other inputs [31].

F. PCE-based Sobol indices
The Sobol indices can be estimated directly using the PCE coefficients in eq. (1), making PCE particularly useful for the sensitivity analysis [32]. The first-order Sobol index is estimated as follows: where θ α i is the PCE coefficient with respect to ψ α i (x) in eq. (5) and The total Sobol index is estimated as follows: where

III. Methodology
In this section, we first define notations on the directed acyclic graph (DAG), which represents the networkstructured process of interest. Then, we present three models to estimate the Sobol indices for the process output with respect to the process inputs. The first model called the naïve PCE is a baseline model and directly approximates the process output as a function of the process inputs, viewing the process as a black-box. The second model called the network PCE uses the network structure of the process to effectively approximate the process output in terms of the process inputs. The third model called the sparse network PCE (SN-PCE) imposes sparsity on the second model to use even fewer observations for the sensitivity analysis than the other models.

A. Directed acyclic graph
Let G = DAG(V, E) be the directed acyclic graph that represents the network-structured process of interest. V = {v 1 , v 2 , . . . , v |V | } is the collection of all the nodes in G, where |V | denotes the number of the nodes. Let x v i denote the random variable represented by the node v i ∈ V and, the collection of all the directed edges in G, encoding all dependencies between the nodes. For example, v i , v j ∈ E implies that there is an edge from node v i to node v j , and hence x v j depends on x v i . The adjacency matrix A is defined as follows: We call the variables in x S(G) network inputs and the variables represented by the sink nodes network outputs. The node corresponding to the network output y is denoted by v y .
We say that there exists a path from v i to v j if and only if either A ij = 1 or there exists a sequence of nodes This function is useful for the naïve PCE, which uses the network inputs that influence y, denoted as ξ := x S(G)∩V y for We assume the variables in ξ are mutually independent hereafter to well-define the Sobol indices of y with respect to ξ.
For the network PCE, which relates each node to its direct predecessors, we define represents the source nodes in v, which do not have any direct predecessors. For l ∈ N, P l (x v ) denotes applying the operator P(·) on x v l times.
The network PCE can be applied to any DAG, which contains any of the four possible 3-node motifs [33]. Fig. 1 shows an example DAG, which contains all the four motifs (e.g., 6 ) are mutually independent. The node v 13 is the sink node corresponding to the network output y. This example DAG will be used in the following subsections to illustrate the naïve PCE and the network PCE. The variable represented by node v 13 , xv 13 , is the network output y. The arrows represent dependent relationships; e.g., y = xv 13 directly depends on xv 11 and xv 12 , while indirectly depending on all the network inputs.

B. Naïve PCE
The naïve PCE is the standard PCE in eq. (1) that approximates y directly as a function of the network inputs that influence y, ξ = x S(G)∩V y , as follows: This PCE directly yields the estimated Sobol indices of y with respect to ξ based on eqs. (8) and (9). The naïve PCE algorithm is summarized in Algorithm 1.

Algorithm 1 Naïve PCE Algorithm
Input: G = DAG(V, E); at least P + 1 observations of the network output y and inputs ξ = x S(G)∩V y . Output: Sobol indices of y with respect to each input in ξ. 1: Construct univariate orthonormal polynomials for each input in ξ. 2: Construct multivariate orthonormal polynomials for ξ as the tensor products of the univariate orthonormal polynomials using eq. (5). 3: Estimate θ in eq. (10) by solving an equivalent problem to eq. (2). 4: Estimate the Sobol indices based on the estimated θ using eqs. (8) and (9).
As discussed in Sec. II-B, the number of orthonormal polynomials, P , increases exponentially in dim (ξ). Thus, this naïve approach of taking the network as a blackbox requires an exponentially increasing number of observations to solve an equivalent problem to eq. (2) as dim (ξ) increases. In other words, a sensitivity analysis with respect to a large number of network inputs requires a large number of observations for the naïve PCE. This issue is mitigated by the network PCE that explicitly considers the network structure.

C. Network PCE
The network PCE is proposed to leverage the known network structure of the process of interest to improve the efficiency and accuracy of sensitivity analysis. Intuitively speaking, this model recursively relates a network node to its direct predecessors to trace the output variance back to the network inputs. How uncertainties propagate through the network is effectively captured by the PCE coefficients in the model. The coefficients directly yield estimated Sobol indices of the output with respect to each input in the network.
The recursive modeling process for the network PCE starts from the sink node v y (e.g., v 13 in Fig. 1) and traces it back to the source nodes (e.g. Fig. 1). The network output y is first modeled as the PCE in P(y) (e.g., (x v 11 , x v 12 ) in Fig. 1), which includes the variables corresponding to the direct predecessors of v y . Then, their direct predecessors are recursively found until y is modeled as the PCE in ξ, or equivalently, P L (y), where L := inf{l ∈ N : P l (y) = P l+1 (y)} denotes the total number of iterations.
In the l th iteration of this recursive process for l = 1, . . . , L, we need to find mutually independent vectors to use in a PCE (recall eq. (5)). Thus, we define the mutually independent decomposition of P l (y) as follows: which has an arbitrary order of the elements and satisfies the following two conditions: is the number of elements of the tuple in eq. (11). For example, in Fig. 1, the mutually independent decompositions of P(y) and P 2 (y) are x v 10 ), respectively. Hence, n (1) = 2 and n (2) = 3, not 4.
In the l th iteration, the network PCE approximates y using the PCE as follows: where each orthonormal polynomial ψ (l) i P l (y) can be obtained using the mutually independent decomposition of P l (y) in eq. (11) as follows: Here α is the i-th arbitrary tuple ij ≤ p (l) for the pre-specified highest polynomial order p (l) . α (l) ij is the vector composed of the polynomial orders with respect to the variables in obtained using the modified Gram-Schmidt algorithm [28].
In the first iteration (l = 1), the PCE coefficients, θ (l) i , i = 0, 1, . . . , P (l) , in eq. (12) are estimated by solving an equivalent problem to eq. (2) where only the notations are different. For the subsequent iterations (l ≥ 2), the coefficients are calculated in a different way using the previous iteration's coefficients, as detailed next.
To model y as a function of P l+1 (y), or equivalently, , the network PCE substitutes ψ to obtain the approximation of eq. (13) as follows: Without loss of generality, we let the highest polynomial order p (l) ij of orthonormal polynomials in eq. (14) to be the constant p (l+1) . Substitutingψ (l) i P l (y) in eq. (15) for ψ (l) i P l (y) in eq. (12) yields the approximation of y for the (l + 1) th iteration as follows: where the PCE coefficient θ (17) is calculated after estimating the coefficients in eq. (14) (by solving an equivalent problem to eq. (2)) and rearranging the terms in eq. (16), which involve the previous iteration's coefficients. This recursive approach of calculating the PCE coefficient helps reduce the minimally required number of observations compared to the naïve PCE, as explained later.
The above iteration ends when y is approximated as the PCE in P L (y), or equivalently, ξ as follows: where P (L) depends on the highest polynomial orders, p (1) , . . . , p (L) . This recursive approximation process is valid as shown in Theorem 3 in Sec. IV, which proves the convergence ofŷ (L) in eq. (18) to y in probability. The PCE coefficients, θ i , i = 1, . . . , P (L) , in eq. (18) directly yield the estimated Sobol indices of y with respect to each input in ξ, as described in Sec. II-F. The network PCE algorithm is summarized in Algorithm 2.

Algorithm 2 Network PCE Algorithm
observations of the network output y and all the variables in x V y ; Iteration counter l = 1. Output: Sobol indices of y with respect to each input in ξ = x S(G)∩V y .
in eq. (13) using the modified Gram-Schmidt algorithm for i = 0, 1, . . . , P (l) and j = 1, 2, . . . , n (l) . An advantage of the network PCE over the naïve PCE lies in its potential to use much fewer observations for solving equivalent problems of eq. (2). The minimally required number of observations for either model is equal to the largest number of orthonormal polynomials of any PCE used in the model. Thanks to the recursive decomposition procedure of the network PCE, it tends to use a much smaller PCE than the naïve PCE especially when the number of the inputs that influence y is large (i.e., dim(ξ) 1). To illustrate this point, assume all PCEs in the network PCE use the same highest polynomial order p (l) = p, l = 1, 2, . . . , L, as the naïve PCE. Then, the minimally required number of observations for the naïve PCE increases exponentially in dim(ξ), as explained below eq. (1). That for the network PCE (see Input of Algorithm 2) increases exponentially in the largest number of variables used for any PCE in Steps 3 and 4 of Algorithm 2, Here, denotes the set of all direct predecessors of the output node v y and D (l) denotes the set of all direct predecessors of the nodes in v (l) j in eq. (14). Fig. 2 visualizes the minimally required number of observations with respect to p and the ratio The saving of the network PCE (with λ < 1) over the naïve PCE (λ = 1) increases as p increases or λ decreases.

D. Sparse network PCE (SN-PCE)
The network PCE uses many orthonormal polynomials to capture all main effects and major interaction effects of the variables in the network on the output variance. However, in practice, many of such effects are insignificant. Therefore, we propose the SN-PCE, which imposes l 1sparsity on the PCE coefficients to capture only significant pathways of uncertainty propagation in the network. Specifically, the SN-PCE solves an equivalent problem of eq. (4) (with the difference lying only in the notations) instead of eq. (2) in Steps 3 and 4 of Algorithm 2. The resulting parsimonious model can use even fewer observations than the network PCE (which can already save substantially over the naïve PCE) to estimate the PCE coefficients and, in turn, the Sobol indices. Also, because only significant effects appear in the model (with non-zero PCE coefficients), the model is easier to interpret than the other models.

IV. Theoretical Result
In this section, we show that predicted outputs from the naïve PCE and the network PCE converge to the true network output in probability under certain regularity conditions. This validates the use of the PCEs for estimating Sobol indices to conduct a sensitivity analysis. Because the SN-PCE is a sparsity-imposed version of the network PCE, its validity follows from the validity of the network PCE and the sprase PCE.
Because the naïve PCE is the direct application of the standard PCE in eq. (1), the corresponding theoretical result (Theorem 1) directly follows from [14] by appropriately invoking Assumption 1 below. The result is still presented here mainly for comparison with the theoretical result on the network PCE (Theorem 3).
Assumption 1 (adapted from [14]). The random vector x := (x 1 , . . . , x n ) T : (Ω, F) → (A n , B n ) 1) has a continuous joint probability density function µ(x) with a bounded or unbounded support A n ⊆ R n ; 2) possesses absolute finite moments of all orders, that is, ∀j := (j 1 , j 2 , . . . , j n ) ∈ N n 0 , where x j := x j 1 1 · · · x j n n ; and 3) has a joint probability density function µ(x), which a) has a compact support, that is, there exists a compact subset A n ⊂ R n such that P(x ∈ A n ) = 1, or b) is exponentially integrable, that is, there exists a real number α > 0 such that where || · || : A n → R + 0 is an abitrary norm. Theorem 1. Suppose that for the network output y(ξ) ∈ L 2 (Ω, F, P), ξ = x S(G)∩V y fulfills Assumption 1. Then,ŷ in eq. (10) converges to y in probability as P → ∞.
Proof. This is a direct result of Theorem 11 in [14].
Theorem 1 imposes regularity conditions on the network inputs ξ and output y, not the other variables on the network. This black-box approach of the naïve PCE still provides a convergent prediction of y as P → ∞. In practice, increasing P requires increasing the number of observations. Thus, the finite-sample inefficiency of the naïve PCE compared to the network PCE (described in Sec. III-C) is critical when the sample size is limited.
Theoretical results on the network PCE impose regularity conditions on all variables on the network because the knowledge of network structure provides the network PCE's advantage over the naïve PCE. Lemma 2 validates the recursive modeling of a network node using its direct predecessors (described in Steps 1-5 in Algorithm 2). Building on Lemma 2, Theorem 3 proves the convergence of the network PCE output in eq. (18).
To proveŷ (l+1) P → y under the aforementioned conditions, we show that for any > 0 and any δ > 0, there exists P Note that P (l) is an increasing function of p (l ) , l = 1, . . . , l. The right-hand side of eq. (23) can be rewritten as by the triangular inequality. By the inductive hypothesis, there exists P (l) 1 such that ∀P (l) ≥ P (l) 1 , the second term in eq.(24) satisfies The first term in eq.(24) can be upper-bounded using the triangular inequality as follows: Note that P (l) ij in eq. (14) is an increasing function of the highest polynomial order p (l) ij , which is assumed to be the constant p (l+1) in Sec. III-C. By Lemma 2, there exists an increasing function γ (l) : N → N such that ∀p (l+1) ≥ γ (l) P (l) , the summand in eq.(26) satisfies for i = 0, 1, . . . , P (l) , and for any P (l) ∈ N. Therefore, eq.(26) is upper-bounded by δ/2, ∀p (l+1) ≥ γ (l) P (l) . Putting this together with eq.(25) proves the existence of P such that ∀P (l) ≥ P (l) 0 , eq.(23) is upperbounded by δ, completing the proof ofŷ (l+1) P → y as P (l) → ∞ if p (l+1) = γ (l) P (l) . By mathematical induction, the conclusion of the theorem follows.
The increasing function γ (l) in Theorem 3 prescribes how fast the highest polynomial order p (l+1) = γ (l) P (l) should grow in relation to the number of orthonormal polynomials, P (l) , for l = 1, . . . , L − 1 so thatŷ (L) in eq. (18) converges to y in probability. Furthermore, to make the relation between p (l+1) and p (l) more explicit, using eqs. (20) and (21) for l = 1, . . . , L, Stirling's approximation yields using the big O notation. For example, if γ (l) is linear (or superlinear), then p (l+1) should grow as fast as (or faster than) d (l) -th power of p (l) , or equivalently, l l =1 d (l ) -th power of p (1) for l = 1, . . . , L − 1. Intuitively speaking, we should control the approximation errors for the upstream nodes in the network more tightly to ensure that the approximation errors for the downstream nodes (especially the output node) are arbitrarily small. We note that it is beyond the scope of this paper to establish more detailed characteristics of γ (l) .
The SN-PCE, which tends to use much smaller P (l) , l = 1, . . . , L, than the network PCE, mitigates the need for rapidly increasing p (l) , l = 1, . . . , L, while maintaining a similar approximation accuracy.

V. Applications
For empirical evaluation of the proposed methodology, we conduct sensitivity analysis of two manufacturing processes, namely, the welding process and the injection molding process. Each process has multiple variables whose relationships are modeled as a network in [34]. We use the same modeling equations and notations therein (hence, some notation conflicts arise although their meanings are clear from the context).
We compare three methods, a state-of-the-art Monte Carlo method [35], the naïve PCE, and the SN-PCE, for estimating the first-order and total Sobol indices. The estimation is based on randomly generated observations of the process variables using the models in [34]. The estimation is replicated 200 times to calculate the sample mean and standard error of the estimated Sobol indices for each method.
As discussed in Sec. II-E, the Sobol indices measure the influence of each network input on the variance of the network output. Hereafter, we call some network inputs influential inputs if their first-order Sobol indices are 10 −1 or larger; in other words, influential inputs explain 10% or more of the output variance without considering their interactions with other inputs.
The Monte Carlo method in [35] is used as a benchmark method because it is known to be more accurate than other Monte Carlo methods for estimating small Sobol indices. We use a large sample for the Monte Carlo method, namely, 10,000 observations and treat its sample mean from the 200 replications as the ground truth if the standard error is below 1% of the sample mean. Even with a large sample, Monte Carlo methods tend to have large standard errors for estimating small total Sobol indices [35,36], as also observed in this study.

A. Welding process
The welding process has several process variables whose relationships are depicted in Fig. 3. The process output of interest is the total minimum theoretical energy required for the welding process, E. This energy depends on the weld volume V , specific gravity ρ, heat capacity C p , initial temperature T i , final temperature T f , and latent heat H as follows: Fig. 3. This DAG represents the relationships among the variables in the welding process [34]; the weld volume V depends on six welding parameters (weld zone dimensions: e, g, h, l, and t; weld length L), and the total energy E depends on V and additional parameters, ρ, Cp, T i , T f , and H.
In turn, the weld volume V depends on six welding parameters (weld zone dimensions: e, g, h, l, and t; weld length L) as follows: The process inputs' distributions are presented in Table I. Compared to the Monte Carlo method that uses 10,000 observations, we use much fewer observations for the naïve PCE and the SN-PCE, namely, 500 and 100, respectively. These samples sizes are still sufficient because we use the highest polynomial order of 3 for both the naïve PCE and the SN-PCE; the naïve PCE requires at least 364 = 11+3  Table I shows the sample means and standard errors of the estimated Sobol indiceses for the three methods. Despite the vastly different sample sizes used for each method, the sample means are nearly identical across the methods (except for the non-influential inputs, which have total Sobol indices smaller than 10 −1 ). This indicates the estimation bias is nearly zero for these methods. The standard errors are also very similar across the methods for the influential inputs, indicating that the SN-PCE achieves a similar accuracy as the other methods with a much smaller sample size. Fig. 4 presents a Pareto chart of the first-order Sobol indices estimated from the SN-PCE. Along with Table  I, the chart confirms that the weld zone dimensions (h, g, t, e, l) are the most influential inputs for the variance of the process output E. Also, the cumulative sum of the first-order Sobol indices approaches 100% in the chart, implying that the interactions between the inputs do not have significant effects on the variance of E. It echoes the finding from Table I that

B. Injection molding process
The injection molding process has more intricate relationships between process variables than the welding process, as depicted in Fig. 5. The process output of interest is the energy consumed in resetting the process, E reset . This energy depends on the melting energy E melt , the injection energy E inj , and the cooling energy E cool as fol- Here, ρ (specific gravity), C p (heat capacity), T pol (initial polymer temperature), (shrinkage parameter), and T inj (injection temperature) are the network inputs. Q (flow rate), H f (polymer heat of fusion), V part (volume of mold), and ∆ (buffer) are constant parameters. On the other hand, E inj = P inj × V part and where P inj (injection pressure), T ej (ejection temperature), and T inj (injection temperature) are the network inputs. COP (coefficient of performance of the cooling equipment) is a constant parameter. The network inputs' distributions are presented in Table II.
To adequately model the more intricate network structure of the injection molding process, we use the highest polynomial order of 4 for both the naïve PCE and the SN-PCE, compared to 3 used for the welding process; the naïve PCE requires at least 330 = 7+4 4 observations for dim(ξ) = 7 and the network PCE (i.e., SN-PCE without sparsity) requires at least 126 = 5+4 This DAG represents the relationships among the variables in the injection molding process [34]; the yellow shaded nodes E melt , E cool , and E inj are the energies consumed in three subprocesses that depend on different blue shaded network inputs. The network output E reset depends on E melt , E cool , and E inj .
compared to 500 and 100 used for the welding process. Yet, again, the SN-PCE could use even fewer observations because it identifies only 9 orthonormal polynomials (3% of those used in the naïve PCE) as necessary to approximate the network output of this particular process across all 200 replications. Like the welding process, the injection molding process turns out to have the first-order Sobol indices approximately equal to the total Sobol indices for the influential inputs. Thus, we only report the first-order Sobol indices in Table II. Again, the SN-PCE attains similar standard errors as the other methods for the influential inputs despite using fewer observations. Fig. 6 shows that T inj determines nearly 50% of the variance of network output E reset . T ej and ρ have comparable effects (26% and 23%, respectively), while other inputs, T pol , C ρ , , and P inj , barely influence the variance of E reset .

VI. Conclusion
This paper proposes the SN-PCE to model uncertainty propagation in a broad class of processes represented as DAGs. A DAG encodes the dependencies between the variables in a process, including the process output (sink node in the DAG) and inputs (source nodes in the DAG). The SN-PCE effectively captures how the inputs influence the output variance. Theoretically, it is shown that the network PCE (equivalent to the SN-PCE without sparsity) is valid in the sense that its prediction of the output converges in probability to the true output under reasonable assumptions. Empirically, the SN-PCE is shown to accurately estimate the Sobol indices of the output with respect to the inputs for two manufacturing processes. The SN-PCE uses substantially fewer observations than the black-box approaches (a state-of-the-art Monte Carlo method and the naïve PCE) to accurately identify the influential inputs, showing promise for efficient sensitivity analysis in process automation.
Future research may investigate extension of the proposed model to even more general networks. One direction could be to relax the assumption of mutual independence of the network inputs. While their dependencies would complicate the estimation and interpretation of the sensitivity indices, the indices proposed in [28] might help decode how the dependent network inputs influence the output. Another research direction would be to allow cycles (or, feedback loops) in the network, thereby, extending this work beyond directed acyclic networks.